Video and accelerometer-based motion analysis for automated surgical skills assessment
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Purpose Basic surgical skills of suturing and knot tying are an essential part of medical training. Having an automated system for surgical skills assessment could help save experts time and improve training efficiency. There have been some recent attempts at automated surgical skills assessment using either video analysis or acceleration data. In this paper, we present a novel approach for automated assessment of OSATS-like surgical skills and provide an analysis of different features on multi-modal data (video and accelerometer data).Methods We conduct a large study for basic surgical skill assessment on a dataset that contained video and accelerometer data for suturing and knot-tying tasks. We introduce "entropy-based" features-approximate entropy and cross-approximate entropy, which quantify the amount of predictability and regularity of fluctuations in time series data. The proposed features are compared to existing methods of Sequential Motion Texture, Discrete Cosine Transform and Discrete Fourier Transform, for surgical skills assessment.Results We report average performance of different features across all applicable OSATS-like criteria for suturing and knot-tying tasks. Our analysis shows that the proposed entropy-based features outperform previous state-of-the-art methods using video data, achieving average classification accuracies of 95.1 and 92.2% for suturing and knot tying, respectively. For accelerometer data, our method performs better for suturing achieving 86.8% average accuracy. We also show that fusion of video and acceleration features can improve overall performance for skill assessment.Conclusion Automated surgical skills assessment can be achieved with high accuracy using the proposed entropy features. Such a system can significantly improve the efficiency of surgical training in medical schools and teaching hospitals.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Some studies analyze tool movement or other cues to assess surgeon skill 119,121,123,124 , through established ratings such as the Global Operative Assessment of Laparoscopic Skills (GOALS) criteria for laparoscopic surgery 125 .”
From Deep learning-enabled medical computer vision (2021) · cites this paper as [119]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Early studies have begun pursuing these objectives, primarily in video-based robotic and laparoscopic surgery-a number of works propose methods for detecting surgical tools and actions [118][119][120][121][122][123][124] .”
From Deep learning-enabled medical computer vision (2021) · cites this paper as [119]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Approximate entropy as a measure of system complexity.
Pincus, S. M. (1991) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.88.6.2297 · Cited by 5,811 · cited 1×
“Approximate Entropy: Approximate entropy is a measure of regularity in time series data initially proposed in [15].”
BackgroundNote on the Sampling Error of the Difference Between Correlated Proportions or Percentages
McNemar, Q. (1947) · Psychometrika · doi:10.1007/bf02295996 · Cited by 4,754 · cited 1×
“In order to check the statistical significance of the presented results in Table 2, we conducted McNemar’s test [27].”
MethodFloating search methods in feature selection
Pudil, P., Novovičová, J., & Kittler, J. (1994) · Pattern Recognition Letters · doi:10.1016/0167-8655(94)90127-9 · Cited by 3,098
Laptev, I. (2005) · International Journal of Computer Vision · doi:10.1007/s11263-005-1838-7 · Cited by 2,629
Objective structured assessment of technical skill (OSATS) for surgical residents
Martin, J. A., Regehr, G., Reznick, R., Macrae, H., Murnaghan, J., Hutchison, C., & Brown, M. (1997) · British Journal of Surgery · doi:10.1002/bjs.1800840237 · Cited by 2,527 · cited 1×
“essments, even by experts are subjective and prone to errors. Objective Structured Assessment of Technical Skills (OSATS) is adopted in most medical schools as a standard to assess surgical residents [1]. The OSATS grading scheme includes specic criteria like Respect for Tissue (RT), Time and Motion (TM), Instrument H…”
BackgroundEndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videos
Twinanda, A. P., Shehata, S., Mutter, D., Marescaux, J., de Mathelin, M., & Padoy, N. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2593957 · Cited by 1,096 · cited 1×
“Surgical activity recognition works have used methods like linear dynamical systems (LDS) and bag of words (BoW) models [13,14] and more recently, deep neural networks and recurrent neural network-based approaches have been reported [15,16] for surgical tool detection and gesture recognition.”
MethodRandomness and degrees of irregularity.
Pincus, S., & Singer, B. H. (1996) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.93.5.2083 · Cited by 483 · cited 1×
“Cross-approximate entropy Cross-approximate entropy (XApEn) is a measure of asynchrony between two time series [25].”
BackgroundGoh, A. C., Goldfarb, D. W., Sander, J. C., Miles, B. J., & Dunkin, B. J. (2012) · Journal of Urology · doi:10.1016/j.juro.2011.09.032 · Cited by 480 · cited 1×
“Global Evaluative Assessment of Robotic Skills (GEARS) is an assessment tool specifically developed to assess levels of robotic surgical expertise and is known to be consistent and reliable as reported in [19].”
MethodAnnotation by Category: ELAN and ISO DCR
Sloetjes, H., & Wittenburg, P. (2008) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/454o8uo6f7z8 · Cited by 469
Rosen, J., Hannaford, B., Richards, C. G., & Sinanan, M. N. (2001) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.918597 · Cited by 263 · cited 3×
“(RMIS) and focused on gesture recognition and skill assessment using Hidden Markov Models [8,9].”
Method
Research works printed but not linked: 3
- Sharma Y, Bettadapura V, Plötz T, Hammerla N, Mellor S, McNaney R, Olivier P, Deshmukh S, McCaskie A, Essa I (2014) Video based assessment of OSATS using sequential motion textures. In: International workshop on modeling and monitoring of computer assisted interventions (M2CAI)—international conference on medical image computing and computer-assisted intervention—MICCAI
- Reiley C, Hager G (2009) Decomposition of robotic surgical tasks: an analysis of subtasks and their correlation to skill. In: International conference on medical image computing and computer-assisted intervention–MICCAI
- Gao Y, Vedula SS, Reiley CE, Ahmidi N, Varadarajan B, Lin HC, Tao L, Zappella L, Béjar B, Yuh DD, Chen CCG, Vidal R, Khundanpur S, Hager GD (2014) JHU-ISI gesture and skill assessment working set (JIGSAWS): a surgical activity dataset for human motion modeling. In: International workshop on modeling and monitoring of computer assisted interventions (M2CAI)—international conference on medical image computing and computer-assisted intervention—MICCAI, vol 3
Cited by
Deep learning-enabled medical computer vision
Esteva, A., Chou, K., Yeung, S., Naik, N., Madani, A., Mottaghi, A., Liu, Y., Topol, E., Dean, J., & Socher, R. (2021) · npj Digital Medicine · doi:10.1038/s41746-020-00376-2 · Cited by 1,406
Video-based surgical skill assessment using 3D convolutional neural networks
Funke, I., Mees, S. T., Weitz, J., & Speidel, S. (2019) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-019-01995-1 · Cited by 201
“[34] extract spatio-temporal interest points (STIPs) from each video frame.”
BackgroundWhat and How Well You Performed? A Multitask Learning Approach to Action Quality Assessment
Parmar, P., & Morris, B. T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00039 · Cited by 208
“Existing AQA [18, 16, 26, 13, 25] and skills assessment [4, 10, 31, 32, 33] approaches use a single label, known as a final score or skill-level, to train the system using some kind of regression or ranking loss function.”
MethodUncertainty-Aware Score Distribution Learning for Action Quality Assessment
Tang, Y., Ni, Z., Zhou, J., Zhang, D., Lu, J., Wu, Y., & Zhou, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00986 · Cited by 209
Machine learning for technical skill assessment in surgery: a systematic review
Lam, K., Chen, J., Wang, Z., Iqbal, F. M., Darzi, A., Lo, B., Purkayastha, S., & Kinross, J. M. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00566-0 · Cited by 174
Metadata
- Authors
- Zia, A., Sharma, Y., Bettadapura, V., Sarin, E. L., & Essa, I.
- Affiliations
- Georgia Institute of Technology (US)
- Emory University (US)
- Corresponding author
- Zia, Aneeq
- Venue
- International Journal of Computer Assisted Radiology and Surgery
- Published
- 2018-01-29
- Volume
- 13
- Issue
- 3
- Pages
- 443-455
- ISSN
- 1861-6410 (ISSN-L)
- 1861-6429
- OpenAlex
- W2594473568
- Cited by
- 134
- References
- 27
- Citations by year
- 2026: 12 · 2025: 17 · 2024: 14 · 2023: 18 · 2022: 14 · 2021: 25 · 2020: 15 · 2019: 14 · 2018: 5
- FWCI
- 15.28
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- International Journal of Computer Assisted Radiology and Surgery (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Health Sciences › Medicine › Surgery › Surgical Simulation and Training
- Social Sciences › Education › Innovations in Medical Education
- Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
- Keywords
- OSATS, suturing, knot tying, approximate entropy, cross-approximate entropy, video analysis, accelerometer data, multimodal fusion, surgical training, time series features
- MeSH terms
- Clinical Competence, Education, Medical, Humans, Schools, Medical, Suture Techniques, Video Recording, Accelerometry
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Video and accelerometer-based motion analysis for automated surgical skills assessment. https://app.cochat.ai/papers/10.1007/s11548-018-1704-z
- The paper
- Zia, A., Sharma, Y., Bettadapura, V., Sarin, E. L., & Essa, I. (2018). Video and accelerometer-based motion analysis for automated surgical skills assessment. International Journal of Computer Assisted Radiology and Surgery. https://doi.org/10.1007/s11548-018-1704-z
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.