The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Eye Metrics as an Objective Assessment of Surgical Skill
Abstract
OBJECTIVE: Currently, surgical skills assessment relies almost exclusively on subjective measures, which are susceptible to multiple biases. We investigate the use of eye metrics as an objective tool for assessment of surgical skill. SUMMARY BACKGROUND DATA: Eye tracking has helped elucidate relationships between eye movements, visual attention, and insight, all of which are employed during complex task performance (Kowler and Martins, Science. 1982;215:997-999; Tanenhaus et al, Science. 1995;268:1632-1634; Thomas and Lleras, Psychon Bull Rev. 2007;14:663-668; Thomas and Lleras, Cognition. 2009;111:168-174; Schriver et al, Hum Factors. 2008;50:864-878; Kahneman, Attention and Effort. 1973). Discovery of associations between characteristic eye movements and degree of cognitive effort have also enhanced our appreciation of the learning process. METHODS: Using linear discriminate analysis (LDA) and nonlinear neural network analyses (NNA) to classify surgeons into expert and nonexpert cohorts, we examine the relationship between complex eye and pupillary movements, collectively referred to as eye metrics, and surgical skill level. RESULTS: Twenty-one surgeons participated in the simulated and live surgical environments. In the simulated surgical setting, LDA and NNA were able to correctly classify surgeons as expert or nonexpert with 91.9% and 92.9% accuracy, respectively. In the live operating room setting, LDA and NNA were able to correctly classify surgeons as expert or nonexpert with 81.0% and 90.7% accuracy, respectively. CONCLUSIONS: We demonstrate, in simulated and live-operating environments, that eye metrics can reliably distinguish nonexpert from expert surgeons. As current medical educators rely on subjective measures of surgical skill, eye metrics may serve as the basis for objective assessment in surgical education and credentialing in the future. Further development of this potential educational tool is warranted to assess its ability to both reliably classify larger groups of surgeons and follow progression of surgical skill during postgraduate training.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ericsson, K. A. (2007) · Medical Education · doi:10.1111/j.1365-2923.2007.02946.x · Cited by 271
Ericsson, K. A., & Ward, P. (2007) · Current Directions in Psychological Science · doi:10.1111/j.1467-8721.2007.00533.x · Cited by 268
Cited by
Winkler-Schwartz, A., Bissonnette, V., Mirchi, N., Ponnudurai, N., Yilmaz, R., Ledwos, N., Siyar, S., Azarnoush, H., Karlik, B., & Del Maestro, R. F. (2019) · Journal of Surgical Education · doi:10.1016/j.jsurg.2019.05.015 · Cited by 295
Systematic review of measurement tools to assess surgeons' intraoperative cognitive workload
Dias, R. D., Ngo-Howard, M. C., Boskovski, M. T., Zenati, M. A., & Yule, S. J. (2018) · British Journal of Surgery · doi:10.1002/bjs.10795 · Cited by 273
Using task-induced pupil diameter and blink rate to infer cognitive load.
Chen, S., & Epps, J. (2014) · Human–Computer Interaction · doi:10.1080/07370024.2014.892428 · Cited by 200
“…system usability (Nakayama & Katsukura, 2007; Józsa 2011) and can differentiate the load changes in visual and audio presentation types (Klingner, Tversky & Hanrahan, 2011), ages (Piquado, Isaacowitz & Wingfield, 2010), intelligence (Beatty, 1982), and experts and novices (Richstone et al., 2010).”
Artificial Intelligence and Surgical Education: A Systematic Scoping Review of Interventions
Kirubarajan, A., Young, D., Khan, S., Crasto, N., Sobel, M., & Sussman, D. (2022) · Journal of Surgical Education · doi:10.1016/j.jsurg.2021.09.012 · Cited by 101
Han, B., Ma, Y., Coghlan, S., McKay, D., Buchanan, G., & Smith, W. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790360 · Cited by 3
“It has been applied to assess student performance in complex tasks like surgical simulations [75, 111] and to mitigate mind-wandering with timely interventions [33, 64].”
Metadata
- Authors
- Richstone, L., Schwartz, M. J., Seideman, C., Cadeddu, J., Marshall, S., & Kavoussi, L. R.
- Venue
- Annals of Surgery
- Published
- 2010-07
- Volume
- 252
- Issue
- 1
- Pages
- 177-182
- ISSN
- 0003-4932 (ISSN-L)
- OpenAlex
- W1992755595
- Cited by
- 196
- References
- 2
- FWCI
- 5.59
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.