The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Global Evaluative Assessment of Robotic Skills: Validation of a Clinical Assessment Tool to Measure Robotic Surgical Skills
Abstract
PURPOSE: We developed and validated a standardized assessment tool for robotic surgical skills, and report its usefulness, reliability and construct validity in a clinical setting. MATERIALS AND METHODS: The Global Evaluative Assessment of Robotic Skills is a tool developed by deconstructing the fundamental elements of robotic surgical procedures in consultation with expert robotic surgeons. Surgical performance was assessed during robot-assisted laparoscopic prostatectomy on a 5-point anchored Likert scale across 6 domains. An overall performance score was derived by summing the ratings in each domain. Expert surgeons and postgraduate year 4 to 6 urology residents were evaluated to determine construct validity. Assessments were completed by the attending surgeon, a trained observer and the operator. RESULTS: A total of 29 evaluations of 25 trainees and 4 attending surgeons were completed. Experts scored significantly higher on the assessment than novice operators (p = 0.004). Postgraduate year 4 and 5 residents scored significantly lower than the expert group (p <0.05) while no difference was observed between mean performance scores of postgraduate year 6 trainees and attending surgeons (p >0.05). The internal consistency of the assessment tool was excellent (Cronbach's α = 0.90 to 0.93). The overall assessment score ICC among raters was 0.80 (95% CI 0.65-0.90). CONCLUSIONS: The Global Evaluative Assessment of Robotic Skills is simple to administer and able to differentiate levels of robotic surgical expertise. This standardized assessment tool shows excellent consistency, reliability and validity. Further study is warranted to evaluate its usefulness for surgical education and the establishment of competency in robotic surgery.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Martin, R. (1986) · Medical Entomology and Zoology · Cited by 8,752
Objective structured assessment of technical skill (OSATS) for surgical residents
Martin, J. A., Regehr, G., Reznick, R., Macrae, H., Murnaghan, J., Hutchison, C., & Brown, M. (1997) · British Journal of Surgery · doi:10.1002/bjs.1800840237 · Cited by 2,527
Encyclopedia of Statistics in Behavioral Science
(2005) · Wiley eBooks · doi:10.1002/0470013192 · Cited by 1,441
A global assessment tool for evaluation of intraoperative laparoscopic skills
Vassiliou, M. C., Feldman, L. S., Andrew, C. G., Bergman, S., Leffondré, K., Stanbridge, D., & Fried, G. M. (2005) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2005.04.004 · Cited by 917
The financial impact of teaching surgical residents in the operating room
Bridges, M., & Diamond, D. L. (1999) · The American Journal of Surgery · doi:10.1016/s0002-9610(98)00289-x · Cited by 798
Reliability: on the reproducibility of assessment data
Downing, S. M. (2004) · Medical Education · doi:10.1111/j.1365-2929.2004.01932.x · Cited by 721
Regehr, G., MacRae, H., Reznick, R. K., & Szalay, D. (1998) · Academic Medicine · doi:10.1097/00001888-199809000-00020 · Cited by 711
Encyclopedia of Statistics in Behavioral Science
(2006) · Reference Reviews · doi:10.1108/09504120610664123 · Cited by 415
The effect of practice on performance in a laparoscopic simulator
Derossis, A. M., Bothwell, J., Sigman, H. H., & Fried, G. M. (1998) · Surgical Endoscopy · doi:10.1007/s004649900796 · Cited by 299
Zorn, K. C., Gautam, G., Shalhav, A. L., Clayman, R. V., Ahlering, T. E., Albala, D. M., Lee, D. I., Sundaram, C. P., Matin, S. F., Castle, E. P., et al. (2009) · Journal of Urology · doi:10.1016/j.juro.2009.05.042 · Cited by 244
Kenney, P. A., Wszolek, M. F., Gould, J. J., Libertino, J. A., & Moinzadeh, A. (2009) · Urology · doi:10.1016/j.urology.2008.12.044 · Cited by 218
Lerner, M. A., Ayalew, M., Peine, W. J., & Sundaram, C. P. (2010) · Journal of Endourology · doi:10.1089/end.2009.0190 · Cited by 165
Best Practices for Robotic Surgery Training and Credentialing
Lee, J. Y., Mucksavage, P., Sundaram, C. P., & McDougall, E. M. (2011) · The Journal of Urology · doi:10.1016/j.juro.2010.11.067 · Cited by 153
Validation of a Novel Virtual Reality Robotic Simulator
Sethi, A. S., Peine, W. J., Mohammadi, Y., & Sundaram, C. P. (2009) · Journal of Endourology · doi:10.1089/end.2008.0250 · Cited by 151
Rashid, H. H., Leung, Y.-Y. M., Rashid, M., Oleyourryk, G., Valvo, J. R., & Eichel, L. (2006) · Urology · doi:10.1016/j.urology.2006.01.057 · Cited by 131
Acquiring Skills in New Procedures and Technology
Sachdeva, A. K. (2005) · Archives of Surgery · doi:10.1001/archsurg.140.4.387 · Cited by 107
Face Validation of a Novel Robotic Surgical Simulator
Seixas‐Mikelus, S. A., Kesavadas, T., Srimathveeravalli, G., et al. (2010) · Urology · doi:10.1016/j.urology.2009.11.069 · Cited by 106
Doumerc, N., Yuen, C., Savdie, R., Rahman, M. B., Rasiah, K. K., Benito, R. P., Delprado, W., Matthews, J., Haynes, A., & Stricker, P. D. (2010) · British Journal of Urology · doi:10.1111/j.1464-410x.2009.09158.x · Cited by 101
Validation of laparoscopic surgical skills training outside the operating room: a long road
Hogle, N. J., Chang, L. C., Strong, V. E. M., Welcome, A. O. U., Sinaan, M., Bailey, R. W., & Fowler, D. L. (2009) · Surgical Endoscopy · doi:10.1007/s00464-009-0379-5 · Cited by 77
The New Paradigm of Continuing Education in Surgery
Sachdeva, A. K. (2005) · Archives of Surgery · doi:10.1001/archsurg.140.3.264 · Cited by 76
Evolution of Robot-Assisted Radical Prostatectomy
Orvieto, M. A., & Patel, V. (2009) · Scandinavian Journal of Surgery · doi:10.1177/145749690909800203 · Cited by 66
K endall's Coefficient of Concordance
Field, A. P. (2005) · Encyclopedia of Statistics in Behavioral Science · doi:10.1002/0470013192.bsa327 · Cited by 65
Cited by
A Systematic Review of Virtual Reality Simulators for Robot-assisted Surgery
Moglia, A., Ferrari, V., Morelli, L., Ferrari, M., Mosca, F., & Cuschieri, A. (2016) · European Urology · doi:10.1016/j.eururo.2015.09.021 · Cited by 300
A Dataset and Benchmarks for Segmentation and Recognition of Gestures in Robotic Surgery
Ahmidi, N., Tao, L., Sefati, S., Gao, Y., Lea, C., Haro, B. B., Zappella, L., Khudanpur, S., Vidal, R., & Hager, G. D. (2017) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2647680 · Cited by 289
Wang, Z., & Majewicz Fey, A. (2018) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-018-1860-1 · Cited by 275
Video and accelerometer-based motion analysis for automated surgical skills assessment
Zia, A., Sharma, Y., Bettadapura, V., Sarin, E. L., & Essa, I. (2018) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-018-1704-z · Cited by 134
Metadata
- Authors
- Goh, A. C., Goldfarb, D. W., Sander, J. C., Miles, B. J., & Dunkin, B. J.
- Venue
- Journal of Urology
- Published
- 2012-01
- Volume
- 187
- Issue
- 1
- Pages
- 247-252
- ISSN
- 0022-5347 (ISSN-L)
- 1527-3792
- OpenAlex
- W2082820542
- Cited by
- 480
- References
- 22
- FWCI
- 10.55
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.