The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Development of a rating system for surgeons' non‐technical skills
Abstract
Background Analyses of adverse events in surgery reveal that many underlying causes are behavioural, such as communication failure, rather than technical. Non‐technical (i.e. cognitive and interpersonal) skills are not addressed explicitly in surgical training. However, surgeons need to demonstrate these skills, which underpin their technical excellence, to maximise patient safety in the operating theatre. This paper describes the method used to identify surgeons' non‐technical skills, and the development of a skills taxonomy and behavioural rating system to structure observation and feedback in surgical training. Methods Cognitive task analyses (critical incident interviews) were conducted with 27 consultant surgeons in general, cardiac and orthopaedic surgery. The interviews were coded and a multidisciplinary group of surgeons and psychologists used an iterative process to develop a skills taxonomy. This was supported by data gathered from an attitude survey, literature review, analysis of surgical mortality reports and observations in theatre. Results Five categories of non‐technical skills were identified, including situation awareness, decision making, task management, leadership and communication and teamwork. This provided a structure for a prototype skill taxonomy (v1.1), which comprised 14 non‐technical skill elements. Observable behaviours (markers) indicative of good and poor performance were developed for each element by 16 consultant surgeons to form a prototype behaviour rating system. Conclusions The prototype skills taxonomy and behaviour rating system are grounded empirically in surgery. The reliability of the system is currently being tested using standardised scenarios. If this evaluation proves successful, the system could be used to structure feedback and guide non‐technical skills training.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The critical incident technique.
Flanagan, J. C. (1954) · Psychological Bulletin · doi:10.1037/h0061470 · Cited by 8,191
(2007) · Encyclopedia of Industrial and Organizational Psychology · doi:10.4135/9781412952651.n55 · Cited by 5,287
Goulding, C. (2002) · SAGE Publications Ltd eBooks · doi:10.4135/9781849209236 · Cited by 4,455
Rethinking Methods in Psychology
Smith, J., Harré, R., & Langenhove, L. (1995) · SAGE Publications Ltd eBooks · doi:10.4135/9781446221792 · Cited by 1,915
Analysis of errors reported by surgeons at three teaching hospitals
Gawande, A. A., Zinner, M. J., Studdert, D. M., & Brennan, T. A. (2003) · Surgery · doi:10.1067/msy.2003.169 · Cited by 1,082
Fletcher, G., Flin, R., McGeorge, P., Glavin, R., Maran, N., & Patey, R. (2003) · British Journal of Anaesthesia · doi:10.1093/bja/aeg112 · Cited by 958
Self-citationNon-technical skills for surgeons in the operating room: A review of the literature
Yule, S., Flin, R., Paterson-Brown, S., & Maran, N. (2006) · Surgery · doi:10.1016/j.surg.2005.06.017 · Cited by 756
Self-citation(2018) · CRC Press eBooks · doi:10.1201/9780203751725 · Cited by 573
Human factors and cardiac surgery: A multicenter study
de Leval, M. R., Carthey, J., Wright, D. J., Farewell, V. T., & Reason, J. T. (2000) · The Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/s0022-5223(00)70006-7 · Cited by 507
The role of non-technical skills in anaesthesia: a review of current literature
Fletcher, G. C. L., McGeorge, P., Flin, R. H., Glavin, R. J., & Maran, N. J. (2002) · British Journal of Anaesthesia · doi:10.1093/bja/88.3.418 · Cited by 423
Self-citationSchvaneveldt, R. W. (1999) · Cited by 406
Hoffman, R. R., Crandall, B., & Shadbolt, N. (1998) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872098779480442 · Cited by 403
Linking Expertise and Naturalistic Decision Making
(2001) · Psychology Press eBooks · doi:10.4324/9781410604200 · Cited by 383
Developing observational measures of performance in surgical teams
Healey, A. N. (2004) · BMJ Quality & Safety · doi:10.1136/qhc.13.suppl_1.i33 · Cited by 249
Team Performance in the Operating Room
Helmreich, R. L., & Schaefer, H.-G. (2018) · Human Error in Medicine · doi:10.1201/9780203751725-12 · Cited by 234
Rating non-technical skills: developing a behavioural marker system for use in anaesthesia
Fletcher, G., Flin, R., McGeorge, P., Glavin, R., Maran, N., & Patey, R. (2004) · Cognition, Technology & Work · doi:10.1007/s10111-004-0158-y · Cited by 214
Self-citationAttitudes to teamwork and safety in the operating theatre
Flin, R., Yule, S., McKenzie, L., Paterson-Brown, S., & Maran, N. (2006) · The Surgeon · doi:10.1016/s1479-666x(06)80084-3 · Cited by 210
Self-citationDevelopment of the NOTECHS (non-technical skills) system for assessing pilots’ CRM skills
(2017) · Contemporary Issues in Human Factors and Aviation Safety · doi:10.4324/9781315259482-16 · Cited by 191
Behavioral Markers for Crew Resource Management: A Review of Current Practice
Flin, R. H., & Martin, L. H. (2001) · International Journal of Aviation Psychology · doi:10.1207/s15327108ijap1101_6 · Cited by 164
Self-citationConsultant surgeons' opinion of the skills required of basic surgical trainees
Baldwin, P. J., Paisley, A., & Brown, S. P. (1999) · British journal of surgery · doi:10.1046/j.1365-2168.1999.01169.x · Cited by 142
Applied Cognitive Task Analysis in Aviation
Seamster, T. L., & Redding, R. E. (2017) · Routledge eBooks · doi:10.4324/9781315262321 · Cited by 122
METHODS USED TO EVALUATE THE EFFECTIVENESS OF FLIGHTCREW CRM TRAINING IN THE UK AVIATION INDUSTRY
O'Connor, P. E., Flin, R. H., Fletcher, G., & Hemsley, P. (2002) · Human factors and aerospace safety · Cited by 21
Self-citation
Cited by
Teamwork and patient safety in dynamic domains of healthcare: A review of the literature
MANSER, T. (2009) · Acta Anaesthesiologica Scandinavica · doi:10.1111/j.1399-6576.2008.01717.x · Cited by 1,322
Yule, S., Flin, R., Maran, N., Rowley, D., Youngson, G., & Paterson‐Brown, S. (2008) · World Journal of Surgery · doi:10.1007/s00268-007-9320-z · Cited by 505
Self-citationPatterson, M. D., Geis, G. L., Falcone, R. A., LeMaster, T., & Wears, R. L. (2013) · BMJ Quality & Safety · doi:10.1136/bmjqs-2012-000942 · Cited by 472
McCulloch, P., Mishra, A., Handa, A., Dale, T., Hirst, G., & Catchpole, K. (2009) · Quality and Safety in Health Care · doi:10.1136/qshc.2008.032045 · Cited by 393
Teamwork and Error in the Operating Room: Analysis of Skills and Roles
Catchpole, K., Mishra, A., Handa, A., & McCulloch, P. (2008) · Annals of Surgery · doi:10.1097/sla.0b013e3181642ec8 · Cited by 384
Metadata
- Authors
- Yule, S., Flin, R., Paterson‐Brown, S., Maran, N., & Rowley, D.
- Venue
- Medical Education
- Publisher
- Wiley
- Published
- 2006-10-17
- Volume
- 40
- Issue
- 11
- Pages
- 1098-1104
- ISSN
- 0308-0110 (ISSN-L)
- 1365-2923
- OpenAlex
- W2148606079
- Cited by
- 603
- References
- 22
- FWCI
- 15.90
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.