The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
The Oxford NOTECHS System: reliability and validity of a tool for measuring teamwork behaviour in the operating theatre
Open accessAbstract
INTRODUCTION: The frequency of adverse events in the operating theatre has been linked to the quality of teamwork and communication. Developing suitable measures of teamwork may play a role in reducing errors in surgery. This study reports on the development and evaluation of a method for measuring operating-theatre teamwork quality. METHODS: The Oxford Non-Technical Skills (NOTECHS) scale was developed from an aviation instrument for assessment of non-technical skills. Consultation with experts and task analysis led to modifications reflecting the complexities of the theatre teamwork, particularly the coexistence of three subteams (surgeons, anaesthetists and nurses). The scale was then evaluated using teams performing laparoscopic cholecystectomy (n = 65) before and after teamwork training. Attitudes to teamwork and surgical error rates were assessed by questionnaire and direct observation methods, and used to assess the reliability and validity of the Oxford NOTECHS scale. RESULTS: The interobserver reliability was excellent in 24 operations independently assessed by two observers (R(wg) = 0.99), confirmed by a third observer in 11 cases (R(wg) = 0.99). Validity was demonstrated through improved scores after teamwork training (t = -3.019, p = 0.005), concurrent with improved attitudes to teamwork after training; inverse correlation between NOTECHS scores and surgical errors (rho = -0.267, p = 0.046); strong inverse correlation between surgical subteam score and surgical errors (rho = -0.412, n = 65, p = 0.001); and strong correlation with teamwork scores from an alternative system (n = 5, r = 0.886, p = 0.046). CONCLUSION: The Oxford NOTECHS scale appears to be a reliable and valid instrument for assessing teamwork in the operating theatre, and is ready for further application.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Evaluating Training Programs : The Four Levels
Kirkpatrick, D. L. (2009) · Cited by 4,720
Leonard, M. (2004) · BMJ Quality & Safety · doi:10.1136/qhc.13.suppl_1.i85 · Cited by 2,322
Leape, L. L. (1994) · PubMed · Cited by 1,961
Sexton, J. B., Helmreich, R. L., Neilands, T. B., Rowan, K., Vella, K., Boyden, J., Roberts, P. R., & Thomas, E. J. (2006) · BMC Health Services Research · doi:10.1186/1472-6963-6-44 · Cited by 1,782
Error, stress, and teamwork in medicine and aviation: cross sectional surveys
Sexton, J. B. (2000) · BMJ · doi:10.1136/bmj.320.7237.745 · Cited by 1,611
Lingard, L. A. (2004) · BMJ Quality & Safety · doi:10.1136/qhc.13.5.330 · Cited by 1,406
On error management: lessons from aviation
Helmreich, R. L. (2000) · BMJ · doi:10.1136/bmj.320.7237.781 · Cited by 1,327
Analysis of errors reported by surgeons at three teaching hospitals
Gawande, A. A., Zinner, M. J., Studdert, D. M., & Brennan, T. A. (2003) · Surgery · doi:10.1067/msy.2003.169 · Cited by 1,082
Fletcher, G., Flin, R., McGeorge, P., Glavin, R., Maran, N., & Patey, R. (2003) · British Journal of Anaesthesia · doi:10.1093/bja/aeg112 · Cited by 958
Human Factors Methods: A Practical Guide for Engineering and Design
Stanton, N. A., Salmon, P. M., Rafferty, L. A., Walker, G. H., & Baber, C. (2006) · Cited by 870
Way, L. W., Stewart, L., Gantert, W., Liu, K., Lee, C. M., Whang, K., & Hunter, J. G. (2003) · Annals of Surgery · doi:10.1097/01.sla.0000060680.92690.e9 · Cited by 795
Development of a rating system for surgeons' non‐technical skills
Yule, S., Flin, R., Paterson‐Brown, S., Maran, N., & Rowley, D. (2006) · Medical Education · doi:10.1111/j.1365-2929.2006.02610.x · Cited by 603
Lingard, L., Reznick, R., Espin, S., Regehr, G., & DeVito, I. (2002) · Academic Medicine · doi:10.1097/00001888-200203000-00013 · Cited by 441
Analysis of surgical errors in closed malpractice claims at 4 liability insurers
Rogers, S. O., Gawande, A. A., Kwaan, M., Puopolo, A. L., Yoon, C., Brennan, T. A., & Studdert, D. M. (2006) · Surgery · doi:10.1016/j.surg.2006.01.008 · Cited by 410
The influence of non-technical performance on technical outcome in laparoscopic cholecystectomy
Mishra, A., Catchpole, K., Dale, T., & McCulloch, P. (2008) · Surgical Endoscopy · doi:10.1007/s00464-007-9346-1 · Cited by 268
Self-citationImproving patient safety by identifying latent failures in successful operations
Catchpole, K. R., Giddings, A. E. B., Wilkinson, M., Hirst, G., Dale, T., & de Leval, M. R. (2007) · Surgery · doi:10.1016/j.surg.2007.01.033 · Cited by 268
Self-citationThomas, E. J. (2004) · Quality and Safety in Health Care · doi:10.1136/qhc.13.suppl_1.i57 · Cited by 227
The human factor in cardiac surgery: errors and near misses in a high technology medical domain
Carthey, J., de Leval, M. R., & Reason, J. T. (2001) · The Annals of Thoracic Surgery · doi:10.1016/s0003-4975(00)02592-3 · Cited by 224
Tang, B. (2004) · Archives of Surgery · doi:10.1001/archsurg.139.11.1215 · Cited by 206
Development of the NOTECHS (non-technical skills) system for assessing pilots’ CRM skills
(2017) · Contemporary Issues in Human Factors and Aviation Safety · doi:10.4324/9781315259482-16 · Cited by 191
Behavioural markers of surgical excellence
Carthey, J., de Leval, M. R., Wright, D. J., et al. (2003) · Safety Science · doi:10.1016/s0925-7535(01)00076-5 · Cited by 160
Observational Assessment of Surgical Teamwork: A Feasibility Study
Undre, S., Healey, A. N., Darzi, A. W., & Vincent, C. A. (2006) · World Journal of Surgery · doi:10.1007/s00268-005-0488-9 · Cited by 152
The role of structured observational research in health care
Carthey, J. (2003) · BMJ Quality & Safety · doi:10.1136/qhc.12.suppl_2.ii13 · Cited by 107
A method for measuring threats and errors in surgery
Catchpole, K., Giddings, A. E. B., Hirst, G., Dale, T., Peek, G. J., & de Leval, M. R. (2007) · Cognition Technology & Work · doi:10.1007/s10111-007-0093-9 · Cited by 41
Self-citation
Cited by
Teamwork in healthcare: Key discoveries enabling safer, high-quality care.
Rosen, M. A., DiazGranados, D., Dietz, A. S., Benishek, L. E., Thompson, D., Pronovost, P. J., & Weaver, S. J. (2018) · American Psychologist · doi:10.1037/amp0000298 · Cited by 1,283
Team-training in healthcare: a narrative synthesis of the literature
Weaver, S. J., Dy, S. M., & Rosen, M. A. (2014) · BMJ Quality & Safety · doi:10.1136/bmjqs-2013-001848 · Cited by 535
Saving lives: A meta-analysis of team training in healthcare.
Hughes, A. M., Gregory, M. E., Joseph, D. L., Sonesh, S. C., Marlow, S. L., Lacerenza, C. N., Benishek, L. E., King, H. B., & Salas, E. (2016) · Journal of Applied Psychology · doi:10.1037/apl0000120 · Cited by 484
Schmutz, J. B., Meier, L. L., & Manser, T. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-028280 · Cited by 454
McCulloch, P., Mishra, A., Handa, A., Dale, T., Hirst, G., & Catchpole, K. (2009) · Quality and Safety in Health Care · doi:10.1136/qshc.2008.032045 · Cited by 393
Self-citation
Metadata
- Authors
- Mishra, A., Catchpole, K., & McCulloch, P.
- Venue
- Quality and Safety in Health Care
- Publisher
- BMJ
- Published
- 2009-04-01
- Volume
- 18
- Issue
- 2
- Pages
- 104-108
- ISSN
- 1475-3898 (ISSN-L)
- 1475-3901
- OpenAlex
- W2139924813
- Cited by
- 368
- References
- 24
- FWCI
- 24.11
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.