The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Observational Teamwork Assessment for Surgery: Content Validation and Tool Refinement
Abstract
BACKGROUND: Effective teamwork is crucial for safe surgery. Failures in nontechnical and teamwork skills are frequently implicated in adverse events. The Observational Teamwork Assessment for Surgery (OTAS) tool assesses teamwork of the entire team in the operating room. Empirical testing of OTAS has yet to explore the content validity of the tool. STUDY DESIGN: This was a cross-sectional observational study. Data were collected in 30 procedures by 2 trained researchers. Five teamwork behaviors were scored (ie, communication, leadership, cooperation, coordination, and monitoring) and behavior exemplar completion was recorded (phase 1). Expert operating room personnel (5 surgeons, 5 anesthesiologists, and 5 scrub nurses) assessed the content validity of the OTAS exemplar behaviors. Finally, a panel of operating room patient-safety experts refined the exemplars (phase 2). RESULTS: In total, the observability (presence/absence) of 130 exemplars was assessed by 2 blinded observers in 30 general surgical cases. Observer agreement was high (Cohen's κ ≥ 0.41) for 83.85% (109 of 130) of exemplar behaviors; 60.77% (79 of 130) of exemplar behaviors were observed frequently with high observer agreement. The majority of the exemplars were rated by expert operating room practitioners and an expert panel as substantial contributors to teamwork and patient safety. Based on expert consensus, 21 behavior exemplars were removed from OTAS and an additional 23 were modified. CONCLUSIONS: The exemplars of OTAS demonstrated very good content validity. Taken together with recent evidence on the construct validity of the tool, these findings demonstrate that OTAS is psychometrically robust for capturing teamwork in the operating room.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A surgical safety checklist to reduce morbidity and mortality in a global population
Haynes, A. B., Weiser, T. G., Berry, W. R., Lipsitz, S. R., Breizat, A.-H. S., Dellinger, E. P., Herbosa, T., Joseph, S., Kibatala, P. L., Lapitan, M. C. M., et al. (2009) · New England Journal of Medicine · doi:10.1056/nejmsa0810119 · Cited by 5,688
High agreement but low Kappa: I. the problems of two paradoxes
Feinstein, A. R., & Cicchetti, D. V. (1990) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(90)90158-l · Cited by 3,034
Fletcher, G., Flin, R., McGeorge, P., Glavin, R., Maran, N., & Patey, R. (2003) · British Journal of Anaesthesia · doi:10.1093/bja/aeg112 · Cited by 958
Cited by
The Impact of Nontechnical Skills on Technical Performance in Surgery: A Systematic Review
Hull, L., Arora, S., Aggarwal, R., Darzi, A., Vincent, C., & Sevdalis, N. (2012) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2011.10.016 · Cited by 384
Self-citationWahr, J. A., Prager, R. L., Abernathy, J. H., Martinez, E. A., Salas, E., Seifert, P. C., Groom, R. C., Spiess, B. D., Searles, B. E., Sundt, T. M., et al. (2013) · Circulation · doi:10.1161/cir.0b013e3182a38efa · Cited by 334
Do Safety Checklists Improve Teamwork and Communication in the Operating Room? A Systematic Review
Russ, S., Rout, S., Sevdalis, N., Moorthy, K., Darzi, A., & Vincent, C. (2013) · Annals of Surgery · doi:10.1097/sla.0000000000000206 · Cited by 331
Self-citationThe Impact of Operating Room Distractions on Stress, Workload, and Teamwork
Wheelock, A., Suliman, A., Wharton, R., Babu, E. D., Hull, L., Vincent, C., Sevdalis, N., & Arora, S. (2015) · Annals of Surgery · doi:10.1097/sla.0000000000001051 · Cited by 253
Self-citationTechnical and Nontechnical Skills in Surgery: A Simulated Operating Room Environment Study
Pfandler, M., Stefan, P., Mehren, C., Lazarovici, M., & Weigl, M. (2019) · Spine · doi:10.1097/brs.0000000000003154 · Cited by 22
Metadata
- Authors
- Hull, L., Arora, S., Kassab, E., Kneebone, R., & Sevdalis, N.
- Venue
- Journal of the American College of Surgeons
- Published
- 2011-02
- Volume
- 212
- Issue
- 2
- Pages
- 234-243e5
- ISSN
- 1072-7515 (ISSN-L)
- OpenAlex
- W2139609086
- Cited by
- 214
- References
- 3
- FWCI
- 29.51
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Observational Teamwork Assessment for Surgery: Content Validation and Tool Refinement. https://app.cochat.ai/papers/10.1016/j.jamcollsurg.2010.11.001
- The paper
- Hull, L., Arora, S., Kassab, E., Kneebone, R., & Sevdalis, N. (2011). Observational Teamwork Assessment for Surgery: Content Validation and Tool Refinement. Journal of the American College of Surgeons. https://doi.org/10.1016/j.jamcollsurg.2010.11.001
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.