The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
A Systematic Review of the Effectiveness, Compliance, and Critical Factors for Implementation of Safety Checklists in Surgery
Abstract
OBJECTIVE: A systematic literature review was conducted to assess the effectiveness of, compliance with, and critical factors for the implementation of safety checklists in surgery. BACKGROUND: With the aim of increasing patient safety, checklists have gained growing attention. Information about effectiveness, compliance, and critical factors for implementation is crucial for whether and which of the available instruments to use. DATA SOURCES: Medline including Premedline (OvidSP), Embase, and Cochrane Collaboration Library, hand search, a search of reference lists of key articles, and tables of content. STUDY SELECTION: Electronic databases returned 4997 citations, of which 84 articles were chosen for full-text review. Finally, 22 articles were included in this review. DATA EXTRACTION: Data relating to care setting, study methods and design, sample population, survey response rate, type of checklist, aim, effectiveness, compliance, attitudes, and critical factors were extracted from the studies. A random effects meta-analysis of effectiveness data was conducted if 2 or more studies reported a specified outcome. RESULTS: With the use of checklists, the relative risk for mortality is 0.57 [95% confidence interval (CI): 0.42-0.76] and for any complications 0.63 (95% CI: 0.58-0.67). The overall compliance rate ranged from 12% to 100% (mean: 75%) and for the Time Out from 70% to 100% (mean: 91%). CONCLUSIONS: Checklists are effective and economic tools that decrease mortality and morbidity. Compliance of surgical staff with checklists was good overall. Further research in particular relating to implementation is needed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · The Lancet · doi:10.1016/s0140-6736(07)61602-x · Cited by 21,320
(2014) · Medical Entomology and Zoology · Cited by 17,633
Stang, A. (2010) · European Journal of Epidemiology · doi:10.1007/s10654-010-9491-z · Cited by 17,396
To Err Is Human: Building a Safer Health System
(2000) · National Academies Press eBooks · doi:10.17226/9728 · Cited by 14,044
GRADE guidelines: 3. Rating the quality of evidence
Balshem, H., Helfand, M., Schünemann, H. J., Oxman, A. D., Kunz, R., Brozek, J., Vist, G. E., Falck-Ytter, Y., Meerpohl, J., & Norris, S. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.07.015 · Cited by 8,285
A surgical safety checklist to reduce morbidity and mortality in a global population
Haynes, A. B., Weiser, T. G., Berry, W. R., Lipsitz, S. R., Breizat, A.-H. S., Dellinger, E. P., Herbosa, T., Joseph, S., Kibatala, P. L., Lapitan, M. C. M., et al. (2009) · New England Journal of Medicine · doi:10.1056/nejmsa0810119 · Cited by 5,688
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · Preventive Medicine · doi:10.1016/j.ypmed.2007.08.012 · Cited by 2,698
The Quality in Australian Health Care Study
Wilson, R. M., Runciman, W. B., Gibberd, R. W., Harrison, B. T., Newby, L., & Hamilton, J. D. (1995) · Medical Journal of Australia · doi:10.5694/j.1326-5377.1995.tb124691.x · Cited by 2,384
Association Between Implementation of a Medical Team Training Program and Surgical Mortality
Neily, J., Mills, P. D., Young-Xu, Y., Carney, B. T., West, P., Berger, D. H., Mazzia, L. M., Paull, D. E., & Bagian, J. P. (2010) · JAMA · doi:10.1001/jama.2010.1506 · Cited by 1,040
Effect of a comprehensive surgical safety system on patient outcomes
de Vries, E. N., Prins, H. A., Crolla, R. M. P. H., den Outer, A. J., van Andel, G., van Helden, S. H., Schlack, W. S., van Putten, M. A., Gouma, D. J., Dijkgraaf, M. G. W., et al. (2010) · New England Journal of Medicine · doi:10.1056/nejmsa0911535 · Cited by 998
The incidence and nature of surgical adverse events in Colorado and Utah in 1992
Gawande, A. A., Thomas, E. J., Zinner, M. J., & Brennan, T. A. (1999) · Surgery · doi:10.1067/msy.1999.98664 · Cited by 977
Surgical team behaviors and patient outcomes
Mazzocco, K., Petitti, D. B., Fong, K. T., Bonacum, D., Brookey, J., Graham, S., Lasky, R. E., Sexton, J. B., & Thomas, E. J. (2009) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2008.03.002 · Cited by 781
Operating Room Teamwork among Physicians and Nurses: Teamwork in the Eye of the Beholder
Makary, M. A., Sexton, J. B., Freischlag, J. A., Holzmueller, C. G., Millman, E. A., Rowen, L., & Pronovost, P. J. (2006) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2006.01.017 · Cited by 672
The checklist—a tool for error management and performance improvement
Hales, B. M., & Pronovost, P. J. (2006) · Journal of Critical Care · doi:10.1016/j.jcrc.2006.06.002 · Cited by 640
Lingard, L. (2008) · Archives of Surgery · doi:10.1001/archsurg.2007.21 · Cited by 596
Haynes, A. B., Weiser, T. G., Berry, W. R., Lipsitz, S. R., Breizat, A.-H. S., Dellinger, E. P., Dziekan, G., Herbosa, T., Kibatala, P. L., Lapitan, M. C. M., et al. (2011) · BMJ Quality & Safety · doi:10.1136/bmjqs.2009.040022 · Cited by 523
Weiser, T. G., Haynes, A. B., Dziekan, G., Berry, W. R., Lipsitz, S. R., & Gawande, A. A. (2010) · Annals of Surgery · doi:10.1097/sla.0b013e3181d970e3 · Cited by 467
Adverse events in surgical patients in Australia
KABLE, A. K., GIBBERD, R. W., & SPIGELMAN, A. D. (2002) · International Journal for Quality in Health Care · doi:10.1093/intqhc/14.4.269 · Cited by 450
Effective surgical safety checklist implementation
Conley, D. M., Singer, S. J., Edmondson, L., Berry, W. R., & Gawande, A. A. (2011) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2011.01.052 · Cited by 372
Practical challenges of introducing WHO surgical checklist: UK pilot experience
Vats, A., Vincent, C. A., Nagpal, K., Davies, R. W., Darzi, A., & Moorthy, K. (2010) · BMJ · doi:10.1136/bmj.b5433 · Cited by 323
Cockpit Checklists: Concepts, Design, and Use
Degani, A., & Wiener, E. L. (1993) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872089303500209 · Cited by 310
Incidence, Patterns, and Prevention of Wrong-Site Surgery
Kwaan, M. R. (2006) · Archives of Surgery · doi:10.1001/archsurg.141.4.353 · Cited by 277
Operating Room Briefings and Wrong-Site Surgery
Makary, M. A., Mukherjee, A., Sexton, B. J., Syin, D., Goodrich, E., Hartmann, E., Rowen, L., Behrens, D. C., Marohn, M., & Pronovost, P. J. (2007) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2006.10.018 · Cited by 255
Hill, D. (2001) · Cited by 243
Information Transfer and Communication in Surgery: A Systematic Review
Nagpal, K., Vats, A., Lamb, B., Ashrafian, H., Sevdalis, N., Vincent, C., & Moorthy, K. (2010) · Annals of Surgery · doi:10.1097/sla.0b013e3181e495c2 · Cited by 223
The Prevalence of Wrong Level Surgery Among Spine Surgeons
Mody, M. G., Nourbakhsh, A., Stahl, D. L., Gibbs, M., Alfawareh, M., & Garges, K. J. (2008) · Spine · doi:10.1097/brs.0b013e31816043d1 · Cited by 221
Development and validation of the SURgical PAtient Safety System (SURPASS) checklist
de Vries, E. N., Hollmann, M. W., Smorenburg, S. M., Gouma, D. J., & Boermeester, M. A. (2009) · Quality and Safety in Health Care · doi:10.1136/qshc.2008.027524 · Cited by 219
Use of the WHO surgical safety checklist in trauma and orthopaedic patients
Sewell, M., Adebibe, M., Jayakumar, P., Jowett, C., Kong, K., Vemulapalli, K., & Levack, B. (2011) · International Orthopaedics · doi:10.1007/s00264-010-1112-7 · Cited by 164
Semel, M. E., Resch, S., Haynes, A. B., Funk, L. M., Bader, A., Berry, W. R., Weiser, T. G., & Gawande, A. A. (2010) · Health Affairs · doi:10.1377/hlthaff.2009.0709 · Cited by 164
Clarke, J. R., Johnston, J., & Finley, E. D. (2007) · Annals of Surgery · doi:10.1097/sla.0b013e3181469987 · Cited by 160
Nilsson, L. M., Lindberget, O., Gupta, A. K., & Vegfors, M. (2009) · Acta Anaesthesiologica Scandinavica · doi:10.1111/j.1399-6576.2009.02109.x · Cited by 127
Prevention of Surgical Malpractice Claims by Use of a Surgical Safety Checklist
de Vries, E. N., Eikens-Jansen, M. P., Hamersma, A. M., Smorenburg, S. M., Gouma, D. J., & Boermeester, M. A. (2011) · Annals of Surgery · doi:10.1097/sla.0b013e3182068880 · Cited by 111
Preoperative Briefing in the Operating Room
Einav, Y., Gopher, D., Kara, I., Ben-Yosef, O., Lawn, M., Laufer, N., Liebergall, M., & Donchin, Y. (2010) · CHEST Journal · doi:10.1378/chest.08-1732 · Cited by 106
surgery, W. G. F. S. (2009) · Medical Entomology and Zoology · Cited by 105
The SURgical PAtient Safety System (SURPASS) checklist optimizes timing of antibiotic prophylaxis
de Vries, E. N., Dijkstra, L., Smorenburg, S. M., Meijer, R. P., & Boermeester, M. A. (2010) · Patient Safety in Surgery · doi:10.1186/1754-9493-4-6 · Cited by 99
Strategies for Improving Surgical Quality — Checklists and Beyond
Birkmeyer, J. D. (2010) · New England Journal of Medicine · doi:10.1056/nejme1009542 · Cited by 98
Surgical Confusions in Ophthalmology
Simon, J. W., Ngo, Y., Khan, S., & Strogatz, D. (2007) · Archives of Ophthalmology · doi:10.1001/archopht.125.11.1515 · Cited by 77
Wrong-Site Surgery: Can We Prevent It?
Clarke, J. R., Johnston, J., Blanco, M., & Martindell, D. P. (2008) · Advances in Surgery · doi:10.1016/j.yasu.2008.03.004 · Cited by 70
Implementing a Pediatric Surgical Safety Checklist in the OR and Beyond
Norton, E. K., & Rangel, S. J. (2010) · AORN Journal · doi:10.1016/j.aorn.2009.11.069 · Cited by 58
Surgical Site Signing and “Time Out”
Johnston, G. H. F., Ekert, L., & Pally, E. (2009) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.h.01615 · Cited by 54
Paige, J. T., Aaron, D. L., Yang, T., Howell, D. S., HILTON, C. W., Cohn, I., & Chauvin, S. W. (2008) · The American Surgeon · doi:10.1177/000313480807400909 · Cited by 50
Eight-Year Experience With a Neurosurgical Checklist
Lyons, M. (2010) · American Journal of Medical Quality · doi:10.1177/1062860610363305 · Cited by 42
Preventing surgical confusions in ophthalmology (an American Ophthalmological Society thesis).
Simon, J. W. (2007) · Europe PMC (PubMed Central) · Cited by 21
Student-observed surgical safety practices across an urban regional health authority: Table 1
Spence, J. D., Goodwin, B., Enns, C., & Dean, H. (2011) · BMJ Quality & Safety · doi:10.1136/bmjqs.2010.044826 · Cited by 15
Cited by
Introduction of surgical safety checklists in Ontario, Canada
Urbach, D. R., Govindarajan, A., Saskin, R., Wilton, A. S., & Baxter, N. N. (2014) · New England Journal of Medicine · doi:10.1056/nejmsa1308261 · Cited by 627
(2017) · OECD Health Working Papers · doi:10.1787/5a9858cd-en · Cited by 616
Buljac-Samardzic, M., Doekhie, K. D., & van Wijngaarden, J. D. H. (2020) · Human Resources for Health · doi:10.1186/s12960-019-0411-3 · Cited by 515
Madaio, M. A., Stark, L., Wortman Vaughan, J., & Wallach, H. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376445 · Cited by 436
“found that aligning checklists to roles and creating opportunities for practitioner empowerment during checklist implementation were critical factors in the success of surgical checklists [13].”
BackgroundBergs, J., Hellings, J., Cleemput, I., Zurel, Ö., De Troyer, V, Van Hiel, M., Demeere, J.-L., Claeys, D., & Vandijck, D. (2014) · British Journal of Surgery · doi:10.1002/bjs.9381 · Cited by 390
Metadata
- Authors
- Borchard, A., Schwappach, D. L. B., Barbir, A., & Bezzola, P.
- Venue
- Annals of Surgery
- Published
- 2012-12
- Volume
- 256
- Issue
- 6
- Pages
- 925-933
- ISSN
- 0003-4932 (ISSN-L)
- OpenAlex
- W1993979945
- Cited by
- 311
- References
- 45
- FWCI
- 6.57
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.