The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Introduction of Surgical Safety Checklists in Ontario, Canada
Open accessAbstract
BACKGROUND: Evidence from observational studies that the use of surgical safety checklists results in striking improvements in surgical outcomes led to the rapid adoption of such checklists worldwide. However, the effect of mandatory adoption of surgical safety checklists is unclear. A policy encouraging the universal adoption of checklists by hospitals in Ontario, Canada, provided a natural experiment to assess the effectiveness of checklists in typical practice settings. METHODS: We surveyed all acute care hospitals in Ontario to determine when surgical safety checklists were adopted. Using administrative health data, we compared operative mortality, rate of surgical complications, length of hospital stay, and rates of hospital readmission and emergency department visits within 30 days after discharge among patients undergoing a variety of surgical procedures before and after adoption of a checklist. RESULTS: During 3-month periods before and after adoption of a surgical safety checklist, a total of 101 hospitals performed 109,341 and 106,370 procedures, respectively. The adjusted risk of death during a hospital stay or within 30 days after surgery was 0.71% (95% confidence interval [CI], 0.66 to 0.76) before implementation of a surgical checklist and 0.65% (95% CI, 0.60 to 0.70) afterward (odds ratio, 0.91; 95% CI, 0.80 to 1.03; P=0.13). The adjusted risk of surgical complications was 3.86% (95% CI, 3.76 to 3.96) before implementation and 3.82% (95% CI, 3.71 to 3.92) afterward (odds ratio, 0.97; 95% CI, 0.90 to 1.03; P=0.29). CONCLUSIONS: Implementation of surgical safety checklists in Ontario, Canada, was not associated with significant reductions in operative mortality or complications. (Funded by the Canadian Institutes of Health Research.).
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Studies demonstrating reduced morbidity and mortality with the use of a surgical safety checklist include detailed implementation programs involving extensive staff engagement and education.3,4,9”
From Society for Maternal-Fetal Medicine Special Statement: Surgical safety checklists for cesarean delivery (2021) · cites this paper as [9]
In the citing paper
“This problem may help to explain apparently contradictory findings about the value of surgical checklists, for example.47–49”
From Demystifying theory and its use in improvement (2015) · cites this paper as [49]
Citations
Cites
A surgical safety checklist to reduce morbidity and mortality in a global population
Haynes, A. B., Weiser, T. G., Berry, W. R., Lipsitz, S. R., Breizat, A.-H. S., Dellinger, E. P., Herbosa, T., Joseph, S., Kibatala, P. L., Lapitan, M. C. M., et al. (2009) · New England Journal of Medicine · doi:10.1056/nejmsa0810119 · Cited by 5,688
Models for Longitudinal Data: A Generalized Estimating Equation Approach
Zeger, S. L., Liang, K.-Y., & Albert, P. S. (1988) · Biometrics · doi:10.2307/2531734 · Cited by 4,505
Deyo, R. A. (2010) · JAMA · doi:10.1001/jama.2010.338 · Cited by 1,520
Association Between Implementation of a Medical Team Training Program and Surgical Mortality
Neily, J., Mills, P. D., Young-Xu, Y., Carney, B. T., West, P., Berger, D. H., Mazzia, L. M., Paull, D. E., & Bagian, J. P. (2010) · JAMA · doi:10.1001/jama.2010.1506 · Cited by 1,040
Dissemination and publication of research findings: an updated review of related biases
Song, F., Parekh, Hooper, L., Loke, Y., Ryder, J., Sutton, A., Hing, C., Kwok, C., Pang, C., & Harvey, I. (2010) · Health Technology Assessment · doi:10.3310/hta14080 · Cited by 1,039
Effect of a comprehensive surgical safety system on patient outcomes
de Vries, E. N., Prins, H. A., Crolla, R. M. P. H., den Outer, A. J., van Andel, G., van Helden, S. H., Schlack, W. S., van Putten, M. A., Gouma, D. J., Dijkgraaf, M. G. W., et al. (2010) · New England Journal of Medicine · doi:10.1056/nejmsa0911535 · Cited by 998
Comparative Effectiveness of Minimally Invasive vs Open Radical Prostatectomy
Hu, J. C. (2009) · JAMA · doi:10.1001/jama.2009.1451 · Cited by 816
Endovascular vs. Open Repair of Abdominal Aortic Aneurysms in the Medicare Population
Schermerhorn, M. L., O'Malley, A. J., Jhaveri, A., Cotterill, P., Pomposelli, F., & Landon, B. E. (2008) · New England Journal of Medicine · doi:10.1056/nejmoa0707348 · Cited by 812
van Klei, W. A., Hoff, R. G., van Aarnhem, E. E. H. L., Simmermacher, R. K. J., Regli, L. P. E., Kappen, T. H., van Wolfswinkel, L., Kalkman, C. J., Buhre, W. F., & Peelen, L. M. (2012) · Annals of Surgery · doi:10.1097/sla.0b013e31823779ae · Cited by 429
The Tension between Needing to Improve Care and Knowing How to Do It
Auerbach, A. D., Landefeld, C. S., & Shojania, K. G. (2007) · New England Journal of Medicine · doi:10.1056/nejmsb070738 · Cited by 411
Research works printed but not linked: 3
- Vogts N, 2011, N Z Med J, 124, 48
- Canadian classification of health interventions. Vol. 3: tabular list. Ottawa: Canadian Institute of Health Information, 2003.
- Tu JV, 1998, CMAJ, 159, 221
Cited by
Items 601–626 of 626
Wears, R. L., & Sutcliffe, K. M. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190271268.002.0003
Wears, R. L., & Sutcliffe, K. M. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190271268.002.0008
Implementation and Utilization of Checklists in Surgical Patient Safety
Kochis, M. A., Turley, N., Brindle, M. E., & Haynes, A. B. (2024) · Springer eBooks · doi:10.1007/978-3-031-56270-9_2
How we WHO : why are we not more engaged with the WHO Surgical Safety Checklist?
Reilly, S., Nataraj, P., & Yoong, W. (2024) · The Obstetrician & Gynaecologist · doi:10.1111/tog.12938
The creation of a pediatric surgical checklist for adult providers
Rapolti, D. I., Kisa, P., Situma, M., Nico, E., Lobe, T. E., Sims, T. L., Ozgediz, D., & Klazura, G. (2024) · BMC Health Services Research · doi:10.1186/s12913-024-11405-1 · Cited by 1
Patientensicherheit, Morbidität, Letalität in der Anästhesiologie
Staender, S. E. A. (2024) · Springer Reference Medizin · doi:10.1007/978-3-662-45539-5_166-2
Escauriza, A. J. J., Gellings, J. A., Iverson, K. R., Leal, B. R., Ortiz, G. C., García, M. Á. C., Herrera, W. M. S., Guelmes-Lavandero, A. L., Laffita, N. M., Odoardo, A. S., et al. (2025) · Global Surgical Education - Journal of the Association for Surgical Education · doi:10.1007/s44186-024-00342-6
Protocol for implementation of intraoperative adverse event recording during WHO checklist sign-out
Burri‐Winkler, K., Auderset, A. C., Hahnloser, D., Burkhart, C. S., Neuhaus, V., Gass, J., Vogt, A. P., Prouse, G., Winkens, J., Haller, G., et al. (2025) · BMJ Open Quality · doi:10.1136/bmjoq-2024-003286
Quality Improvement and Patient Safety in Surgery
Hannick, J. H., & Koyle, M. A. (2025) · Springer eBooks · doi:10.1007/978-3-031-87083-5_20
Management of the post-operative neurosurgical patient
Bellapart, J., Jeffree, R. L., & Coulthard, A. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-11611-7.00075-x
Arad, D., Rosenfeld, A., & Magnezi, R. (2024) · Figshare · doi:10.6084/m9.figshare.26579636
Campbell, K. K., Gardner, A., Scott, D. J., Johnson, J., Harvey, J., & Kazley, A. S. (2023) · Figshare · doi:10.6084/m9.figshare.24439310
Campbell, K. K., Gardner, A., Scott, D. J., Johnson, J., Harvey, J., & Kazley, A. S. (2024) · Figshare · doi:10.6084/m9.figshare.24439457
Arad, D., Rosenfeld, A., & Magnezi, R. (2024) · Figshare · doi:10.6084/m9.figshare.26579639
The Weekend Effect: Is Surgery on Friday Associated With a Greater Risk of Complications?
Khalil, M., King, J., Altaf, A., Zindani, S., Rashid, Z., Sarfraz, A., Mevawalla, A., & Pawlik, T. M. (2026) · Journal of Surgical Research · doi:10.1016/j.jss.2026.02.033
Swoboda, L., Bell, D., Bauer, K., & Clayton, S. (2026) · Advances in Skin & Wound Care · doi:10.1097/asw.0000000000000450
Checklist Utility in the Perioperative Care Environment
Sultan, E. (2026) · Cambridge University Press eBooks · doi:10.1017/9781009467414.046
Schmidt, E., Balk, Y. A., ten Broeke, P., Louisa, H., Adriaanse, M. A., & Hamming, J. (2026) · Current Problems in Surgery · doi:10.1016/j.cpsurg.2026.102088
Shemesh, S. Z., Kelmer, P., Asprilla, J., Cohen, O., Cohen, Z. R., & Ungar, L. (2026) · Clinical and Translational Neuroscience · doi:10.3390/ctn10030021
Verma, D. M. K., Prakesh, J., Bhat, M. S. R., & Meena, P. (. S. K. (2026) · PAIN JOINTS SPINE · doi:10.1922/pjs.16.6s.2026.963
Innovations in Surgical Quality Improvement
Kelz, R. R., & Hwang, J. (2026) · Success in academic surgery · doi:10.1007/978-3-032-30411-7_13
From checklist to closed-loop: the case for AI-supported perioperative management in esophagectomy
Burri, P., Chatziisaak, D., Schneider, M. A., Steffen, T., Wolf, S., Weiss, T., Cron, L., & Gutschow, C. A. (2026) · Intelligence-Based Medicine · doi:10.1016/j.ibmed.2026.100471
Hamad, D. M., Conn, L. G., Haas, B., Jerath, A., & Nathens, A. B. (2026) · Injury · doi:10.1016/j.injury.2026.113669
Unit, E. E. S. A. C. A. N. G. S., Li, E., Blackwell, S., Buchwald, P., Castro, L., Chaudhri, S., Chowdhury, S., Dardanov, D., Dulskas, A., Elhadi, M., et al. (2026) · British journal of surgery · doi:10.1093/bjs/znag107
Have We Asked Too Much of the Surgical Time-out?
Bitterman, A. D., & Cohn, R. M. (2026) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.26.00777
Metadata
- Authors
- Urbach, D. R., Govindarajan, A., Saskin, R., Wilton, A. S., & Baxter, N. N.
- Affiliations
- Mount Sinai Hospital (CA)
- Institute for Clinical Evaluative Sciences (CA)
- St. Michael's Hospital (CA)
- Venue
- New England Journal of Medicine
- Publisher
- Massachusetts Medical Society
- Published
- 2014-03-13
- Volume
- 370
- Issue
- 11
- Pages
- 1029-1038
- ISSN
- 0028-4793 (ISSN-L)
- 1533-4406
- OpenAlex
- W2149382303
- Cited by
- 627
- References
- 25
- Citations by year
- 2026: 14 · 2025: 12 · 2024: 28 · 2023: 28 · 2022: 32 · 2021: 43 · 2020: 51 · 2019: 71 · 2018: 62 · 2017: 65 · 2016: 81 · 2015: 91 · 2014: 47
- FWCI
- 164.51
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- New England Journal of Medicine (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Canadian Institutes of Health Research (89704_1)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Patient Safety and Medication Errors
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › Cardiac, Anesthesia and Surgical Outcomes
- Health Sciences › Nursing › Leadership and Management › Hospital Admissions and Outcomes
- Keywords
- surgical safety checklist, postoperative mortality, surgical complications, length of hospital stay, hospital readmission, emergency department visits, hospital policy
- MeSH terms
- Adolescent, Adult, Aged, Child, Child, Preschool, Female, Hospitals, Humans, Infant, Male, Middle Aged, Ontario, Postoperative Complications, Risk, Surgical Procedures, Operative, Hospital Mortality, Checklist, Patient Safety
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.