The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index; 2 of the 24 sources its claims cite were checked for support.
Changes in medical errors after implementation of a handoff program
Open accessAbstract
BACKGROUND: Miscommunications are a leading cause of serious medical errors. Data from multicenter studies assessing programs designed to improve handoff of information about patient care are lacking. METHODS: We conducted a prospective intervention study of a resident handoff-improvement program in nine hospitals, measuring rates of medical errors, preventable adverse events, and miscommunications, as well as resident workflow. The intervention included a mnemonic to standardize oral and written handoffs, handoff and communication training, a faculty development and observation program, and a sustainability campaign. Error rates were measured through active surveillance. Handoffs were assessed by means of evaluation of printed handoff documents and audio recordings. Workflow was assessed through time-motion observations. The primary outcome had two components: medical errors and preventable adverse events. RESULTS: In 10,740 patient admissions, the medical-error rate decreased by 23% from the preintervention period to the postintervention period (24.5 vs. 18.8 per 100 admissions, P<0.001), and the rate of preventable adverse events decreased by 30% (4.7 vs. 3.3 events per 100 admissions, P<0.001). The rate of nonpreventable adverse events did not change significantly (3.0 and 2.8 events per 100 admissions, P=0.79). Site-level analyses showed significant error reductions at six of nine sites. Across sites, significant increases were observed in the inclusion of all prespecified key elements in written documents and oral communication during handoff (nine written and five oral elements; P<0.001 for all 14 comparisons). There were no significant changes from the preintervention period to the postintervention period in the duration of oral handoffs (2.4 and 2.5 minutes per patient, respectively; P=0.55) or in resident workflow, including patient-family contact and computer time. CONCLUSIONS: Implementation of the handoff program was associated with reductions in medical errors and in preventable adverse events and with improvements in communication, without a negative effect on workflow. (Funded by the Office of the Assistant Secretary for Planning and Evaluation, U.S. Department of Health and Human Services, and others.).
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
2 Valid · 0 Not valid · 14 Not checked · 54 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“We chose to combine several educational and process changes into a single bundled intervention because numerous successful patient-safety interventions have used this approach.1,2,40”
§ Changes in medical errors after implementation of a handoff program > Dated Vital Signs
What the sources say
- Not checked — no full text of the sourcecites [1] source
- Supportedcites [2] source
The Intervention section describes a checklist combining multiple surgical-safety practices with staff education. The Results report lower complication and death rates after implementation. This paper therefore provides an example of a successful bundled patient-safety intervention; the sentence also cites other sources for the broader claim that there were numerous such interventions. (LLM, conf=0.90)
- Not matchedcites [40]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“although sleep depriva-tion increases the risk of performance failures and medical errors, 27,[35][36][37]”
§ Changes in medical errors after implementation of a handoff program > Discussion
What the sources say
- Supportedcites [27] source
The Quality of Life, Sleep, and Fatigue section reports that interns on longer shifts slept less and had roughly twice the rate of attentional failures. The Patient Safety and Quality of Care section reports significantly more serious medical errors on the traditional 30-hour-shift schedule than on the 16-hour-shift schedule. Page numbers are not available in our copy. (LLM, conf=0.90)
- Not matchedcites [35]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites [36]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We found substantial interinstitutional variation in baseline error rates.”
§ Changes in medical errors after implementation of a handoff program > Dated Vital Signs
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Although the implementation of the I-PASS Handoff Bundle was associated with an overall reduction in medical errors, error rates did not change significantly at three of the nine sites.”
§ Changes in medical errors after implementation of a handoff program > Dated Vital Signs
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Across sites, significant increases were observed in the inclusion of all prespecified key elements in written documents and oral communication during handoff (nine written and five oral elements; P<0.001 for all 14 comparisons).”
- Also stated in: § Written and Oral Handoff Quality · plain
“I-PASS implementation was followed by significant improvements in the inclusion of all nine written handoff elements evaluated and all five oral handoff elements evaluated”
§ Changes in medical errors after implementation of a handoff program > Abstract
plainstates a causen = 5,752- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Written and Oral Handoff Quality · plain
35 more claims
Create a free account to see all 70 claims and every source verdict.
- It may state two separate claims as one. 20
- Probably not a substantial claim. 14
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For day–night shift handoffs, structured communication with the IPASS framework, which has been used at many residency training programs, reduces medical errors and adverse events in the hospital (2).”
From Cocreating the ICU-PAUSE Tool for Intensive Care Unit–Ward Transitions (2022) · cites this paper as [2]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Standardized handoff processes have been found to reduce communication errors and adverse patient events in other clinical environments but are understudied at the ICU-ward interface.”
From Improving Communication in Intensive Care Unit to Ward Transitions: Protocol for Multisite National Implementation of the ICU-PAUSE Handoff Tool (2023) · cites this paper as [5]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Currently available handoff tools [5] are informed by external resources and conceptual models [28] and lack the necessary elements to facilitate a safe transfer of information at the ICU-ward interface.”
From Improving Communication in Intensive Care Unit to Ward Transitions: Protocol for Multisite National Implementation of the ICU-PAUSE Handoff Tool (2023) · cites this paper as [5]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Currently available handoff tools [5] are informed by external resources and conceptual models [28]”
From Improving Communication in Intensive Care Unit to Ward Transitions: Protocol for Multisite National Implementation of the ICU-PAUSE Handoff Tool (2023) · cites this paper as [5]
Citations
Cites
Longitudinal Data Analysis for Discrete and Continuous Outcomes
Zeger, S. L., & Liang, K.-Y. (1986) · Biometrics · doi:10.2307/2531248 · Cited by 7,764
A surgical safety checklist to reduce morbidity and mortality in a global population
Haynes, A. B., Weiser, T. G., Berry, W. R., Lipsitz, S. R., Breizat, A.-H. S., Dellinger, E. P., Herbosa, T., Joseph, S., Kibatala, P. L., Lapitan, M. C. M., et al. (2009) · New England Journal of Medicine · doi:10.1056/nejmsa0810119 · Cited by 5,688
Self-citationBrennan, T. A., Leape, L. L., Laird, N. M., Hebert, L., Localio, A. R., Lawthers, A. G., Newhouse, J. P., Weiler, P. C., & Hiatt, H. H. (1991) · New England Journal of Medicine · doi:10.1056/nejm199102073240604 · Cited by 4,627
An Intervention to Decrease Catheter-Related Bloodstream Infections in the ICU
Pronovost, P., Needham, D., Berenholtz, S., Sinopoli, D., Chu, H., Cosgrove, S., Sexton, B., Hyzy, R., Welsh, R., Roth, G., et al. (2006) · New England Journal of Medicine · doi:10.1056/nejmoa061115 · Cited by 4,387
Incidence of Adverse Drug Events and Potential Adverse Drug Events: Implications for Prevention
Bates, D. W. (1995) · JAMA · doi:10.1001/jama.1995.03530010043033 · Cited by 2,127
Effect of Reducing Interns' Work Hours on Serious Medical Errors in Intensive Care Units
Landrigan, C. P., Rothschild, J. M., Cronin, J. W., Kaushal, R., Burdick, E., Katz, J. T., Lilly, C. M., Stone, P. H., Lockley, S. W., Bates, D. W., et al. (2004) · New England Journal of Medicine · doi:10.1056/nejmoa041406 · Cited by 1,760
Self-citationChildren With Medical Complexity: An Emerging Population for Clinical and Research Initiatives
Cohen, E., Kuo, D. Z., Agrawal, R., Berry, J. G., Bhagat, S. K. M., Simon, T. D., & Srivastava, R. (2011) · Pediatrics · doi:10.1542/peds.2010-0910 · Cited by 1,340
Self-citationTemporal Trends in Rates of Patient Harm Resulting from Medical Care
Landrigan, C. P., Parry, G. J., Bones, C. B., Hackbarth, A. D., Goldmann, D. A., & Sharek, P. J. (2010) · New England Journal of Medicine · doi:10.1056/nejmsa1004404 · Cited by 1,144
Self-citationRelationship between medication errors and adverse drug events
Bates, D. W., Boyle, D. L., Vliet, M. B. V., Schneider, J., & Leape, L. (1995) · Journal of General Internal Medicine · doi:10.1007/bf02600255 · Cited by 981
Rothschild, J. M., Landrigan, C. P., Cronin, J. W., Kaushal, R., Lockley, S. W., Burdick, E., Stone, P. H., Lilly, C. M., Katz, J. T., Czeisler, C. A., et al. (2005) · Critical Care Medicine · doi:10.1097/01.ccm.0000171609.91035.bd · Cited by 925
Self-citation
Cited by
Bates, D. W., & Singh, H. (2018) · Health Affairs · doi:10.1377/hlthaff.2018.0738 · Cited by 440
Goodman, D., Ogrinc, G., Davies, L., Baker, G. R., Barnsteiner, J., Foster, T. C., Gali, K., Hilden, J., Horwitz, L., Kaplan, H. C., et al. (2016) · BMJ Quality & Safety · doi:10.1136/bmjqs-2015-004480 · Cited by 374
“20 Interventions to improve patient experience, or to enhance team communication about patient safety 21 may also address quality problems, but in the absence of an established, evidence-based standard.”
The Impact of Rudeness on Medical Team Performance: A Randomized Trial
Riskin, A., Erez, A., Foulk, T. A., Kugelman, A., Gover, A., Shoris, I., Riskin, K. S., & Bamberger, P. A. (2015) · Pediatrics · doi:10.1542/peds.2015-1385 · Cited by 318
Khan, A., Spector, N. D., Baird, J. D., Ashland, M., Starmer, A. J., Rosenbluth, G., Garcia, B. M., Litterer, K. P., Rogers, J. E., Dalal, A. K., et al. (2018) · BMJ · doi:10.1136/bmj.k4764 · Cited by 240
Self-citationRates and Characteristics of Paid Malpractice Claims Among US Physicians by Specialty, 1992-2014
Schaffer, A. C., Jena, A. B., Seabury, S. A., Singh, H., Chalasani, V., & Kachalia, A. (2017) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2017.0311 · Cited by 228
Metadata
- Authors
- Starmer, A. J., Spector, N. D., Srivastava, R., West, D. C., Rosenbluth, G., Allen, A. D., Noble, E. L., Tse, L. L., Dalal, A. K., Keohane, C. A., Lipsitz, S. R., Rothschild, J. M., Wien, M. F., Yoon, C. S., Zigmont, K. R., Wilson, K. M., O’Toole, J. K., Solan, L. G., Aylor, M., Bismilla, Z., Coffey, M., Mahant, S., Blankenburg, R. L., Destino, L. A., Everhart, J. L., Patel, S. J., Bale, J. F., Spackman, J. B., Stevenson, A. T., Calaman, S., Cole, F. S., Balmer, D. F., Hepps, J. H., Lopreiato, J. O., Yu, C. E., Sectish, T. C., & Landrigan, C. P.
- Affiliations
- Boston Children's Hospital (US)
- St. Christopher's Hospital for Children (US)
- Intermountain Healthcare (US)
- University of California, San Francisco (US)
- Harvard University (US)
- Brigham and Women's Hospital (US)
- University of Toronto (CA)
- Cincinnati Children's Hospital Medical Center (US)
- Oregon Health & Science University (US)
- Lucile Packard Children's Hospital (US)
- University of Hawaiʻi at Mānoa (US)
- St. Louis Children's Hospital (US)
- Uniformed Services University of the Health Sciences (US)
- ORCID
- Starmer, Amy J.
- Spector, Nancy D.
- Srivastava, Rajendu
- West, Daniel C.
- Rosenbluth, Glenn
- Noble, Elizabeth L.
- Tse, Lisa L.
- Dalal, Anuj K.
- Lipsitz, Stuart R.
- Yoon, Catherine S.
- Wilson, Karen M.
- O’Toole, Jennifer K.
- Aylor, Megan
- Bismilla, Zia
- Coffey, Maitreya
- Mahant, Sanjay
- Blankenburg, Rebecca L.
- Destino, Lauren A.
- Patel, Shilpa J.
- Bale, James F.
- Cole, F. Sessions
- Balmer, Dorene F.
- Lopreiato, Joseph O.
- Sectish, Theodore C.
- Landrigan, Christopher P.
- Venue
- New England Journal of Medicine
- Publisher
- Massachusetts Medical Society
- Published
- 2014-11-06
- Volume
- 371
- Issue
- 19
- Pages
- 1803-1812
- ISSN
- 0028-4793 (ISSN-L)
- 1533-4406
- OpenAlex
- W2133023740
- Cited by
- 947
- References
- 35
- Citations by year
- 2026: 91 · 2025: 68 · 2024: 65 · 2023: 59 · 2022: 71 · 2021: 73 · 2020: 84 · 2019: 81 · 2018: 94 · 2017: 99 · 2016: 90 · 2015: 63 · 2014: 3
- FWCI
- 90.65
- Type
- journal article
- Language
- en
- Open access
- Locations
- New England Journal of Medicine (publishedVersion)
- PubMed (publishedVersion)
- Digital Commons@Becker (Washington University School of Medicine) (submittedVersion)
- Funders
- Agency for Healthcare Research and Quality (1k12hs019456-01)
- Topics
- Health Sciences › Nursing › Leadership and Management › Hospital Admissions and Outcomes
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Patient Safety and Medication Errors
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Keywords
- patient handover, medical errors, preventable adverse events, communication errors, faculty development, program sustainability, patient safety
- MeSH terms
- Child, Child, Preschool, Communication, Female, Humans, Internship and Residency, Length of Stay, Male, Pediatrics, Prospective Studies, Severity of Illness Index, Medical Errors, Organizational Case Studies, Workflow, Patient Safety, Patient Handoff
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Changes in medical errors after implementation of a handoff program. https://app.cochat.ai/papers/10.1056/nejmsa1405556
- The paper
- Starmer, A. J., Spector, N. D., Srivastava, R., West, D. C., Rosenbluth, G., Allen, A. D., Noble, E. L., Tse, L. L., Dalal, A. K., Keohane, C. A., Lipsitz, S. R., Rothschild, J. M., Wien, M. F., Yoon, C. S., Zigmont, K. R., Wilson, K. M., O’Toole, J. K., Solan, L. G., Aylor, M., . . . Landrigan, C. P. (2014). Changes in medical errors after implementation of a handoff program. New England Journal of Medicine. https://doi.org/10.1056/nejmsa1405556
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.