Patient Safety Outcomes under Flexible and Standard Resident Duty-Hour Rules
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Concern persists that extended shifts in medical residency programs may adversely affect patient safety. METHODS: We conducted a cluster-randomized noninferiority trial in 63 internal-medicine residency programs during the 2015-2016 academic year. Programs underwent randomization to a group with standard duty hours, as adopted by the Accreditation Council for Graduate Medical Education (ACGME) in July 2011, or to a group with more flexible duty-hour rules that did not specify limits on shift length or mandatory time off between shifts. The primary outcome for each program was the change in unadjusted 30-day mortality from the pretrial year to the trial year, as ascertained from Medicare claims. We hypothesized that the change in 30-day mortality in the flexible programs would not be worse than the change in the standard programs (difference-in-difference analysis) by more than 1 percentage point (noninferiority margin). Secondary outcomes were changes in five other patient safety measures and risk-adjusted outcomes for all measures. RESULTS: The change in 30-day mortality (primary outcome) among the patients in the flexible programs (12.5% in the trial year vs. 12.6% in the pretrial year) was noninferior to that in the standard programs (12.2% in the trial year vs. 12.7% in the pretrial year). The test for noninferiority was significant (P = 0.03), with an estimate of the upper limit of the one-sided 95% confidence interval (0.93%) for a between-group difference in the change in mortality that was less than the prespecified noninferiority margin of 1 percentage point. Differences in changes between the flexible programs and the standard programs in the unadjusted rate of readmission at 7 days, patient safety indicators, and Medicare payments were also below 1 percentage point; the noninferiority criterion was not met for 30-day readmissions or prolonged length of hospital stay. Risk-adjusted measures generally showed similar findings. CONCLUSIONS: Allowing program directors flexibility in adjusting duty-hour schedules for trainees did not adversely affect 30-day mortality or several other measured outcomes of patient safety. (Funded by the National Heart, Lung, and Blood Institute and Accreditation Council for Graduate Medical Education; iCOMPARE ClinicalTrials.gov number, NCT02274818.).
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A limitation of several studies that informed this latest policy change is that the primary end points lacked sensitivity (eg, hospital-wide mortality) or were only tangentially related to the care provided by first-year resident physicians”
In the citing paper
“In addition, the prespecified non-inferiority threshold allowed for non-inferiority to be declared as long as hospital-level 30-day mortality for any cause did not increase in the flexible group by >1%.”
In the citing paper
“In any case, neither of these studies suggested limiting work hours is harmful to patient safety.”
In the citing paper
“Another recent effort, the iCOMPARE (Individualized Comparative Effectiveness of Models Optimizing Patient Safety and Resident Education) trial,20 compared programmes randomised to flexible work hours (where extended duration shifts were permitted) with programmes that maintained the 2011 ACGME work-hour restrictions, and similarly found that flexible programmes were not inferior to standard progr”
Citations
Cites
Comorbidity measures for use with administrative data.
Elixhauser, A., Steiner, C., Harris, D. R., & Coffey, R. M. (1998) · Medical Care · doi:10.1097/00005650-199801000-00004 · Cited by 9,921
Subjective and objective sleepiness in the active individual
Åkerstedt, T., & Gillberg, M. (1990) · International Journal of Neuroscience · doi:10.3109/00207459008994241 · Cited by 3,088
Maximizing sensitivity of the Psychomotor Vigilance Test (PVT) to sleep loss
Basner, M., & Dinges, D. F. (2011) · Sleep · doi:10.1093/sleep/34.5.581 · Cited by 958
Self-citationQuality of Care, Process, and Outcomes in Elderly Patients With Pneumonia
Meehan, T. P. (1997) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1997.03550230056037 · Cited by 919
Asch, D. A., & Parker, R. M. (1988) · New England Journal of Medicine · doi:10.1056/nejm198803243181209 · Cited by 396
Self-citationKrumholz, H. M., Lin, Z., Keenan, P. S., Chen, J., Ross, J. S., Drye, E. E., Bernheim, S. M., Wang, Y., Bradley, E. H., Han, L. F., et al. (2013) · JAMA · doi:10.1001/jama.2013.333 · Cited by 354
Volpp, K. G., Rosen, A. K., Rosenbaum, P. R., Romano, P. S., Even-Shoshan, O., Wang, Y., Bellini, L., Behringer, T., & Silber, J. H. (2007) · JAMA · doi:10.1001/jama.298.9.975 · Cited by 325
Self-citationA systematic review of the effect of retention methods in population-based cohort studies
Booker, C. L., Harding, S., & Benzeval, M. (2011) · BMC Public Health · doi:10.1186/1471-2458-11-249 · Cited by 300
Does Clinical Evidence Support ICD-9-CM Diagnosis Coding of Complications?
McCarthy, E. P., Iezzoni, L. I., Davis, R. B., Palmer, R. H., Cahalane, M., Hamel, M. B., Mukamal, K., Phillips, R. S., & Davies, D. T. (2000) · Medical Care · doi:10.1097/00005650-200008000-00010 · Cited by 242
Volpp, K. G., Rosen, A. K., Rosenbaum, P. R., Romano, P. S., Even-Shoshan, O., Canamucio, A., Bellini, L., Behringer, T., & Silber, J. H. (2007) · JAMA · doi:10.1001/jama.298.9.984 · Cited by 228
Self-citationVolpp, K. G., Rosen, A. K., & Rosenbaum, P. R. (2008) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2007.11.035 · Cited by 222
Self-citationUsing administrative data to screen hospitals for high complication rates.
Iezzoni, L. I., Daley, J., Heeren, T., Foley, S. M., Hughes, J. S., Fisher, E. S., Duncan, C. C., & Coffman, G. A. (1994) · PubMed · Cited by 196
Education Outcomes in a Duty-Hour Flexibility Trial in Internal Medicine
Desai, S. V., Asch, D. A., Bellini, L. M., Chaiyachati, K. H., Liu, M., Sternberg, A. L., Tonascia, J., Yeager, A. M., Asch, J. M., Katz, J. T., et al. (2018) · New England Journal of Medicine · doi:10.1056/nejmoa1800965 · Cited by 173
Self-citationProblems in dealing with missing data and informative censoring in clinical trials
Shih, W. J. (2002) · Current Controlled Trials in Cardiovascular Medicine · doi:10.1186/1468-6708-3-4 · Cited by 170
Drye, E. E., Normand, S.-L. T., Wang, Y., Ross, J. S., Schreiner, G. C., Han, L., Rapp, M., & Krumholz, H. M. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-156-1-201201030-00004 · Cited by 152
Rajaram, R., Chung, J. W., Jones, A. T., Cohen, M. E., Dahlke, A. R., Ko, C. Y., Tarpley, J. L., Lewis, F. R., Hoyt, D. B., & Bilimoria, K. Y. (2014) · JAMA · doi:10.1001/jama.2014.15277 · Cited by 139
Silber, J. H., Rosenbaum, P. R., McHugh, M. D., Ludwig, J. M., Smith, H. L., Niknam, B. A., Even‐Shoshan, O., Fleisher, L. A., Kelz, R. R., & Aiken, L. H. (2016) · JAMA Surgery · doi:10.1001/jamasurg.2015.4908 · Cited by 138
Self-citationPatel, M. S., Volpp, K. G., Small, D. S., Hill, A. S., Even-Shoshan, O., Rosenbaum, L., Ross, R. N., Bellini, L., Zhu, J., & Silber, J. H. (2014) · JAMA · doi:10.1001/jama.2014.15273 · Cited by 113
Self-citationMedical and Financial Risks Associated With Surgery in the Elderly Obese
Silber, J. H., Rosenbaum, P. R., Kelz, R. R., Reinke, C. E., Neuman, M. D., Ross, R. N., Even‐Shoshan, O., David, G., Saynisch, P. A., Kyle, F. A., et al. (2012) · Annals of Surgery · doi:10.1097/sla.0b013e31825375ef · Cited by 92
Self-citationRosen, A. K., Loveland, S. A., Romano, P. S., Itani, K. M. F., Silber, J. H., Even-Shoshan, O. O., Halenar, M. J., Teng, Y., Zhu, J., & Volpp, K. G. (2009) · Medical Care · doi:10.1097/mlr.0b013e31819a588f · Cited by 81
Self-citationDid Duty Hour Reform Lead to Better Outcomes Among the Highest Risk Patients?
Volpp, K. G. M., Rosen, A. K., Rosenbaum, P. R., Romano, P. S., Itani, K. M. F., Bellini, L. M., Even‐Shoshan, O., Cen, L., Wang, Y., Halenar, M. J., et al. (2009) · Journal of General Internal Medicine · doi:10.1007/s11606-009-1011-z · Cited by 79
Self-citationSleep and Alertness in a Duty-Hour Flexibility Trial in Internal Medicine
Basner, M., Asch, D. A., Shea, J. A., Bellini, L. M., Carlin, M., Ecker, A. J., Malone, S. K., Desai, S. V., Sternberg, A. L., Tonascia, J., et al. (2019) · New England Journal of Medicine · doi:10.1056/nejmoa1810641 · Cited by 69
Self-citationThe Composition of Intern Work While on Call
Fletcher, K. E., Visotcky, A. M., Slagle, J. M., Tarima, S. S., Weinger, M. B., & Schapira, M. M. (2012) · Journal of General Internal Medicine · doi:10.1007/s11606-012-2120-7 · Cited by 66
Length of Stay, Conditional Length of Stay, and Prolonged Stay in Pediatric Asthma
Silber, J. H., Rosenbaum, P. R., Even‐Shoshan, O., Shabbout, M., Zhang, X., Bradlow, E. T., & Marsh, R. R. (2003) · Health Services Research · doi:10.1111/1475-6773.00150 · Cited by 55
Self-citationDuty Hours, Quality of Care, and Patient Safety: General Surgery Resident Perceptions
Borman, K. R., Jones, A. T., & Shea, J. A. (2012) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2012.02.010 · Cited by 38
Self-citationSilber, J. H., Rosenbaum, P. R., Koziol, L. F., Sutaria, N. B., Marsh, R. R., & Even‐Shoshan, O. (1999) · PubMed · Cited by 38
Self-citationProlonged Hospital Stay and the Resident Duty Hour Rules of 2003
Silber, J. H., Rosenbaum, P. R., Rosen, A. K., Romano, P. S., Itani, K. M. F., Cen, L., Mi, L., Halenar, M. J., Even-Shoshan, O., & Volpp, K. G. (2009) · Medical Care · doi:10.1097/mlr.0b013e3181adcbff · Cited by 37
Self-citationTeaching Hospital Five-Year Mortality Trends in the Wake of Duty Hour Reforms
Volpp, K. G. M., Small, D. S., Romano, P. S., Itani, K. M. F., Rosen, A. K., Even‐Shoshan, O., Wang, Y., Bellini, L. M., Halenar, M. J., Korovaichuk, S., et al. (2013) · Journal of General Internal Medicine · doi:10.1007/s11606-013-2401-9 · Cited by 21
Self-citationShea, J. A., Silber, J. H., Desai, S. V., Dinges, D. F., Bellini, L. M., Tonascia, J., Sternberg, A. L., Small, D. S., Shade, D. M., Katz, J. T., et al. (2018) · BMJ Open · doi:10.1136/bmjopen-2018-021711 · Cited by 18
Self-citationTeaching Hospital Financial Status and Patient Outcomes Following ACGME Duty Hour Reform
Navathe, A. S., Silber, J. H., Small, D. S., Rosen, A. K., Romano, P. S., Even‐Shoshan, O., Wang, Y., Zhu, J., Halenar, M. J., & Volpp, K. G. M. (2012) · Health Services Research · doi:10.1111/j.1475-6773.2012.01453.x · Cited by 10
Self-citation
Cited by
Rotenstein, L. S., Brown, R., Sinsky, C., & Linzer, M. (2023) · Journal of General Internal Medicine · doi:10.1007/s11606-023-08153-z · Cited by 204
Fang, Y., Forger, D. B., Frank, E., Sen, S., & Goldstein, C. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00400-z · Cited by 99
Effect on patient safety of a resident physician schedule without 24-hour shifts
Landrigan, C. P., Rahman, S. A., Sullivan, J. P., Vittinghoff, E., Barger, L. K., Sanderson, A. L., Wright, K. P., O’Brien, C. S., Qadri, S., St. Hilaire, M. A., et al. (2020) · New England Journal of Medicine · doi:10.1056/nejmoa1900669 · Cited by 105
The association between resident physician Work-Hour regulations and physician safety and health
Weaver, M. D., Landrigan, C. P., Sullivan, J. P., O'Brien, C. S., Qadri, S., Viyaran, N., Wang, W., Vetter, C., Czeisler, C. A., & Barger, L. K. (2020) · The American Journal of Medicine · doi:10.1016/j.amjmed.2019.12.053 · Cited by 79
“As reported elsewhere, compliance with the policy was not universal, (25, 26) and randomized trials of flexible hours permitted training programs at some institutions to exceed existing work hour limitations.(6, 8) Participants in both cohorts reporting exceeding 80 weekly work hours and working extended duration shif…”
BackgroundMelariri, H., Freercks, R., van der Merwe, E., ten Ham‐Baloyi, W., Oyedele, O., Murphy, R. A., Claasen, C., Etusim, P. E., Achebe, M., Offiah, S. A., et al. (2024) · EClinicalMedicine · doi:10.1016/j.eclinm.2024.102571 · Cited by 100
“This fi nding, which is consistent with other studies, 83 – 86 may be related to patients having multiple conditions warranting increased use of invasive interventions, and in turn increases their risks of contracting HAI.”
Result
Metadata
- Authors
- Silber, J. H., Bellini, L. M., Shea, J. A., Desai, S. V., Dinges, D. F., Basner, M., Even-Shoshan, O., Hill, A. S., Hochman, L. L., Katz, J. T., Ross, R. N., Shade, D. M., Small, D. S., Sternberg, A. L., Tonascia, J., Volpp, K. G., & Asch, D. A.
- Affiliations
- Children's Hospital of Philadelphia (US)
- From the Center for Outcomes Research, Children’s Hospital of Philadelphia (J.H.S., O.E.-S., A.S.H., L.L.H., R.N.R.), the Departments of Pediatrics (J.H.S.), Anesthesiology and Critical Care (J.H.S.), and Medicine (L.M.B., J.A.S., K.G.V., D.A.A.), University of Pennsylvania School of Medicine, the Departments of Health Care Management (J.H.S., K.G.V., D.A.A.) and Statistics (D.S.S.), the Wharton School, the Leonard Davis Institute of Health Economics (J.H.S., J.A.S., D.S.S., K.G.V., D.A.A.), and the...
- Brigham and Women's Hospital (US)
- ORCID
- Venue
- New England Journal of Medicine
- Publisher
- Massachusetts Medical Society
- Published
- 2019-03-07
- Volume
- 380
- Issue
- 10
- Pages
- 905-914
- ISSN
- 0028-4793 (ISSN-L)
- 1533-4406
- PMC
- PMC6476299
- OpenAlex
- W2921233494
- Cited by
- 87
- References
- 30
- Citations by year
- 2026: 6 · 2025: 10 · 2024: 6 · 2023: 11 · 2022: 20 · 2021: 10 · 2020: 14 · 2019: 9
- FWCI
- 15.39
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- New England Journal of Medicine (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Heart, Lung, and Blood Institute (U01HL126088, U01HL125388)
- Topics
- Health Sciences › Nursing › Leadership and Management › Hospital Admissions and Outcomes
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Patient Safety and Medication Errors
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Sleep and Work-Related Fatigue
- Keywords
- patient safety, 30-day mortality, internal medicine residency, non-inferiority, hospital readmission, length of hospital stay, Medicare payments, graduate medical education
- MeSH terms
- Humans, Internal Medicine, Internship and Residency, Length of Stay, Patient Readmission, Personnel Staffing and Scheduling, United States, Workload, Hospital Mortality, Patient Safety
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.