Automatic Detection of Front-Line Clinician Hospital Shifts: A Novel Use of Electronic Health Record Timestamp Data
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Objective Excess physician work hours contribute to burnout and medical errors. Self-report of work hours is burdensome and often inaccurate. We aimed to validate a method that automatically determines provider shift duration based on electronic health record (EHR) timestamps across multiple inpatient settings within a single institution. Methods We developed an algorithm to calculate shift start and end times for inpatient providers based on EHR timestamps. We validated the algorithm based on overlap between calculated shifts and scheduled shifts. We then demonstrated a use case by calculating shifts for pediatric residents on inpatient rotations from July 1, 2015 through June 30, 2016, comparing hours worked and number of shifts by rotation and role. Results We collected 6.3 × 107 EHR timestamps for 144 residents on 771 inpatient rotations, yielding 14,678 EHR-calculated shifts. Validation on a subset of shifts demonstrated 100% shift match and 87.9 ± 0.3% overlap (mean ± standard error [SE]) with scheduled shifts. Senior residents functioning as front-line clinicians worked more hours per 4-week block (mean ± SE: 273.5 ± 1.7) than senior residents in supervisory roles (253 ± 2.3) and junior residents (241 ± 2.5). Junior residents worked more shifts per block (21 ± 0.1) than senior residents (18 ± 0.1). Conclusion Automatic calculation of inpatient provider work hours is feasible using EHR timestamps. An algorithm to assess provider work hours demonstrated criterion validity via comparison with scheduled shifts. Differences between junior and senior residents in calculated mean hours worked and number of shifts per 4-week block were also consistent with differences in scheduled shifts and duty-hour restrictions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Physician burnout: contributors, consequences and solutions
West, C. P., Dyrbye, L. N., & Shanafelt, T. D. (2018) · Journal of Internal Medicine · doi:10.1111/joim.12752 · Cited by 2,768
Effect of Reducing Interns' Work Hours on Serious Medical Errors in Intensive Care Units
Landrigan, C. P., Rothschild, J. M., Cronin, J. W., Kaushal, R., Burdick, E., Katz, J. T., Lilly, C. M., Stone, P. H., Lockley, S. W., Bates, D. W., et al. (2004) · New England Journal of Medicine · doi:10.1056/nejmoa041406 · Cited by 1,760 · cited 1×
“Additionally, excessive physician work hours are associated with worse clinical performance, 13 increased medical errors, 14 and may contribute to burnout.”
BackgroundAllocation of Physician Time in Ambulatory Practice: A Time and Motion Study in 4 Specialties
Sinsky, C., Colligan, L., Li, L., Prgomet, M., Reynolds, S., Goeders, L., Westbrook, J., Tutty, M., & Blike, G. (2016) · Annals of Internal Medicine · doi:10.7326/m16-0961 · Cited by 1,494
Shanafelt, T. D., Dyrbye, L. N., Sinsky, C., Hasan, O., Satele, D., Sloan, J., & West, C. P. (2016) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2016.05.007 · Cited by 1,086
Arndt, B. G., Beasley, J. W., Watkinson, M. D., Temte, J. L., Tuan, W.-J., Sinsky, C. A., & Gilchrist, V. J. (2017) · The Annals of Family Medicine · doi:10.1370/afm.2121 · Cited by 972
Addressing Physician Burnout: The Way Forward
Shanafelt, T. D., Dyrbye, L. N., & West, C. P. (2017) · JAMA · doi:10.1001/jama.2017.0076 · Cited by 447
Electronic medical records and physician stress in primary care: results from the MEMO Study
Babbott, S., Manwell, L. B., Brown, R., Montague, E., Williams, E., Schwartz, M., Hess, E., & Linzer, M. (2014) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-001875 · Cited by 366
Electronic Health Record Alert-Related Workload as a Predictor of Burnout in Primary Care Providers
Russo, E., Singh, H., & Gregory, M. E. (2017) · Applied Clinical Informatics · doi:10.4338/aci-2017-01-ra-0003 · Cited by 169
Cited by
Moy, A. J., Schwartz, J. M., Chen, R., Sadri, S., Lucas, E., Cato, K. D., & Rossetti, S. C. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa325 · Cited by 284
“For example, Dziorny and colleagues developed an automated algorithm to quantify shift duration among physicians in an inpatient setting and internally validated it against scheduled shift-time.(83) Likewise, DiAngi et al proposed the “calculated EHR time outside of clinic” (CLOC) metric for ambulatory settings to mea…”
BackgroundMethodRule, A., Chiang, M. F., & Hribar, M. R. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz196 · Cited by 136
Temporal Associations Between EHR-Derived Workload, Burnout, and Errors: a Prospective Cohort Study
Lou, S. S., Lew, D., Harford, D. R., Lu, C., Evanoff, B. A., Duncan, J. G., & Kannampallil, T. (2022) · Journal of General Internal Medicine · doi:10.1007/s11606-022-07620-3 · Cited by 46
“Audit logs have previously been used to describe clinician work hours and workflow.(10,21,22) We extracted audit logs for the study participants from the study site’s EHR data warehouse (Epic Systems, Verona, WI).”
MethodLou, S. S., Liu, H., Harford, D., Lu, C., & Kannampallil, T. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac239 · Cited by 13
Metadata
- Authors
- Dziorny, A., Orenstein, E., Lindell, R., Hames, N., Washington, N., & Desai, B.
- Venue
- Applied Clinical Informatics
- Publisher
- Georg Thieme Verlag KG
- Published
- 2019-01
- Volume
- 10
- Issue
- 01
- Pages
- 028-037
- ISSN
- 1869-0327 (ISSN-L)
- OpenAlex
- W2909142896
- Cited by
- 16
- References
- 8
- FWCI
- 3.12
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Automatic Detection of Front-Line Clinician Hospital Shifts: A Novel Use of Electronic Health Record Timestamp Data. https://app.cochat.ai/papers/10.1055/s-0038-1676819
- The paper
- Dziorny, A., Orenstein, E., Lindell, R., Hames, N., Washington, N., & Desai, B. (2019). Automatic Detection of Front-Line Clinician Hospital Shifts: A Novel Use of Electronic Health Record Timestamp Data. Applied Clinical Informatics. https://doi.org/10.1055/s-0038-1676819
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.