Characterizing electronic health record usage patterns of inpatient medicine residents using event log data
Open accessPublished version of a preprint
Abstract
Amid growing rates of burnout, physicians report increasing electronic health record (EHR) usage alongside decreasing clinical facetime with patients. There exists a pressing need to improve physician-computer-patient interactions by streamlining EHR workflow. To identify interventions to improve EHR design and usage, we systematically characterize EHR activity among internal medicine residents at a tertiary academic hospital across various inpatient rotations and roles from June 2013 to November 2016. Logged EHR timestamps were extracted from Stanford Hospital's EHR system (Epic) and cross-referenced against resident rotation schedules. We tracked the quantity of EHR logs across 24-hour cycles to reveal daily usage patterns. In addition, we decomposed daily EHR time into time spent on specific EHR actions (e.g. chart review, note entry and review, results review).In examining 24-hour usage cycles from general medicine day and night team rotations, we identified a prominent trend in which night team activity promptly ceased at the shift's end, while day team activity tended to linger post-shift. Across all rotations and roles, residents spent on average 5.38 hours (standard deviation = 2.07) using the EHR. PGY1 (post-graduate year one) interns and PGY2+ residents spent on average 2.4 and 4.1 times the number of EHR hours on information review (chart, note, and results review) as information entry (note and order entry).Analysis of EHR event log data can enable medical educators and programs to develop more targeted interventions to improve physician-computer-patient interactions, centered on specific EHR actions.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The 5-minute idle time threshold has been used in several studies analyzing raw log data.
“Notably, this threshold has been used in several studies analyzing raw log data.24,25,31,46,47”
From Electronic health record activity changes around new decision support implementation: monitoring using audit logs and topic modeling (2025) · cites this paper as [25]
Audit logs capture EHR-use behavior without interruptions.
“Third, audit logs capture EHR-use behavior without interruptions.”
From Electronic health record activity changes around new decision support implementation: monitoring using audit logs and topic modeling (2025) · cites this paper as [25]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Allocation of Physician Time in Ambulatory Practice: A Time and Motion Study in 4 Specialties
Sinsky, C., Colligan, L., Li, L., Prgomet, M., Reynolds, S., Goeders, L., Westbrook, J., Tutty, M., & Blike, G. (2016) · Annals of Internal Medicine · doi:10.7326/m16-0961 · Cited by 1,494 · see citing works
Shanafelt, T. D., Dyrbye, L. N., Sinsky, C., Hasan, O., Satele, D., Sloan, J., & West, C. P. (2016) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2016.05.007 · Cited by 1,086 · see citing works
Arndt, B. G., Beasley, J. W., Watkinson, M. D., Temte, J. L., Tuan, W.-J., Sinsky, C. A., & Gilchrist, V. J. (2017) · The Annals of Family Medicine · doi:10.1370/afm.2121 · Cited by 972 · see citing works
Flagged first, then by citations
Research works printed but not linked: 10
- [1]Chi J & Verghese A Clinical education and the electronic health record: the flipped patient. JAMA 312, 2331– 2 (2014). 10.1001/jama.2014.12820 25490318 · DOI
- [2]Block L, Habicht R, Wu AW, Desai SV, Wang K, Silva KN, Niessen T, Oliver N, Feldman L. In the wake of the 2003 and 2011 duty hours regulations, how do internal medicine interns spend their time? J. Gen. Intern. Med 28, 1042– 1047 (2013). 10.1007/s11606-013-2376-6 23595927 PMC3710392 · DOI
- [3]Ouyang D, Chen J H, Hom J, & Chi J Internal medicine resident computer usage: an electronic audit of an inpatient service. JAMA Internal Medicine. 176, 252– 54 (2016). 10.1001/jamainternmed.2015.6831 26642261 PMC5951167 · DOI · Paper page
- [4]Desai S V, Asch D A, Bellini L M, Chaiyachati K, Liu M, Sternberg A, et al Education Outcomes in a Duty-Hour Flexibility Trial in Internal Medicine. The New England Journal of Medicine. 10, 1056 (2018). PMC6101652 29557719
- [5]Asch D A, Bilimoria K Y & Desai S V. Resident Duty Hours and Medical Education Policy—Raising the Evidence Bar. N. Engl. J. Med. 376, 1704– 1706 (2017). 10.1056/NEJMp1703690 28402246 · DOI
- [6]Babbott S, Manwell LB, Brown R, Montague E, Williams E, Schwartz M, Hess E, Linzer M. Electronic medical records and physician stress in primary care: results from the MEMO Study. J Am Med Inform Assoc. 21, 1006 (2014). PMC3957395 24005796
- [7]Friedberg M, Chen PG, Van Busum KR, Aunon FM, Pham C, Caloyeras J.P., et al Factors Affecting Physician Professional Satisfaction and Their Implications for Patient Care, Health Systems and Health Policy. RAND Corporation, 2013. PMC5051918 28083306
- [8]Hill RG Jr, Sears LM, & Melanson SW 4000 clicks: a productivity analysis of electronic medical records in a community hospital ED. Am J Emerg Med. 31, 1591– 1594 (2014). 24060331
- [11]Hribar MR, Read-Brown S, Goldstein IH, Reznick LG, Lombardi L, Parikh M, Chamberlain W, Chiang MF. Secondary Use of Electronic Health Record Data for Clinical Workflow Analysis. Journal of the American Medical Informatics Association. 25, 40– 46 (2018). 10.1093/jamia/ocx098 29036581 PMC6080808 · DOI
- [13]Lowe H J, Ferris TA, Hernandez M & Weber S C STRIDE—An integrated standards-based translational research informatics platform. AMIA Annu. Symp. Proc. 2009, 391– 5 (2009). 20351886 PMC2815452
Cited by
Sorted by citations
Moy, A. J., Schwartz, J. M., Chen, R., Sadri, S., Lucas, E., Cato, K. D., & Rossetti, S. C. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa325 · Cited by 284 · see citing works
Interaction time with electronic health records: a systematic review
Pinevich, Y., Clark, K. J., Harrison, A. M., Pickering, B. W., & Herasevich, V. (2021) · Applied Clinical Informatics · doi:10.1055/s-0041-1733909 · Cited by 62 · see citing works
Chen, J., Cutrona, S. L., Dharod, A., Bunch, S. C., Foley, K. L., Ostasiewski, B., Hale, E. R., Bridges, A., Moses, A., Donny, E. C., et al. (2023) · JMIR Medical Informatics · doi:10.2196/43097 · Cited by 4 · see citing works
Self-citationChen, J., Cutrona, S. L., Dharod, A., Moses, A., Bridges, A., Ostasiewski, B., Foley, K. L., Houston, T. K., iDAPT (Implementation & Informatics Developing Adaptable Processes and Technologies for Cancer Control) Implementation Science Center for Cancer Control, Chen, J., et al. (2025) · JAMIA Open · doi:10.1093/jamiaopen/ooaf050 · Cited by 3 · see citing works
Self-citation
- Authors
- Wang, J. K., Ouyang, D., Hom, J., Chi, J., & Chen, J. H.
- Affiliations
- Stanford University (US)
- Stanford Medicine (US)
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2019-02-06
- Volume
- 14
- Issue
- 2
- Pages
- e0205379
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC6364867
- OpenAlex
- W2912878510
- Cited by
- 63
- References
- 3
- Citations by year
- 2026: 6 · 2025: 5 · 2024: 4 · 2023: 9 · 2022: 9 · 2021: 9 · 2020: 15 · 2019: 5
- FWCI
- 10.37
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Institutes of Health
- National Institute of Environmental Health Sciences (K01ES026837)
- National Center for Research Resources (UL1RR025744)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Emergency Medicine › Hospital Admissions and Outcomes
- Health Sciences › Nursing › Issues, ethics and legal aspects › Nursing Diagnosis and Documentation
- Keywords
- electronic health records, internal medicine residents, physician burnout, event logs
- MeSH terms
- Academic Medical Centers, Humans, Inpatients, Internal Medicine, Internship and Residency, Practice Patterns, Physicians', Physicians, Time Factors, Photoperiod, Electronic Health Records, Tertiary Care Centers
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review