Assessment of Electronic Health Record Use Between US and Non-US Health Systems
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Importance: Understanding how the electronic health record (EHR) system changes clinician work, productivity, and well-being is critical. Little is known regarding global variation in patterns of use. Objective: To provide insights into which EHR activities clinicians spend their time doing, the EHR tools they use, the system messages they receive, and the amount of time they spend using the EHR after hours. Design, Setting, and Participants: This cross-sectional study analyzed the deidentified metadata of ambulatory care health systems in the US, Canada, Northern Europe, Western Europe, the Middle East, and Oceania from January 1, 2019, to August 31, 2019. All of these organizations used the EHR software from Epic Systems and represented most of Epic Systems's ambulatory customer base. The sample included all clinicians with scheduled patient appointments, such as physicians and advanced practice practitioners. Exposures: Clinician EHR use was tracked by deidentified and aggregated metadata across a variety of clinical activities. Main Outcomes and Measures: Descriptive statistics for clinician EHR use included time spent on clinical activities, note documentation (as measured by the percentage of characters in the note generated by automated or manual data entry source), messages received, and time spent after hours. Results: A total of 371 health systems were included in the sample, of which 348 (93.8%) were located in the US and 23 (6.2%) were located in other countries. US clinicians spent more time per day actively using the EHR compared with non-US clinicians (mean time, 90.2 minutes vs 59.1 minutes; P < .001). In addition, US clinicians vs non-US clinicians spent significantly more time performing 4 clinical activities: notes (40.7 minutes vs 30.7 minutes; P < .001), orders (19.5 minutes vs 8.75 minutes; P < .001), in-basket messages (12.5 minutes vs 4.80 minutes; P < .001), and clinical review (17.6 minutes vs 14.8 minutes; P = .01). Clinicians in the US composed more automated note text than their non-US counterparts (77.5% vs 60.8% of note text; P < .001) and received statistically significantly more messages per day (33.8 vs 12.8; P < .001). Furthermore, US clinicians used the EHR for a longer time after hours, logging in 26.5 minutes per day vs 19.5 minutes per day for non-US clinicians (P = .01). The median US clinician spent as much time actively using the EHR per day (90.1 minutes) as a non-US clinician in the 99th percentile of active EHR use time per day (90.7 minutes) in the sample. These results persisted after controlling for organizational characteristics, including structure, type, size, and daily patient volume. Conclusions and Relevance: This study found that US clinicians compared with their non-US counterparts spent substantially more time actively using the EHR for a wide range of clinical activities or tasks. This finding suggests that US clinicians have a greater EHR burden that may be associated with nontechnical factors, which policy makers and health system leaders should consider when addressing clinician wellness.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Shanafelt, T. D., Hasan, O., Dyrbye, L. N., Sinsky, C., Satele, D., Sloan, J., & West, C. P. (2015) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2015.08.023 · Cited by 2,885
Self-citationPhysician burnout: contributors, consequences and solutions
West, C. P., Dyrbye, L. N., & Shanafelt, T. D. (2018) · Journal of Internal Medicine · doi:10.1111/joim.12752 · Cited by 2,768
Self-citationAllocation of Physician Time in Ambulatory Practice: A Time and Motion Study in 4 Specialties
Sinsky, C., Colligan, L., Li, L., Prgomet, M., Reynolds, S., Goeders, L., Westbrook, J., Tutty, M., & Blike, G. (2016) · Annals of Internal Medicine · doi:10.7326/m16-0961 · Cited by 1,494
Shanafelt, T. D., Dyrbye, L. N., Sinsky, C., Hasan, O., Satele, D., Sloan, J., & West, C. P. (2016) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2016.05.007 · Cited by 1,086
Self-citationThe business case for investing in physician well-being
Shanafelt, T., Goh, J., & Sinsky, C. (2017) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2017.4340 · Cited by 714
Self-citationwith the HITEC Investigators, Ancker, J. S., Edwards, A., Nosal, S., Hauser, D., Mauer, E., & Kaushal, R. (2017) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-017-0430-8 · Cited by 709
Physician stress and burnout: the impact of health information technology
Gardner, R. L., Cooper, E., Haskell, J., Harris, D. A., Poplau, S., Kroth, P. J., & Linzer, M. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy145 · Cited by 566
Physician Burnout in the Electronic Health Record Era: Are We Ignoring the Real Cause?
Downing, N. L., Bates, D. W., & Longhurst, C. A. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0139 · Cited by 418
Self-citationMelnick, E. R., Dyrbye, L. N., Sinsky, C. A., Trockel, M., West, C. P., Nedelec, L., Tutty, M. A., & Shanafelt, T. (2020) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2019.09.024 · Cited by 413
Self-citationElectronic health record adoption in US hospitals: the emergence of a digital “advanced use” divide
Adler-Milstein, J., Holmgren, A. J., Kralovec, P., Worzala, C., Searcy, T., & Patel, V. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx080 · Cited by 392
Self-citation
Cited by
Medical Documentation Burden Among US Office-Based Physicians in 2019: A National Study
Gaffney, A., Woolhandler, S., Cai, C., Bor, D., Himmelstein, J., McCormick, D., & Himmelstein, D. U. (2022) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2022.0372 · Cited by 118
Differences in total and after-hours electronic health record time across ambulatory specialties.
Rotenstein, L. S., Holmgren, A. J., Downing, N. L., & Bates, D. W. (2021) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2021.0256 · Cited by 101
Self-citationSeol, H. Y., Shrestha, P., Muth, J. F., Wi, C.-I., Sohn, S., Ryu, E., Park, M., Ihrke, K., Moon, S., King, K., et al. (2021) · PLOS ONE · doi:10.1371/journal.pone.0255261 · Cited by 82
Documentation dynamics: note composition, burden, and physician efficiency
Apathy, N. C., Rotenstein, L., Bates, D. W., & Holmgren, A. J. (2023) · Health Services Research · doi:10.1111/1475-6773.14097 · Cited by 70
Self-citationFindings and guidelines on provider technology, fatigue, and well-being: scoping review
Hilty, D. M., Armstrong, C. M., Smout, S. A., Crawford, A., Maheu, M. M., Drude, K. P., Chan, S., Yellowlees, P. M., & Krupinski, E. A. (2022) · Journal of Medical Internet Research · doi:10.2196/34451 · Cited by 65
Metadata
- Authors
- Holmgren, A. J., Downing, N. L., Bates, D. W., Shanafelt, T. D., Milstein, A., Sharp, C. D., Cutler, D. M., Huckman, R. S., & Schulman, K. A.
- Venue
- JAMA Internal Medicine
- Publisher
- American Medical Association (AMA)
- Published
- 2021-02-01
- Volume
- 181
- Issue
- 2
- Pages
- 251
- ISSN
- 2168-6106 (ISSN-L)
- OpenAlex
- W3113250099
- Cited by
- 157
- References
- 13
- FWCI
- 14.96
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Assessment of Electronic Health Record Use Between US and Non-US Health Systems. https://app.cochat.ai/papers/10.1001/jamainternmed.2020.7071
- The paper
- Holmgren, A. J., Downing, N. L., Bates, D. W., Shanafelt, T. D., Milstein, A., Sharp, C. D., Cutler, D. M., Huckman, R. S., & Schulman, K. A. (2021). Assessment of Electronic Health Record Use Between US and Non-US Health Systems. JAMA Internal Medicine. https://doi.org/10.1001/jamainternmed.2020.7071
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.