Physician electronic health record usage as affected by the COVID-19 pandemic
Open accessAbstract
Objectives To utilize metrics from physician action logs to analyze volume, physician efficiency and burden as impacted by telemedicine implementation during the COVID-19 (coronavirus disease 2019) pandemic, and physician characteristics such as gender, years since graduation, and specialty category. Methods We selected 11 metrics from Epic Signal, a functionality of the Epic electronic health record (EHR). Metrics measuring time spent in the EHR outside working hours were used as a correlate for burden. We performed an analysis of these metrics among active physicians at our institution across three time periods—prepandemic and telehealth implementation (August 2019), postimplementation of telehealth (May 2020), and follow-up (July 2020)—and correlated them with physician characteristics. Results Analysis of 495 physicians showed that after the start of the pandemic, physicians overall had fewer appointments per day, higher same day visit closure rates, and spent less time writing notes in the EHR outside 7 a.m. to 7 p.m. on patient scheduled days. Across all three time periods, male physicians had better EHR-defined “efficiency” measures and spent less time in the EHR outside working hours. Years since graduation only had modest associations with higher same day visit closure rates and appointments per day in May 2020. Specialty category was significantly associated with appointments per day and same day closure visit rates and also was a significant factor in the observed changes seen across the three time periods. Conclusion Utilizing EHR-generated reports may provide a scalable and nonintrusive way to monitor trends in physician usage and experience to help guide health systems in increasing productivity and reducing burnout.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Woolson, R. F. (2008) · Wiley Encyclopedia of Clinical Trials · doi:10.1002/9780471462422.eoct979 · Cited by 925 · see citing works
Bishara, A. J., & Hittner, J. B. (2012) · Psychological Methods · doi:10.1037/a0028087 · Cited by 766 · see citing works
Physician stress and burnout: the impact of health information technology
Gardner, R. L., Cooper, E., Haskell, J., Harris, D. A., Poplau, S., Kroth, P. J., & Linzer, M. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy145 · Cited by 566 · see citing works
Trends in Outpatient Care Delivery and Telemedicine During the COVID-19 Pandemic in the US
Patel, S. Y., Mehrotra, A., Huskamp, H. A., Uscher‐Pines, L., Ganguli, I., & Barnett, M. L. (2020) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2020.5928 · Cited by 553 · see citing works
The psychological impact of the COVID-19 outbreak on health professionals: A cross-sectional study
Giusti, E. M., Pedroli, E., D'Aniello, G. E., Stramba Badiale, C., Pietrabissa, G., Manna, C., Stramba Badiale, M., Riva, G., Castelnuovo, G., & Molinari, E. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.01684 · Cited by 533 · see citing works
Wu, Y., Wang, J., Luo, C.-G., Hu, S., Lin, X., Anderson, A. E., Bruera, E., Yang, X.-X., Wei, S., & Qian, Y. (2020) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2020.04.008 · Cited by 530 · see citing works
Shanafelt, T. D., West, C. P., Sinsky, C. A., Trockel, M., Tutty, M., Wang, H., Carlasare, L. E., & Dyrbye, L. N. (2022) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2021.11.021 · Cited by 456 · see citing works
Koh, D., Lim, M. K., Chia, S. E., Ko, S. M., Qian, F., Ng, V., Tan, B. H., Wong, K. S., Chew, W. M., Tang, H. K., et al. (2005) · Medical Care · doi:10.1097/01.mlr.0000167181.36730.cc · Cited by 454 · see citing works
Adler‐Milstein, J., Zhao, W., Willard‐Grace, R., Knox, M. J., & Grumbach, K. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz220 · Cited by 363 · see citing works
Biostatistics series module 3: Comparing groups: Numerical variables
Hazra, A., & Gogtay, N. (2016) · Indian Journal of Dermatology · doi:10.4103/0019-5154.182416 · Cited by 354 · see citing works
The impact of COVID-19 on physician burnout globally: a review
Amanullah, S., & Ramesh Shankar, R. (2020) · Healthcare · doi:10.3390/healthcare8040421 · Cited by 276 · see citing works
Robertson, S. L., Robinson, M. D., & Reid, A. (2017) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-16-00123.1 · Cited by 170 · see citing works
Physician Burnout in Primary Care during the COVID-19 Pandemic: A Cross-Sectional Study in Portugal
Baptista, S., Teixeira, A., Castro, L., Cunha, M., Serrão, C., Rodrigues, A. M., & Duarte, I. (2021) · Journal of Primary Care & Community Health · doi:10.1177/21501327211008437 · Cited by 109 · see citing works
Effects of the COVID-19 Pandemic on Outpatient Providers in the United States
Chatterji, P., & Li, Y. (2020) · Medical Care · doi:10.1097/mlr.0000000000001448 · Cited by 101 · see citing works
Nath, B., Williams, B., Jeffery, M. M., O’Connell, R. T., Goldstein, R. L., Sinsky, C. A., & Melnick, E. R. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.31490 · Cited by 100 · see citing works
Eschenroeder, H. C., Manzione, L. C., Adler‐Milstein, J., Bice, C., Cash, R., Duda, C., Joseph, C., Lee, J. S., Maneker, A., Poterack, K. A., et al. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab053 · Cited by 90 · see citing works
McPeek-Hinz, E., Boazak, M., Sexton, J. B., Adair, K. C., West, V., Goldstein, B. A., Alphin, R. S., Idris, S., Hammond, W. E., Hwang, S. E., et al. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.5686 · Cited by 80 · cited 1× · see citing works
“25 – 27 However, our multivariate analyses found that gender was only a signi fi cant factor in PEP score and years since graduation was only an independent predictor in appointments in May 2020 and PEP scores.”
Melnick, E. R., Ong, S. Y., Fong, A., Socrates, V., Ratwani, R. M., Nath, B., Simonov, M., Salgia, A. D. T., Williams, B., Marchalik, D., et al. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab011 · Cited by 67 · see citing works
Preliminary Report: US Physician Stress During the Early Days of the COVID-19 Pandemic
Linzer, M., Stillman, M. J., Brown, R. B., Taylor, S., Nankivil, N., Poplau, S., Goelz, E., Sinsky, C. A., Barbouche, M., Buhr, C., et al. (2021) · Mayo Clinic Proceedings Innovations Quality & Outcomes · doi:10.1016/j.mayocpiqo.2021.01.005 · Cited by 54 · see citing works
Williams, D. C., Warren, R. W., Ebeling, M. D., Andrews, A. L., & Teufel, R. J. (2018) · JMIR Medical Informatics · doi:10.2196/10949 · Cited by 37 · see citing works
Watts, K. L., & Abraham, N. (2020) · The Journal of Urology · doi:10.1097/ju.0000000000001185 · Cited by 26 · see citing works
Beiser, M., Lu, V., Paul, S., Ni, J., Nazar, N., Epstein, E., Mammen, A., Short, J., Tomer, Y., & Jariwala, S. P. (2021) · Telemedicine and e-Health · doi:10.1089/tmj.2020.0490 · Cited by 15 · see citing works
Self-citationKhairat, S., Zalla, L. C., Gartland-Gray, A., & Seashore, C. J. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.689646 · Cited by 15 · see citing works
Department-focused electronic health record thrive training
Livingston, K., & Bovi, J. A. (2022) · JAMIA Open · doi:10.1093/jamiaopen/ooac025 · Cited by 13 · see citing works
Hollister-Meadows, L., Richesson, R., Gagne, J. C. D., & Rawlins, N. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa333 · Cited by 11 · see citing works
Moore, C. E., Valenti, A., Robinson, E. J., & Perkins, R. M. (2021) · Applied Clinical Informatics · doi:10.1055/s-0041-1731679 · Cited by 8 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- Kaufman M. Telehealth visits dip as New Yorkers return to doctors' offices. Crain's New York Business. May 11, 2021. Accessed July 9, 2021 at: https://www.crainsnewyork.- com/health-care/telehealth-visits-dip-new-yorkers-return-doc- tors-offices Applied Clinical Informatics Vol. 13 No. 4/2022 © 2022. Thieme. All rights reserved. Physician EHR Usage as Affected by COVID-19 Ruan et al. 793
Cited by
Sorted by citations
Electronic Health Record Usage Patterns Across Surgical Subspecialties
Tang, K., Labagnara, K., Babar, M., Loloi, J., Watts, K. L., Jariwala, S., & Abraham, N. (2024) · Applied Clinical Informatics · doi:10.1055/a-2194-1061 · Cited by 7 · see citing works
Self-citation
- Authors
- Ruan, E., Beiser, M., Lu, V., Paul, S., Ni, J., Nazar, N., Liu, J., Kim, M., Epstein, E., Keller, M., Kitsis, E., Tomer, Y., & Jariwala, S. P.
- Affiliations
- Albert Einstein College of Medicine (US)
- ORCID
- Venue
- Applied Clinical Informatics
- Publisher
- Georg Thieme Verlag KG
- Published
- 2022-06-15
- Volume
- 13
- Issue
- 04
- Pages
- 785-793
- ISSN
- 1869-0327 (ISSN-L)
- PMC
- PMC9411035
- OpenAlex
- W4282981078
- Cited by
- 15
- References
- 26
- Citations by year
- 2026: 3 · 2025: 3 · 2024: 2 · 2023: 6 · 2022: 1
- FWCI
- 2.25
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Applied Clinical Informatics (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Healthcare Systems and Technology
- Keywords
- COVID-19 pandemic, telemedicine, electronic health records, physician efficiency, physician burden, physician burnout, physician productivity, physician specialty, gender differences
- MeSH terms
- COVID-19, Burnout, Professional, Humans, Male, Physicians, Electronic Health Records, Pandemics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
