Using electronic health record audit log data for research: insights from early efforts
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Electronic health record audit logs capture a time-sequenced record of clinician activities while using the system. Audit log data therefore facilitate unobtrusive measurement at scale of clinical work activities and workflow as well as derivative, behavioral proxies (eg, teamwork). Given its considerable research potential, studies leveraging these data have burgeoned. As the field has matured, the challenges of using the data to answer significant research questions have come into focus. In this Perspective, we draw on our research experiences and insights from the broader audit log literature to advance audit log research. Specifically, we make 2 complementary recommendations that would facilitate substantial progress toward audit log-based measures that are: (1) transparent and validated, (2) standardized to allow for multisite studies, (3) sensitive to meaningful variability, (4) broader in scope to capture key aspects of clinical work including teamwork and coordination, and (5) linked to patient and clinical outcomes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Shanafelt, T. D., Dyrbye, L. N., Sinsky, C., Hasan, O., Satele, D., Sloan, J., & West, C. P. (2016) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2016.05.007 · Cited by 1,086
Arndt, B. G., Beasley, J. W., Watkinson, M. D., Temte, J. L., Tuan, W.-J., Sinsky, C. A., & Gilchrist, V. J. (2017) · The Annals of Family Medicine · doi:10.1370/afm.2121 · Cited by 972
Physician stress and burnout: the impact of health information technology
Gardner, R. L., Cooper, E., Haskell, J., Harris, D. A., Poplau, S., Kroth, P. J., & Linzer, M. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy145 · Cited by 566
Electronic medical records and physician stress in primary care: results from the MEMO Study
Babbott, S., Manwell, L. B., Brown, R., Montague, E., Williams, E., Schwartz, M., Hess, E., & Linzer, M. (2014) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-001875 · Cited by 366
The impact of electronic health record systems on clinical documentation times: a systematic review
Baumann, L. A., Baker, J., & Elshaug, A. G. (2018) · Health Policy · doi:10.1016/j.healthpol.2018.05.014 · Cited by 320
Metrics for assessing physician activity using electronic health record log data
Sinsky, C. A., Rule, A., Cohen, G., Arndt, B. G., Shanafelt, T. D., Sharp, C. D., Baxter, S. L., Tai-Seale, M., Yan, S., Chen, Y., et al. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz223 · Cited by 162
Self-citationRule, A., Chiang, M. F., & Hribar, M. R. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz196 · Cited by 136
Measuring Primary Care Exam Length Using Electronic Health Record Data
Neprash, H. T., Everhart, A., McAlpine, D., Smith, L. B., Sheridan, B., & Cross, D. A. (2021) · Medical Care · doi:10.1097/mlr.0000000000001450 · Cited by 79
Rule, A., Melnick, E. R., & Apathy, N. C. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac177 · Cited by 58
DiAngi, Y. T., Stevens, L. A., Halpern – Felsher, B., Pageler, N. M., & Lee, T. C. (2019) · JAMIA Open · doi:10.1093/jamiaopen/ooz003 · Cited by 52
Cited by
Rule, A., Melnick, E. R., & Apathy, N. C. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac177 · Cited by 58
Unlocking Inpatient Workload Insights with Electronic Health Record Event Logs
Burden, M., Keniston, A., Pell, J., Yu, A., Dyrbye, L., & Kannampallil, T. (2025) · Journal of Hospital Medicine · doi:10.1002/jhm.13386 · Cited by 19
Self-citationLevy, D. R., Moy, A. J., Apathy, N., Adler-Milstein, J., Rotenstein, L., Nath, B., Rosenbloom, S. T., Kannampallil, T., Mishuris, R. G., Alexanian, A., et al. (2023) · Applied Clinical Informatics · doi:10.1055/a-2187-3243 · Cited by 6
Self-citationChen, J., Cutrona, S. L., Dharod, A., Moses, A., Bridges, A., Ostasiewski, B., Foley, K. L., Houston, T. K., iDAPT (Implementation & Informatics Developing Adaptable Processes and Technologies for Cancer Control) Implementation Science Center for Cancer Control, Chen, J., et al. (2025) · JAMIA Open · doi:10.1093/jamiaopen/ooaf050 · Cited by 5
Metadata
- Authors
- Kannampallil, T., & Adler-Milstein, J.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2022-09-29
- Volume
- 30
- Issue
- 1
- Pages
- 167-171
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- OpenAlex
- W4297965388
- Cited by
- 49
- References
- 13
- FWCI
- 5.99
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using electronic health record audit log data for research: insights from early efforts. https://app.cochat.ai/papers/10.1093/jamia/ocac173
- The paper
- Kannampallil, T., & Adler-Milstein, J. (2022). Using electronic health record audit log data for research: insights from early efforts. Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocac173
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.