The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Identifying and Addressing Barriers to Implementing Core Electronic Health Record Use Metrics for Ambulatory Care: Virtual Consensus Conference Proceedings
Open accessAbstract
Precise, reliable, valid metrics that are cost-effective and require reasonable implementation time and effort are needed to drive electronic health record (EHR) improvements and decrease EHR burden. Differences exist between research and vendor definitions of metrics. Process We convened three stakeholder groups (health system informatics leaders, EHR vendor representatives, and researchers) in a virtual workshop series to achieve consensus on barriers, solutions, and next steps to implementing the core EHR use metrics in ambulatory care. Conclusion Actionable solutions identified to address core categories of EHR metric implementation challenges include: (1) maintaining broad stakeholder engagement, (2) reaching agreement on standardized measure definitions across vendors, (3) integrating clinician perspectives, and (4) addressing cognitive and EHR burden. Building upon the momentum of this workshop's outputs offers promise for overcoming barriers to implementing EHR use metrics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Delphi methodology in healthcare research: How to decide its appropriateness
Nasa, P., Jain, R., & Juneja, D. (2021) · World Journal of Methodology · doi:10.5662/wjm.v11.i4.116 · Cited by 1,821
Overhage, J. M., & McCallie, D. (2020) · Annals of Internal Medicine · doi:10.7326/m18-3684 · Cited by 238
Assessment of Electronic Health Record Use Between US and Non-US Health Systems
Holmgren, A. J., Downing, N. L., Bates, D. W., Shanafelt, T. D., Milstein, A. S., Sharp, C., Cutler, D., Huckman, R. S., & Schulman, K. A. (2020) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2020.7071 · Cited by 166
Metrics for assessing physician activity using electronic health record log data
Sinsky, C. A., Rule, A., Cohen, G., Arndt, B. G., Shanafelt, T. D., Sharp, C. D., Baxter, S. L., Tai-Seale, M., Yan, S., Chen, Y., et al. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz223 · Cited by 162
Self-citationBurnout and EHR use among academic primary care physicians with varied clinical workloads.
Tran, B. D., Lenhart, A., Ross, R., & Dorr, D. A. (2019) · PubMed · Cited by 77
Melnick, E. R., Ong, S. Y., Fong, A., Socrates, V., Ratwani, R. M., Nath, B., Simonov, M., Salgia, A. D. T., Williams, B., Marchalik, D., et al. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab011 · Cited by 69
Self-citationMeasures of electronic health record use in outpatient settings across vendors
Baxter, S. L., Apathy, N. C., Cross, D. A., Sinsky, C. A., & Hribar, M. R. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa266 · Cited by 61
Self-citationUsing electronic health record audit log data for research: insights from early efforts
Kannampallil, T., & Adler‐Milstein, J. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac173 · Cited by 59
Self-citationRule, A., Melnick, E. R., & Apathy, N. C. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac177 · Cited by 58
Self-citationMoy, A. J., Aaron, L., Cato, K., Schwartz, J., Elias, J. E., Trepp, R., & Rossetti, S. C. (2021) · Applied Clinical Informatics · doi:10.1055/s-0041-1736625 · Cited by 41
Self-citation25 × 5 Symposium to reduce documentation burden: report-out and call for action
Hobensack, M., Levy, D. R., Cato, K., Detmer, D. E., Johnson, K. B., Williamson, J., Murphy, J., Moy, A., Withall, J., Lee, R., et al. (2022) · Applied Clinical Informatics · doi:10.1055/s-0042-1746169 · Cited by 37
Self-citationImplementing Measurement Science for Electronic Health Record Use
Melnick, E. R., Sinsky, C. A., & Krumholz, H. M. (2021) · JAMA · doi:10.1001/jama.2021.5487 · Cited by 36
Self-citationSenathirajah, Y., Kaufman, D. R., Cato, K., Borycki, E. M., Fawcett, J. A., & Kushniruk, A. W. (2020) · JMIR Human Factors · doi:10.2196/18484 · Cited by 32
Melnick, E. R., Nielson, J. A., Finnell, J. T., Bullard, M. J., Cantrill, S. V., Cochrane, D. G., Halamka, J. D., Handler, J. A., Holroyd, B. R., Kamens, D. R., et al. (2010) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2010.03.006 · Cited by 20
Self-citationArndt, B. G., Micek, M. A., Rule, A., Shafer, C. M., Baltus, J. J., & Sinsky, C. A. (2023) · The Annals of Family Medicine · doi:10.1370/afm.2960 · Cited by 19
Self-citationMeasuring and Maximizing Undivided Attention in the Context of Electronic Health Records
Chen, Y., Adler‐Milstein, J., & Sinsky, C. A. (2022) · Applied Clinical Informatics · doi:10.1055/a-1892-1437 · Cited by 13
Self-citationReflections on the Documentation Burden Reduction AMIA Plenary Session through the Lens of 25 × 5
Levy, D. R., Sloss, E. A., Chartash, D., Corley, S. T., Mishuris, R. G., Rosenbloom, S. T., & Tiase, V. L. (2022) · Applied Clinical Informatics · doi:10.1055/a-1976-2052 · Cited by 13
Self-citation
Cited by
Effect of an Electronic Health Record-Based Intervention on Documentation Practices
Shah, S., Bedgood, M., Devon-Sand, A., Dolphin-Dempsey, C., Cherukuri, V., Weng, K., Lin, S., & Sharp, C. (2024) · Applied Clinical Informatics · doi:10.1055/a-2367-8564 · Cited by 4
Utete, E., & Mahlanganise, R. (2024) · Research Square · doi:10.21203/rs.3.rs-4351822/v1 · Cited by 3
Ahlness, E. A., & Levy, D. R. (2025) · Applied Clinical Informatics · doi:10.1055/a-2624-5482
Self-citationA Measurement Science Framework to Optimize CDS for Opioid Use Disorder Treatment in the ED
Iscoe, M. S., Hooper, C. D., Levy, D. R., Lutz, J., Paek, H., Rose, C. C., Kannampallil, T., Meeker, D., Dziura, J. D., & Melnick, E. R. (2025) · Applied Clinical Informatics · doi:10.1055/a-2595-0317
Self-citationEHRs, PHRs, and Patient Portals
Boren, S. (2026) · Health informatics · doi:10.1007/978-3-032-16657-9_9
Metadata
- Authors
- Levy, D. R., Moy, A. J., Apathy, N., Adler-Milstein, J., Rotenstein, L., Nath, B., Rosenbloom, S. T., Kannampallil, T., Mishuris, R. G., Alexanian, A., Sieja, A., Hribar, M. R., Patel, J. S., Sinsky, C. A., & Melnick, E. R.
- Affiliations
- Yale University (US)
- Columbia University (US)
- Regenstrief Institute (US)
- Department of Medicine, Center for Clinical Informatics and Improvement Research, University of California, San Francisco, California, United States
- Brigham and Women's Hospital (US)
- Vanderbilt University (US)
- Washington University in St. Louis (US)
- Novant Health (US)
- University of Colorado Anschutz (US)
- Oregon Health & Science University (US)
- Oracle (United States) (US)
- American Medical Association (US)
- Corresponding author
- Levy, Deborah R.
- ORCID
- Venue
- Applied Clinical Informatics
- Publisher
- Georg Thieme Verlag KG
- Published
- 2023-10
- Volume
- 14
- Issue
- 05
- Pages
- 944-950
- ISSN
- 1869-0327 (ISSN-L)
- PMC
- PMC10686750
- OpenAlex
- W4387395119
- Semantic Scholar
- 6062195fa2f8c20f64f4519648eb1a157ece255c
- Cited by
- 6
- References
- 17
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 2
- FWCI
- 1.35
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Applied Clinical Informatics (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Digital Commons@Becker (Washington University School of Medicine) (submittedVersion, cc-by-nc-nd)
- Funders
- Office of Academic Affiliations, Department of Veterans Affairs
- American Medical Association (American Medical Association Practice Transformati)
- U.S. Department of Veterans Affairs (CIN-13-407)
- National Institute on Drug Abuse (Funding to Dr. Melnick, unrelated to this work.)
- Agency for Healthcare Research and Quality (Funding to Dr. Melnick, unrelated to this work.)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Health Sciences › Nursing › Research and Theory › Nursing Diagnosis and Documentation
- Keywords
- outpatient care, stakeholder consensus, clinician perspectives, cognitive burden
- MeSH terms
- Ambulatory Care, Humans, Medical Informatics, Benchmarking, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
