CoChat

Effect of an Electronic Health Record-Based Intervention on Documentation Practices

Open access

The DOI matches its Crossref record; 28 of the 33 references it cites were found in a registry or an index; 12 of the 17 sources its claims cite were checked for support.

Abstract

Abstract Background Documentation burden is one of the largest contributors to physician burnout. Evaluation and Management (E&M) coding changes were implemented in 2021 to alleviate documentation burden. Objectives We used this opportunity to develop documentation best practices, implement new electronic health record (EHR) tools, and study the potential impact on provider experiences with documentation related to these 2021 E&M changes, documentation length, and time spent documenting at an academic medical center. Methods Five actionable best practices, developed through a consensus-driven, multidisciplinary approach in November 2020, led to the creation of two new ambulatory note templates, one for E&M visits (implemented in January 2021) and another for preventative visits (implemented in May 2021). As part of a quality-improvement initiative at nine faculty primary care clinics, surveys were developed utilizing a 5-point Likert scale to assess provider perceptions and deidentified EHR metadata (Signal, Epic Systems) were analyzed to measure changes in EHR use metrics between a pre-E&M changes timeframe (August 2020–December 2020) and a post-E&M change timeframe (August 2021–December 2021). A subgroup analysis was conducted comparing EHR use metrics among note template utilizers versus nonutilizers. Any provider who used one of the note templates at least once was categorized as a utilizer. Results Between January 2021 and December 2021, the adoption of the E&M visit template was 31,480 instances among 120 unique ambulatory providers, and adoption of the preventative visit template was 1,464 instances among 22 unique ambulatory providers. Survey response rate among faculty primary care providers was 82% (88/107): 55% (48/88) believed the 2021 E&M changes provided an opportunity to reduce documentation burden, and 28% reported favorable satisfaction with time spent documenting. Among providers who reported using one or both of the new note templates, 81% (35/43) of survey respondents reported favorable satisfaction with new note templates. EHR use metric analyses revealed a small, yet significant reduction in time in notes per appointment (p = 0.004) with no significant change in documentation length of notes (p = 0.45). Note template utilization was associated with a statistically significant reduction in documentation length (p = 0.034). Conclusion This study shows modest progress in improving EHR use measures of documentation length and time spent documenting following the 2021 E&M changes, but without great improvement in perceived documentation burden. Additional tools are needed to reduce documentation burden and further research is needed to understand the impact of these interventions.

Overview

CoChat Summary

TL;DR

This quality-improvement study at an academic medical center developed documentation best practices and two new Epic note templates in response to the 2021 E&M coding changes, then assessed provider perceptions and EHR use metrics. It found a small but significant reduction in time in notes per appointment and no significant change in note length overall, with template utilization associated with reduced note length, but little improvement in perceived documentation burden.

Key findings

  • Organization-wide adoption between January and December 2021 reached 31,480 instances of the E&M visit template among 120 unique providers and 1,464 instances of the preventative visit template among 22 unique providers.
  • Survey response rate among faculty primary care providers was 82% (88/107); 55% (48/88) believed the 2021 E&M changes provided an opportunity to reduce documentation burden, and 28% (25/88) reported satisfaction with time spent documenting. Among template users, 81% (35/43) reported favorable satisfaction with the E&M template and 89% (16/18) with the preventative template.
  • EHR use metrics (64 providers in final analysis) showed a small but significant reduction in time in notes per appointment (−0.84 minutes, 7.8%, p = 0.004) and no significant change in documentation length (−54.24 characters, p = 0.4476).
  • Subgroup analysis found template utilization was significantly associated with reduced documentation length (utilizers −274.026 vs. nonutilizers +69.057 characters, p = 0.0337), but not with time per appointment (p = 0.4726).

Methods

  • A 22-member multidisciplinary workgroup (14 providers from primary care, gastroenterology, and dermatology) met roughly weekly from October 2020 to May 2021 and developed five documentation best practices and five structural design principles; two note templates were built in Epic, implemented in January 2021 (E&M) and May 2021 (preventative), alongside a level-of-service calculator update, encounter summary updates, and voluntary multimodal training.
  • A four-question, 5-point Likert survey was emailed in December 2021 to all 107 providers in the academic primary care division (nonanonymized, voluntary response sampling); completion was defined as any response to one or more questions, and items were scored as proportions per response category.
  • Deidentified EHR metadata (Signal, Epic Systems) were analyzed for faculty primary care providers comparing pre-E&M (August–December 2020) and post-E&M (August–December 2021) timeframes using a one-sample t-test, with a utilizer-vs-nonutilizer subgroup analysis using Welch's two-sample t-test; α = 0.05, analyses in R.

Limitations

  • Stated by the paper: the study focused on primary care, while subspecialties also experience documentation burden and impacts likely vary; surveys were nonanonymized and lacked formal criterion and construct validation; no analysis compared training module completers versus noncompleters; the utilization measure missed providers who copied and edited templates into personal versions; the two templates were implemented at different times (January vs. May), likely affecting utilization; and EHR metadata have known limitations, especially for time-based approximations, in a natural experiment without randomized design.
  • Evident from the text: the survey was distributed only to primary care faculty, so perception findings may not generalize to the broader organization-wide adopter population; the small magnitude of the significant time reduction (−0.84 minutes) limits its practical significance.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1055/a-2367-8564

Cites

28 of 28 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

10 Valid · 0 Not valid · 1 Not checked · 45 Own results and interpretations

24 more claims

Create a free account to see all 56 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 24
  • It may state two separate claims as one. 6

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

3 of 3

Citations

Cites

Show all 28 references

Cited by

See all 4

Metadata

Authors
Shah, S., Bedgood, M., Devon-Sand, A., Dolphin-Dempsey, C., Cherukuri, V., Weng, K., Lin, S., & Sharp, C.
Affiliations
  • Stanford Medicine (US)
  • California Department of Health Care Services (US)
  • Stanford Health Care (US)
Corresponding author
Shah, Shreya
Venue
Applied Clinical Informatics
Published
2024-07-17
Volume
15
Issue
04
Pages
771-777
ISSN
1869-0327 (ISSN-L)
OpenAlex
W4400724463
Cited by
4
References
33
Citations by year
2026: 1 · 2025: 3
FWCI
1.22
Type
journal article
Language
en
Open access
Locations
  • Applied Clinical Informatics (publishedVersion)
  • PubMed Central (publishedVersion)
  • Europe PMC (PubMed Central) (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
  • Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
  • Health Sciences › Nursing › Research and Theory › Nursing Diagnosis and Documentation
Keywords
documentation burden, electronic health records, note templates, physician burnout, documentation practices, outpatient care, primary care, documentation time, quality improvement, provider satisfaction, academic medical centers, preventive visits, faculty physicians, Epic EHR
MeSH terms
Documentation, Humans, Electronic Health Records

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-09-30, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-09-30 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.