Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.

Does AI-powered clinical documentation enhance clinician efficiency: a longitudinal study.

Abstract

BACKGROUND: Nuance's Dragon Ambient eXperience (DAX) Copilot is an artificial intelligence (AI)-driven ambient clinical documentation software platform. Atrium Health, a large multisite academic learning health system, was the first to use DAX Copilot. This study evaluates outcomes for participating clinicians after DAX implementation. METHODS: In this longitudinal study, 112 primary care clinicians using DAX were recruited between June and August 2023 along with a control group of 103 clinicians from similar practices not using DAX. Primary outcomes of electronic health record (EHR) use and financial impact were assessed over 180 days using linear mixed models. Within the DAX group were two subgroups: active users (who transferred ≥25% of DAX notes) and high users (who transferred ≥60% of DAX notes). We performed exploratory analyses to compare the control group with DAX subgroups, in addition to subgroup analyses stratified by patient volume and clinician specialty. RESULTS: After controlling for length of intervention, age, gender, provider type, years of practice, and baseline outcome, we did not find statistical significance in the primary analyses of EHR and financial metrics. Exploratory analyses suggested that small decreases in documentation hours could result from high DAX usage (means ratio [MR] 0.93, 95% confidence interval [CI] 0.88 to 0.98) and from implementing DAX with low-volume clinicians (MR 0.91, 95% CI 0.83 to 0.99) and with family medicine clinicians (MR 0.91, 95% CI 0.85 to 0.98). CONCLUSIONS: AI-powered ambient clinical documentation software has been promoted as a promising strategy to alleviate the documentation burden faced by outpatient clinicians. However, our findings suggest that the tool did not make clinicians as a group more efficient. Future studies can further investigate the utility of DAX for clinician subgroups and alternative implementations with improved clinical adoption. (Funded by Wake Forest University Health Sciences; ClinicalTrials.gov number, NCT06329427.).

Overview

Integrity signals

Registry

Crossref · 10.1056/aioa2400659

Cites

15 of 15 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Research works printed but not linked: 4

  1. Peterson J, Culver E, Piatti G, et al. How University of Michigan Health-West improved clinician wellbeing: reducing documentation and cognitive burden with Nuance’s Dragon Ambient eXperience (DAX). Advisory Board, 2023:1-22.
  2. Brown H, Prescott R. Repeated Measures Data. In: Senn S and Barnett V, eds. Applied mixed models in medicine. 2nd ed. Edinburgh, UK: Wiley, 2006:215-270.
  3. Riyahi AM. The use of artificial intelligence for assisting dentist in writing chart notes. Int J Med Dent 2023;27:546-548.
  4. American Medical Association. AMA Augmented Intelligence Research: Physician sentiments around the use of AI in health care: motivations, opportunities, risks, and use cases. Chicago, IL: American Medical Association, 2023:27. Accessed April 2, 2024.

Cited by

See all 70

Metadata

Authors
Liu, T.-L., Hetherington, T. C., Dharod, A., Carroll, T., Bundy, R., Nguyen, H., Bundy, H. E., Isreal, M., McWilliams, A., & Cleveland, J. A.
Affiliations
  • Center for Health System Sciences, Atrium Health, Charlotte, NC
  • Wake Forest University Health Sciences (US)
  • Atrium Health Wake Forest Baptist (US)
  • Advanced Analytics, Atrium Health, Charlotte, NC
  • Department of Pediatrics, Atrium Health, Charlotte, NC
Venue
NEJM AI
Published
2024-11-27
Volume
1
Issue
12
Pages
AIoa2400659-AIoa2400659
ISSN
2836-9386 (ISSN-L)
OpenAlex
W4404637131
Cited by
65
References
15
Citations by year
2026: 26 · 2025: 39
FWCI
19.86
Type
journal article
Language
en
Open access
closed
Locations
  • NEJM AI (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Health Sciences › Nursing › Research and Theory › Nursing Diagnosis and Documentation
Keywords
artificial intelligence, clinical documentation, electronic health records, clinical workflow, longitudinal outcomes

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.