The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Does AI-powered clinical documentation enhance clinician efficiency: a longitudinal study.
Abstract
BACKGROUND: Nuance's Dragon Ambient eXperience (DAX) Copilot is an artificial intelligence (AI)-driven ambient clinical documentation software platform. Atrium Health, a large multisite academic learning health system, was the first to use DAX Copilot. This study evaluates outcomes for participating clinicians after DAX implementation. METHODS: In this longitudinal study, 112 primary care clinicians using DAX were recruited between June and August 2023 along with a control group of 103 clinicians from similar practices not using DAX. Primary outcomes of electronic health record (EHR) use and financial impact were assessed over 180 days using linear mixed models. Within the DAX group were two subgroups: active users (who transferred ≥25% of DAX notes) and high users (who transferred ≥60% of DAX notes). We performed exploratory analyses to compare the control group with DAX subgroups, in addition to subgroup analyses stratified by patient volume and clinician specialty. RESULTS: After controlling for length of intervention, age, gender, provider type, years of practice, and baseline outcome, we did not find statistical significance in the primary analyses of EHR and financial metrics. Exploratory analyses suggested that small decreases in documentation hours could result from high DAX usage (means ratio [MR] 0.93, 95% confidence interval [CI] 0.88 to 0.98) and from implementing DAX with low-volume clinicians (MR 0.91, 95% CI 0.83 to 0.99) and with family medicine clinicians (MR 0.91, 95% CI 0.85 to 0.98). CONCLUSIONS: AI-powered ambient clinical documentation software has been promoted as a promising strategy to alleviate the documentation burden faced by outpatient clinicians. However, our findings suggest that the tool did not make clinicians as a group more efficient. Future studies can further investigate the utility of DAX for clinician subgroups and alternative implementations with improved clinical adoption. (Funded by Wake Forest University Health Sciences; ClinicalTrials.gov number, NCT06329427.).
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“another study12 did not find significant differences for time in notes or work time outside of work.”
From Evaluation of an Ambient Artificial Intelligence Documentation Platform for Clinicians (2025) · cites this paper as [12]
In the citing paper
“However, the association of ambient AI with EHR metrics has been mixed, with 1 study finding that use of ambient AI was associated with reductions in time spent in notes during appointments but no difference in off-hour EHR activities (5:30 PM to 7:00 AM on weekdays and nonscheduled weekends and holidays)11 while another study12 did not find significant differences for time in notes or work time”
From Evaluation of an Ambient Artificial Intelligence Documentation Platform for Clinicians (2025) · cites this paper as [12]
In the citing paper
“To date, studies of ambient AI have shown varied results for the association with time in notes, off-hour EHR activities, and after-hours work.7,11,12”
From Evaluation of an Ambient Artificial Intelligence Documentation Platform for Clinicians (2025) · cites this paper as [12]
Citations
Cites
Lambert, S. I., Madi, M., Sopka, S., Lenes, A., Stange, H., Buszello, C.-P., & Stephan, A. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00852-5 · Cited by 404
Ambient artificial intelligence scribes to alleviate the burden of clinical documentation.
Tierney, A. A., Gayre, G., Hoberman, B., Mattern, B., Ballesca, M., Kipnis, P., Liu, V., & Lee, K. (2024) · NEJM Catalyst · doi:10.1056/cat.23.0404 · Cited by 400
Artificial Intelligence–Generated Draft Replies to Patient Inbox Messages
Garcia, P., Ma, S. P., Shah, S., Smith, M., Jeong, Y., Devon-Sand, A., Tai-Seale, M., Takazawa, K., Clutter, D., Vogt, K., et al. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.3201 · Cited by 266
The rise of artificial intelligence and the uncertain future for physicians
Krittanawong, C. (2018) · European Journal of Internal Medicine · doi:10.1016/j.ejim.2017.06.017 · Cited by 205
The impact of nuance DAX ambient listening AI documentation: a cohort study.
Haberle, T., Cleveland, C., Snow, G. L., Barber, C., Stookey, N., Thornock, C., Younger, L., Mullahkhel, B., & Ize-Ludlow, D. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae022 · Cited by 171
Metrics for assessing physician activity using electronic health record log data
Sinsky, C. A., Rule, A., Cohen, G., Arndt, B. G., Shanafelt, T. D., Sharp, C. D., Baxter, S. L., Tai-Seale, M., Yan, S., Chen, Y., et al. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz223 · Cited by 162
Kocaballi, A. B., Ijaz, K., Laranjo, L., Quiroz, J. C., Rezazadegan, D., Tong, H. L., Willcock, S., Berkovsky, S., & Coiera, E. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa131 · Cited by 112
Liu, T., Hetherington, T. C., Stephens, C., McWilliams, A. D., Dharod, A., Carroll, T., & Cleveland, J. A. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.32460 · Cited by 102
Self-citationDigital scribe utility and barriers to implementation in clinical practice: a scoping review
Ghatnekar, S., Faletsky, A., & Nambudiri, V. E. (2021) · Health and Technology · doi:10.1007/s12553-021-00568-0 · Cited by 78
Can the administrative loads of physicians be alleviated by AI-facilitated clinical documentation?
Bundy, H., Gerhart, J., Baek, S., Connor, C. D., Isreal, M., Dharod, A., Stephens, C., Liu, T.-L., Hetherington, T., & Cleveland, J. (2024) · Journal of General Internal Medicine · doi:10.1007/s11606-024-08870-z · Cited by 78
Self-citationYim, W.-W., Fu, Y., Ben Abacha, A., Snider, N., Lin, T., & Yetisgen, M. (2023) · Scientific Data · doi:10.1038/s41597-023-02487-3 · Cited by 64
A patient-centered digital scribe for automatic medical documentation
Wang, J., Lavender, M., Hoque, M. E., Brophy, P. D., & Kautz, H. (2021) · JAMIA Open · doi:10.1093/jamiaopen/ooab003 · Cited by 55
Factors governing the adoption of artificial intelligence in healthcare providers
Davenport, T. H., & GLASER, J. P. (2022) · Discover Health Systems · doi:10.1007/s44250-022-00004-8 · Cited by 42
Interventions to Reduce Electronic Health Record-Related Burnout: A Systematic Review
Kang, C., & Sarkar, I. N. (2023) · Applied Clinical Informatics · doi:10.1055/a-2203-3787 · Cited by 41
Scoping review: Positive and negative impact of technology on clinicians
McBride, S. G., Alexander, G. L., Baernholdt, M., Vugrin, M., & Epstein, B. (2023) · Nursing Outlook · doi:10.1016/j.outlook.2023.101918 · Cited by 28
Research works printed but not linked: 4
- Peterson J, Culver E, Piatti G, et al. How University of Michigan Health-West improved clinician wellbeing: reducing documentation and cognitive burden with Nuance’s Dragon Ambient eXperience (DAX). Advisory Board, 2023:1-22.
- Brown H, Prescott R. Repeated Measures Data. In: Senn S and Barnett V, eds. Applied mixed models in medicine. 2nd ed. Edinburgh, UK: Wiley, 2006:215-270.
- Riyahi AM. The use of artificial intelligence for assisting dentist in writing chart notes. Int J Med Dent 2023;27:546-548.
- American Medical Association. AMA Augmented Intelligence Research: Physician sentiments around the use of AI in health care: motivations, opportunities, risks, and use cases. Chicago, IL: American Medical Association, 2023:27. Accessed April 2, 2024.
Cited by
Duggan, M. J., Gervase, J., Schoenbaum, A., Hanson, W., Howell, J. T., Sheinberg, M., & Johnson, K. B. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.60637 · Cited by 249
Use of ambient AI scribes to reduce administrative burden and professional burnout
Olson, K. D., Meeker, D., Troup, M., Barker, T. D., Nguyen, V. H., Manders, J. B., Stults, C. D., Jones, V. G., Shah, S. D., Shah, T., et al. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2025.34976 · Cited by 243
AI, Health, and Health Care Today and Tomorrow: The JAMA Summit Report on Artificial Intelligence
Angus, D. C., Khera, R., Lieu, T., Liu, V., Ahmad, F. S., Anderson, B., Bhavani, S. V., Bindman, A., Brennan, T., Celi, L. A., et al. (2025) · JAMA · doi:10.1001/jama.2025.18490 · Cited by 195
Physician Perspectives on Ambient AI Scribes
Shah, S., Crowell, T., Jeong, Y., Devon-Sand, A., Smith, M. A., Yang, B., Ma, S. P., Liang, A. S., Delahaie, C., Hsia, C., et al. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2025.1904 · Cited by 184
Ambient AI Scribes in Clinical Practice: A Randomized Trial
Lukac, P. J., Turner, W. B., Vangala, S., Chin, A. T., Khalili, J., Shih, Y. T., Sarkisian, C. A., Cheng, E. M., & Mafi, J. N. (2025) · NEJM AI · doi:10.1056/aioa2501000 · Cited by 208
Metadata
- Authors
- Liu, T.-L., Hetherington, T. C., Dharod, A., Carroll, T., Bundy, R., Nguyen, H., Bundy, H. E., Isreal, M., McWilliams, A., & Cleveland, J. A.
- Affiliations
- Center for Health System Sciences, Atrium Health, Charlotte, NC
- Wake Forest University Health Sciences (US)
- Atrium Health Wake Forest Baptist (US)
- Advanced Analytics, Atrium Health, Charlotte, NC
- Department of Pediatrics, Atrium Health, Charlotte, NC
- ORCID
- Venue
- NEJM AI
- Publisher
- Massachusetts Medical Society
- Published
- 2024-11-27
- Volume
- 1
- Issue
- 12
- Pages
- AIoa2400659-AIoa2400659
- ISSN
- 2836-9386 (ISSN-L)
- OpenAlex
- W4404637131
- Cited by
- 65
- References
- 15
- Citations by year
- 2026: 26 · 2025: 39
- FWCI
- 19.86
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- NEJM AI (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Nursing › Research and Theory › Nursing Diagnosis and Documentation
- Keywords
- artificial intelligence, clinical documentation, electronic health records, clinical workflow, longitudinal outcomes
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.