Ambient artificial intelligence scribes: utilization and impact on documentation time
Open accessThe DOI matches its Crossref record; 21 of the 22 references it cites were found in a registry or an index; 5 of the 13 sources its claims cite were checked for support.
Abstract
To quantify utilization and impact on documentation time of a large language model-powered ambient artificial intelligence (AI) scribe. This prospective quality improvement study was conducted at a large academic medical center with 45 physicians from 8 ambulatory disciplines over 3 months. Utilization and documentation times were derived from electronic health record (EHR) use measures. The ambient AI scribe was utilized in 9629 of 17 428 encounters (55.25%) with significant interuser heterogeneity. Compared to baseline, median time per note reduced significantly by 0.57 minutes. Median daily documentation, afterhours, and total EHR time also decreased significantly by 6.89, 5.17, and 19.95 minutes/day, respectively. An early pilot of an ambient AI scribe demonstrated robust utilization and reduced time spent on documentation and in the EHR. There was notable individual-level heterogeneity. Large language model-powered ambient AI scribes may reduce documentation burden. Further studies are needed to identify which users benefit most from current technology and how future iterations can support a broader audience.
Overview
CoChat Summary
TL;DR
This prospective quality improvement study evaluated a large language model-powered ambient AI scribe (DAX Copilot) among 45 physicians across 8 ambulatory specialties over 3 months. The scribe was used in 55.25% of encounters and was associated with significant reductions in median documentation time per note and daily EHR time, with notable interuser heterogeneity.
Key findings
- DAX Copilot was utilized in 9629 of 17 428 encounters (55.25%); median physician-level utilization was 52.5% (IQR 17.86%–80.97%). HPI and A&P SmartSections had higher median utilization (39.7% and 14.8%) than Results and PE SmartSections (2.6% and 1.6%).
- Median time per note decreased by 0.57 minutes (IQR −1.3 to −0.13; T-statistic −5.19, P<.001). Median user average time per note fell from 4.86 minutes prepilot (IQR 2.89–6.47) to 3.64 minutes during the pilot (IQR 2.45–5.46).
- Median daily documentation time decreased by 6.89 minutes/day (IQR −22.37 to −0.65; T-statistic −4.48, P<.001). Median daily afterhours EHR time decreased by 5.17 minutes/day (IQR −21.32 to 3.82; T-statistic −2.65, P=.01), and median daily total EHR time decreased by 19.95 minutes/day (IQR −39.34 to −3.64; T-statistic −5.85, P<.001).
- There was significant interuser heterogeneity: some physicians used DAX for almost all encounters, others had minimal utilization, and a small number spent more time per note compared to baseline.
Methods
- Prospective quality improvement study at a single academic medical center (Stanford Health Care) with 45 physicians from 8 ambulatory disciplines. The pilot ran October 2023–January 2024, with a 2-month baseline prepilot period from May 28, 2023 to July 29, 2023.
- DAX Copilot was integrated with Epic; the mobile app recorded physician-patient interactions, and an LLM generated drafts of HPI, PE, Results, and A&P SmartSections for insertion into existing note templates. Exclusions included existing scribe support, working exclusively with trainees, lacking an iPhone, non-English patient preferred language, and low-utility license relinquishment.
- Utilization and documentation times were derived from Epic Signal EHR use measures. Average note time and daily documentation, afterhours, and total EHR time were weighted per physician and compared between prepilot and pilot periods using one-sample t-tests against a null of no change; analysis used Python 3.11.4 with statsmodels.
Limitations
- The paper states: small sample size, volunteer and selection bias, potential secular trends, inability to analyze time outcomes at the level of individual patient encounters, lack of comparison to alternate strategies, English-speaking patients only, and predominance of primary care physicians.
- The paper also states that EHR use measures have known limitations; afterhours and total EHR time were calculated per calendar day without normalization to encounter volume, potentially underestimating impact, and the 5-second inactivity timer likely underestimates total documentation time and the absolute magnitude of change.
- Evident from the text: this was a single-center, non-randomized pilot with convenience and purposive sampling, a 50-license limit, rolling onboarding, and a short 3-month evaluation period, which limits causal inference and generalizability.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 0 Not valid · 1 Not checked · 32 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Electronic health record (EHR) documentation burden is a significant contributor to physician burnout.[1][2][3][4][5][6][7][8]”
§ Ambient artificial intelligence scribes: utilization and impact on documentation time > Background and significance
What the sources say
- Not checked — no full text of the sourcecites [1] Shanafelt, 2016, Relationship between clerical burden and characteristics of the electronic environment with physician burnout and professional satisfaction, Mayo Clin Proc. source
- Not checked — no full text of the sourcecites [2] Gardner, 2019, Physician stress and burnout: the impact of health information technology, J Am Med Inform Assoc. source
- Supportedcites [3] Apathy, 2023, Documentation dynamics: note composition, burden, and physician efficiency, Health Serv Res. source
The paper’s “What is known on this topic” section explicitly calls EHR-derived burden a major driver of physician burnout, especially burden associated with clinical documentation. The Introduction also describes evidence linking greater EHR burden with emotional exhaustion. (LLM, conf=0.94)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The ambient AI scribe was utilized in 9629 of 17 428 encounters (55.25%) with significant interuser heterogeneity.”
- Also stated in: § Utilization · plain
“Of the 17 428 encounters in the analysis period, DAX Copilot was utilized for 9629 encounters (55.25%).”
§ Ambient artificial intelligence scribes: utilization and impact on documentation time > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Utilization · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“with significant interuser heterogeneity.”
- Also stated in: § Utilization · plain
“There was significant interuser heterogeneity in utilization, with some physicians utilizing DAX for almost all encounters and others having minimal utilization (Figure 1 and Table S3).”
§ Ambient artificial intelligence scribes: utilization and impact on documentation time > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Utilization · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Median daily documentation, afterhours, and total EHR time also decreased significantly by 6.89, 5.17, and 19.95 minutes/day, respectively.”
- Also stated in: § EHR time · plain
“identified a median decrease of -6.89 minutes (IQR -22.37 to -0.65), which was also statistically significant (T-statistic -4.48, P<.001).”
§ Ambient artificial intelligence scribes: utilization and impact on documentation time > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Also stated in: § EHR time · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Median daily documentation, afterhours, and total EHR time also decreased significantly by 6.89, 5.17, and 19.95 minutes/day, respectively.”
- Also stated in: § EHR time · plain
“There were also statistically significant decreases in daily afterhours EHR time (T-statistic -2.65, P ¼ .01)and daily total EHR time (T-statistic -5.85, P<.001) with median changes of -5.17 minutes (IQR -21.32 to 3.82) and -19.95 minutes (IQR -39.34 to -3.64), respectively (Figure 3B and C, and Tables S6 and S7).”
§ Ambient artificial intelligence scribes: utilization and impact on documentation time > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Also stated in: § EHR time · plain
17 more claims
Create a free account to see all 37 claims and to verify the 2 references still open.
- Probably not a substantial claim. 8
- It may state two separate claims as one. 8
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Recent studies have suggested that ADS implementation may reduce documentation burden, enhance provider wellbeing, and improve patient satisfaction.4, 5, 6, 7, 8”
From Evaluating the Quality and Safety of Ambient Digital Scribe Platforms Using Simulated Ambulatory Encounters (2025) · cites this paper as [5]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Previous studies evaluating ADS performance have predominantly focused on postimplementation effects, with recent studies demonstrating beneficial impact on documentation efficiency and wellbeing.4, 5, 6, 7, 8,22, 23, 24”
From Evaluating the Quality and Safety of Ambient Digital Scribe Platforms Using Simulated Ambulatory Encounters (2025) · cites this paper as [5]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Although these tools have reported potential for improving documentation efficiency and physician wellbeing, their impact on patient safety remains unknown.”
From Evaluating the Quality and Safety of Ambient Digital Scribe Platforms Using Simulated Ambulatory Encounters (2025) · cites this paper as [5]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To date, fully autonomous, EHR-integrated scribes have been used primarily in the ambulatory outpatient setting, with improvements in physician task load, burnout, and usability [10-12].”
From Clinician Perspectives on Ambient AI Scribes in the Intensive Care Unit: Qualitative Interview Study (2026) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While prior work has explored the impact of this technology on patient-provider interactions primarily in ambulatory settings”
From Clinician Perspectives on Ambient AI Scribes in the Intensive Care Unit: Qualitative Interview Study (2026) · cites this paper as [10]
Experimental — accuracy not yet measured
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Ambient artificial intelligence scribes: utilization and impact on documentation time > Study recruitment
“Physicians were recruited through convenience and purposive sampling based on interest and suspected documentation burden between August 2023 and December 2024.”
§ Ambient artificial intelligence scribes: utilization and impact on documentation time > Setting
“The intervention was piloted during a 3-month period from October 2023 to January 2024 in ambulatory settings at a single academic medical center (Stanford Health Care).”
Citations
Cites
Shanafelt, T. D., Dyrbye, L. N., Sinsky, C., Hasan, O., Satele, D., Sloan, J., & West, C. P. (2016) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2016.05.007 · Cited by 1,086
Self-citationArndt, B. G., Beasley, J. W., Watkinson, M. D., Temte, J. L., Tuan, W.-J., Sinsky, C. A., & Gilchrist, V. J. (2017) · The Annals of Family Medicine · doi:10.1370/afm.2121 · Cited by 972
Physician stress and burnout: the impact of health information technology
Gardner, R. L., Cooper, E., Haskell, J., Harris, D. A., Poplau, S., Kroth, P. J., & Linzer, M. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy145 · Cited by 566
Ambient artificial intelligence scribes to alleviate the burden of clinical documentation.
Tierney, A. A., Gayre, G., Hoberman, B., Mattern, B., Ballesca, M., Kipnis, P., Liu, V., & Lee, K. (2024) · NEJM Catalyst · doi:10.1056/cat.23.0404 · Cited by 400
The influence of electronic health record use on physician burnout: cross-sectional survey
Tajirian, T., Stergiopoulos, V., Strudwick, G., Sequeira, L., Sanches, M., Kemp, J., Ramamoorthi, K., Zhang, T., & Jankowicz, D. (2020) · Journal of Medical Internet Research · doi:10.2196/19274 · Cited by 241
Gidwani, R., Nguyen, C., Kofoed, A., Carragee, C., Rydel, T., Nelligan, I., Sattler, A., Mahoney, M., & Lin, S. (2017) · The Annals of Family Medicine · doi:10.1370/afm.2122 · Cited by 202
Self-citationWill Generative Artificial Intelligence Deliver on Its Promise in Health Care?
Wachter, R. M., & Brynjolfsson, E. (2024) · JAMA · doi:10.1001/jama.2023.25054 · Cited by 185
The impact of nuance DAX ambient listening AI documentation: a cohort study.
Haberle, T., Cleveland, C., Snow, G. L., Barber, C., Stookey, N., Thornock, C., Younger, L., Mullahkhel, B., & Ize-Ludlow, D. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae022 · Cited by 171
A systematic review of speech recognition technology in health care
Johnson, M., Lapkin, S., Long, V., Sanchez, P., Suominen, H., Basilakis, J., & Dawson, L. (2014) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-14-94 · Cited by 141
Medical Documentation Burden Among US Office-Based Physicians in 2019: A National Study
Gaffney, A., Woolhandler, S., Cai, C., Bor, D., Himmelstein, J., McCormick, D., & Himmelstein, D. U. (2022) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2022.0372 · Cited by 118
Cited by
Use of ambient AI scribes to reduce administrative burden and professional burnout
Olson, K. D., Meeker, D., Troup, M., Barker, T. D., Nguyen, V. H., Manders, J. B., Stults, C. D., Jones, V. G., Shah, S. D., Shah, T., et al. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2025.34976 · Cited by 243
Self-citationPhysician Perspectives on Ambient AI Scribes
Shah, S., Crowell, T., Jeong, Y., Devon-Sand, A., Smith, M. A., Yang, B., Ma, S. P., Liang, A. S., Delahaie, C., Hsia, C., et al. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2025.1904 · Cited by 184
Self-citationPoon, E. G., Lemak, C. H., Rojas, J. C., Guptill, J., & Classen, D. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaf065 · Cited by 143
Ambient AI Scribes in Clinical Practice: A Randomized Trial
Lukac, P. J., Turner, W. B., Vangala, S., Chin, A. T., Khalili, J., Shih, Y. T., Sarkisian, C. A., Cheng, E. M., & Mafi, J. N. (2025) · NEJM AI · doi:10.1056/aioa2501000 · Cited by 210
Ng, J. J. W., Wang, E., Zhou, X., Zhou, K. X., Goh, C. X. L., Sim, G.-H., Tan, H. K., Goh, S. S. N., & Ng, Q. X. (2025) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-025-03061-0 · Cited by 132
Metadata
- Authors
- Ma, S. P., Liang, A. S., Shah, S. J., Smith, M., Jeong, Y., Devon-Sand, A., Crowell, T., Delahaie, C., Hsia, C., Lin, S., Shanafelt, T., Pfeffer, M. A., Sharp, C., & Garcia, P.
- Affiliations
- Stanford Medicine (US)
- Stanford Health Care (US)
- Department of Medicine, Stanford University School of Medicine , Stanford, CA 94305,
- Corresponding author
- Ma, Stephen P
- Liang, April S
- ORCID
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2024-12-17
- Volume
- 32
- Issue
- 2
- Pages
- 381-385
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC11756633
- OpenAlex
- W4405499002
- Cited by
- 155
- References
- 22
- Citations by year
- 2026: 99 · 2025: 56
- FWCI
- 47.13
- Type
- journal article
- Language
- en
- Open access
- green
- pmc.ncbi.nlm.nih.gov
- Locations
- Journal of the American Medical Informatics Association (publishedVersion)
- PubMed Central (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Nursing › Research and Theory › Nursing Diagnosis and Documentation
- Keywords
- ambient AI scribes, large language models, electronic health records, documentation burden, physician time use, outpatient care
- MeSH terms
- Academic Medical Centers, Artificial Intelligence, Documentation, Humans, Prospective Studies, Time Factors, Electronic Health Records, Quality Improvement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Ambient artificial intelligence scribes: utilization and impact on documentation time. https://app.cochat.ai/papers/10.1093/jamia/ocae304
- The paper
- Ma, S. P., Liang, A. S., Shah, S. J., Smith, M., Jeong, Y., Devon-Sand, A., Crowell, T., Delahaie, C., Hsia, C., Lin, S., Shanafelt, T., Pfeffer, M. A., Sharp, C., & Garcia, P. (2025). Ambient artificial intelligence scribes: utilization and impact on documentation time. Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocae304
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.