Real-World Evidence Synthesis of Digital Scribes Using Ambient Listening and Generative Artificial Intelligence for Clinician Documentation Workflows: Rapid Review
Open accessThe DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Abstract
Background: As physicians spend up to twice as much time on electronic health record tasks as on direct patient care, digital scribes have emerged as a promising solution to restore patient-clinician communication and reduce documentation burden—making it essential to study their real-world impact on clinical workflows, efficiency, and satisfaction. Objective: This study aimed to synthesize evidence on clinician efficiency, user satisfaction, quality, and practical barriers associated with the use of digital scribes using ambient listening and generative artificial intelligence (AI) in real-world clinical settings. Methods: A rapid review was conducted to evaluate the real-world evidence of digital scribes using ambient listening and generative AI in clinical practice from 2014 to 2024. Data were collected from Ovid MEDLINE, Embase, Web of Science–Core Collection, Cochrane CENTRAL and Reviews, and PubMed Central. Predefined eligibility criteria focused on studies addressing clinical implementation, excluding those centered solely on technical development or model validation. The findings of each study were synthesized and analyzed through the QUEST human evaluation framework for quality and safety and the Systems Engineering Initiative for Patient Safety (SEIPS) 3.0 model to assess integration into clinicians’ workflows and experience. Results: Of the 1450 studies identified, 6 met the inclusion criteria. These studies included an observational study, a case report, a peer-matched cohort study, and survey-based assessments conducted across academic health systems, community settings, and outpatient practices. The major themes noted were as follows: (1) they decreased self-reported documentation times, with associated increased length of notes; (2) physician burnout measured using standardized scales was unaffected, but physician engagement improved; (3) physician productivity, assessed via billing metrics, was unchanged; and (4) the studies fell short when compared to standardized frameworks. Conclusions: Digital scribes show promise in reducing documentation burden and enhancing clinician satisfaction, thereby supporting workflow efficiency. However, the currently available evidence is sparse. Future real-world, multifaceted studies are needed before AI scribes can be recommended unequivocally.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Most existing Ambient AI implementation playbooks have been developed for outpatient provider (Physician and Advanced Practice Provider) workflows, which are characterized by bounded clinical encounters, primarily narrative documentation, and relatively controlled acoustic environments [23].”
From Protocol for an EHR-embedded pragmatic randomized control trial of Ambient AI to Reduce Nursing Staff Documentation Time (2026) · cites this paper as [23]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Munn, Z., Peters, M. D. J., Stern, C., Tufanaru, C., McArthur, A., & Aromataris, E. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0611-x · Cited by 11,385 · cited 1×
“Compared to scoping reviews, which broadly map research areas, our rapid review focuses on synthesizing actionable evidence on the effectiveness of digital scribes [22].”
Arndt, B. G., Beasley, J. W., Watkinson, M. D., Temte, J. L., Tuan, W.-J., Sinsky, C. A., & Gilchrist, V. J. (2017) · The Annals of Family Medicine · doi:10.1370/afm.2121 · Cited by 972 · cited 2×
“This shift toward increased documentation and EHR-driven tasks, driven by billing, medicolegal, and regulatory requirements, has led to more time in front of the computer and strained the patient-physician relationship [1,3,4].”
Trends in the Adoption of Robotic Surgery for Common Surgical Procedures
Sheetz, K. H., Claflin, J., & Dimick, J. B. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.18911 · Cited by 926
Expediting systematic reviews: methods and implications of rapid reviews
Ganann, R., Ciliska, D., & Thomas, H. (2010) · Implementation Science · doi:10.1186/1748-5908-5-56 · Cited by 752
Ferguson, T., Olds, T., Curtis, R., Blake, H., Crozier, A. J., Dankiw, K., Dumuid, D., Kasai, D., O'Connor, E., Virgara, R., et al. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00111-x · Cited by 605 · cited 1×
“Similarly, wearable health monitors such as fitness trackers and smartwatches, initially praised for enhancing patient engagement, often produce data that are not clinically actionable and can contribute to patient anxiety, without clear evidence of improved health outcomes [17,18].”
SEIPS 3.0: human-centered design of the patient journey for patient safety
Carayon, P., Wooldridge, A., Hoonakker, P., Hundt, A. S., & Kelly, M. M. (2020) · Applied Ergonomics · doi:10.1016/j.apergo.2019.103033 · Cited by 493
Tam, T. Y. C., Sivarajkumar, S., Kapoor, S., Stolyar, A. V., Polanska, K., McCarthy, K. R., Osterhoudt, H., Wu, X., Visweswaran, S., Fu, S., et al. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01258-7 · Cited by 424 · cited 3×
“The data synthesis for this study was conducted using a structured thematic approach guided by the QUEST human evaluation framework [23], Systems Engineering Initiative for Patient Safety (SEIPS) 3.0 model [24,25], and a study by Abbasian et al [26].”
InfluentialAmbient artificial intelligence scribes to alleviate the burden of clinical documentation.
Tierney, A. A., Gayre, G., Hoberman, B., Mattern, B., Ballesca, M., Kipnis, P., Liu, V., & Lee, K. (2024) · NEJM Catalyst · doi:10.1056/cat.23.0404 · Cited by 400 · cited 10×
“A notable concern, albeit briefly discussed, was the potential for “hallucinations” [11] —where the AI may fabricate information, thereby altering the accuracy of medical documentation.”
InfluentialHealth information technology: fallacies and sober realities
Karsh, B.-T., Weinger, M. B., Abbott, P. A., & Wears, R. L. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2010.005637 · Cited by 365 · cited 1×
“Medicine and health IT are replete with examples of prematurely adopted technologies that failed to meet expectations [15].”
All in the Family: systematic reviews, rapid reviews, scoping reviews, realist reviews, and more
Moher, D., Stewart, L., & Shekelle, P. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0163-7 · Cited by 288
Kuhn, T., Basch, P., Barr, M., Yackel, T., & for the Medical Informatics Committee of the American College of Physicians* (2015) · Annals of Internal Medicine · doi:10.7326/m14-2128 · Cited by 270
Duggan, M. J., Gervase, J., Schoenbaum, A., Hanson, W., Howell, J. T., Sheinberg, M., & Johnson, K. B. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.60637 · Cited by 249
Shah, S. J., Devon-Sand, A., Ma, S. P., Jeong, Y., Crowell, T., Smith, M., Liang, A. S., Delahaie, C., Hsia, C., Shanafelt, T., et al. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae295 · Cited by 224
Burnout Related to Electronic Health Record Use in Primary Care
Budd, J. (2023) · Journal of Primary Care & Community Health · doi:10.1177/21501319231166921 · Cited by 223
SEIPS 101 and seven simple SEIPS tools
Holden, R. J., & Carayon, P. (2021) · BMJ Quality & Safety · doi:10.1136/bmjqs-2020-012538 · Cited by 213
Foundation metrics for evaluating effectiveness of healthcare conversations powered by generative AI
Abbasian, M., Khatibi, E., Azimi, I., Oniani, D., Shakeri Hossein Abad, Z., Thieme, A., Sriram, R., Yang, Z., Wang, Y., Lin, B., et al. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01074-z · Cited by 213 · cited 7×
“Nguyen et al [33] Owens et al [34] Tierney et al [11] Health care evaluation metric groups from Abbasian et al [26] Accuracy Intrinsic, SSI a , robustness, generalization, conciseness, up-to-dateness, groundedness Framework, dimensions, and components Paper Nguyen et al [33] Owens et al [34]…”
InfluentialThe Influence of Wearables on Health Care Outcomes in Chronic Disease: Systematic Review
Mattison, G., Canfell, O., Forrester, D., Dobbins, C., Smith, D., Töyräs, J., & Sullivan, C. (2022) · Journal of Medical Internet Research · doi:10.2196/36690 · Cited by 171 · cited 1×
“Similarly, wearable health monitors such as fitness trackers and smartwatches, initially praised for enhancing patient engagement, often produce data that are not clinically actionable and can contribute to patient anxiety, without clear evidence of improved health outcomes [17,18].”
The impact of nuance DAX ambient listening AI documentation: a cohort study.
Haberle, T., Cleveland, C., Snow, G. L., Barber, C., Stookey, N., Thornock, C., Younger, L., Mullahkhel, B., & Ize-Ludlow, D. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae022 · Cited by 171 · cited 7×
“[32].”
InfluentialHigh Agreement and High Prevalence: The Paradox of Cohen’s Kappa
Zec, S., Soriani, N., Comoretto, R., & Baldi, I. (2017) · The Open Nursing Journal · doi:10.2174/1874434601711010211 · Cited by 169 · cited 1×
“Both metrics offer a reliable, comprehensive view of interrater reliability, aligning with our study’s emphasis on precision and consistency in data extraction [28,29].”
Challenges of developing a digital scribe to reduce clinical documentation burden
Quiroz, J. C., Laranjo, L., Kocaballi, A. B., Berkovsky, S., Rezazadegan, D., & Coiera, E. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0190-1 · Cited by 162 · cited 1×
“To address these challenges, health care has turned to digital tools promising to offload work burden, revive patient-clinician interactions, and reduce burnout [9].”
Ambient artificial intelligence scribes: utilization and impact on documentation time
Ma, S. P., Liang, A. S., Shah, S. J., Smith, M., Jeong, Y., Devon-Sand, A., Crowell, T., Delahaie, C., Hsia, C., Lin, S., et al. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae304 · Cited by 155
Joukes, E., Abu-Hanna, A., Cornet, R., & de Keizer, N. (2018) · Applied Clinical Informatics · doi:10.1055/s-0037-1615747 · Cited by 150
Evaluation of an Ambient Artificial Intelligence Documentation Platform for Clinicians
Stults, C. D., Deng, S., Martinez, M. C., Wilcox, J., Szwerinski, N., Chen, K. H., Driscoll, S., Washburn, J., & Jones, V. G. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2025.8614 · Cited by 147
Pavuluri, S., Sangal, R., Sather, J., & Taylor, R. A. (2024) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2024-101120 · Cited by 129
Self-citationKnox, M. J., Willard‐Grace, R., Huang, B., & Grumbach, K. (2018) · Journal of General Internal Medicine · doi:10.1007/s11606-018-4507-6 · Cited by 119
Documentation burden in nursing and its role in clinician burnout syndrome
Gesner, E., Dykes, P. C., Zhang, L., & Gazarian, P. (2022) · Applied Clinical Informatics · doi:10.1055/s-0042-1757157 · Cited by 118
Li, R., Kumar, A., & Chen, J. H. (2023) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2023.1835 · Cited by 104 · cited 1×
“…digital scribe technology, spurred on by recent advancements in automated speech recognition, increased computational power, and breakthroughs in the development of large language models, which underlie services such as ChatGPT, has enabled rapid advancements in automated documentation [10-12].”
Albrecht, M., Shanks, D., Shah, T., Hudson, T., Thompson, J., Filardi, T., Wright, K., Ator, G. A., & Smith, T. R. (2024) · JAMIA Open · doi:10.1093/jamiaopen/ooaf013 · Cited by 103
Liu, T.-L., Hetherington, T. C., Stephens, C., McWilliams, A., Dharod, A., Carroll, T., & Cleveland, J. A. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.32460 · Cited by 92
Pajama time: working after work in the electronic health record
Saag, H. S., Shah, K., Jones, S. A., Testa, P. A., & Horwitz, L. I. (2019) · Journal of General Internal Medicine · doi:10.1007/s11606-019-05055-x · Cited by 90 · cited 1×
““Pajama time,” wherein a physician works after scheduled hours to complete their clinical work, is a well-cited marker of physician burden [37].”
Owens, L. M., Wilda, J. J., Hahn, P. Y., Koehler, T., & Fletcher, J. J. (2024) · Family Practice · doi:10.1093/fampra/cmad092 · Cited by 86 · cited 7×
“In a pre-post study, among the 19 clinicians who used Dragon Ambient Experience (DAX) in >60% of their visits (“high users”), there was a reported 28.8% lower documentation time per encounter, translating to an average of 1.8 minutes per visit [34].”
InfluentialCao, D. Y., Silkey, J. R., Decker, M. C., & Wanat, K. A. (2024) · JAAD International · doi:10.1016/j.jdin.2024.02.009 · Cited by 74
Digital scribe utility and barriers to implementation in clinical practice: a scoping review
Ghatnekar, S., Faletsky, A., & Nambudiri, V. E. (2021) · Health and Technology · doi:10.1007/s12553-021-00568-0 · Cited by 72
Galloway, J. L., Munroe, D., Vohra-Khullar, P. D., Holland, C., Solis, M. A., Moore, M. A., & Dbouk, R. H. (2024) · Journal of General Internal Medicine · doi:10.1007/s11606-024-08924-2 · Cited by 56 · cited 7×
“While patient satisfaction metrics did not show significant differences, 1 study reported an improvement in patients’ perception of their experience [31].”
InfluentialA patient-centered digital scribe for automatic medical documentation
Wang, J., Lavender, M., Hoque, E., Brophy, P., & Kautz, H. (2021) · JAMIA Open · doi:10.1093/jamiaopen/ooab003 · Cited by 49
Nguyen, O. T., Turner, K. L., Charles, D., Sprow, O., Perkins, R. M., Hong, Y., Islam, J. Y., Khanna, N., Tabriz, A. A., Johnson, J. E. H., et al. (2023) · JCO Clinical Cancer Informatics · doi:10.1200/cci.22.00166 · Cited by 43
The Utility and Implications of Ambient Scribes in Primary Care
Seth, P., Carretas, R., & Rudzicz, F. (2024) · JMIR AI · doi:10.2196/57673 · Cited by 43
Tran, B. D., Mangu, R., Tai‐Seale, M., Lafata, J. E., & Zheng, K. (2022) · PubMed Central · Cited by 40
Tan, K. S., Yeh, Y., Adusumilli, P. S., & Travis, W. D. (2023) · JTO Clinical and Research Reports · doi:10.1016/j.jtocrr.2023.100618 · Cited by 34
Impact of Ambient Artificial Intelligence Documentation on Cognitive Load
Hudson, T., Albrecht, M., Smith, T. R., Ator, G. A., Thompson, J. A., Shah, T., & Shanks, D. (2025) · Mayo Clinic Proceedings Digital Health · doi:10.1016/j.mcpdig.2024.100193 · Cited by 26
Hudelson, C. E., Gunderson, M. A., Pestka, D., Christiaansen, T., Stotka, B., Kissock, L., Markowitz, R., Badlani, S., & Melton, G. B. (2024) · PubMed Central · Cited by 14
AutoScribe: Extracting Clinically Pertinent Information from Patient-Clinician Dialogues
Khan, K. F., Jeblee, S., Crampton, N. H., Mamdani, M., & Rudzicz, F. (2019) · Studies in health technology and informatics · doi:10.3233/shti190510 · Cited by 13
Albrecht, M., Shanks, D., Shah, T., Hudson, T., Thompson, J., Filardi, T., Wright, K., Ator, G., & Smith, T. R. (2024) · doi:10.1101/2024.08.12.24311883 · Cited by 11
Levy, D. R., Rossetti, S. C., Brandt, C., Melnick, E. R., Hamilton, A., Rinne, S. T., Womack, D. M., & Mohan, V. (2024) · Applied Clinical Informatics · doi:10.1055/a-2434-5177 · Cited by 10
Self-citation
Cited by
Guo, Y., Hu, D., Yang, Z., Chow, E., Tam, S., Perret, D., Pandita, D., & Zheng, K. (2026) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocag059 · Cited by 21
What do clinicians edit in ambient AI-drafted clinical documentation? A qualitative content analysis
Guo, Y., Hu, D., Yang, Z., Kim, S., Tran, B. D., Lee, J., Vallabhaneni, S., Zehrung, R., Sutari, S., Tam, S., et al. (2026) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocag073 · Cited by 19
AI Scribes: Are We Measuring What Matters?
Coiera, E. W., & Navarro, D. F. (2026) · JMIR Medical Informatics · doi:10.2196/89337 · Cited by 12
Atiku, S. O., & Olakotan, O. O. (2026) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.70516 · Cited by 6
Wolfe, J., & Welsh, S. (2026) · Cureus · doi:10.7759/cureus.106643 · Cited by 5
Metadata
- Authors
- Kanaparthy, N. S., Villuendas-Rey, Y., Bakare, T., Diao, Z., Iscoe, M., Loza, A., Wright, D., Safranek, C., Faustino, I. V., Brackett, A., Melnick, E. R., & Taylor, R. A.
- Affiliations
- Yale University (US)
- Instituto Politécnico Nacional (MX)
- Corresponding author
- Kanaparthy, Naga Sasidhar
- ORCID
- Venue
- JMIR AI
- Publisher
- JMIR Publications Inc.
- Published
- 2025-10-10
- Volume
- 4
- Pages
- e76743-e76743
- ISSN
- 2817-1705 (ISSN-L)
- PMC
- PMC12513689
- OpenAlex
- W4414318138
- Cited by
- 57
- References
- 43
- Citations by year
- 2026: 56 · 2025: 1
- FWCI
- 7.30
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- JMIR AI (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Institutes of Health (UL1TR001863, KL2TR001862)
- National Heart, Lung, and Blood Institute (T35HL007649)
- National Center for Advancing Translational Sciences
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Nursing › Research and Theory › Nursing Diagnosis and Documentation
- Keywords
- generative AI, electronic health record documentation, clinical workflow efficiency, physician burnout, physician engagement, physician productivity, provider satisfaction, AI scribes
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
