Real-World Evidence Synthesis of Digital Scribes Using Ambient Listening and Generative Artificial Intelligence for Clinician Documentation Workflows: Rapid Review
Open accessThe DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Abstract
Background: As physicians spend up to twice as much time on electronic health record tasks as on direct patient care, digital scribes have emerged as a promising solution to restore patient-clinician communication and reduce documentation burden—making it essential to study their real-world impact on clinical workflows, efficiency, and satisfaction. Objective: This study aimed to synthesize evidence on clinician efficiency, user satisfaction, quality, and practical barriers associated with the use of digital scribes using ambient listening and generative artificial intelligence (AI) in real-world clinical settings. Methods: A rapid review was conducted to evaluate the real-world evidence of digital scribes using ambient listening and generative AI in clinical practice from 2014 to 2024. Data were collected from Ovid MEDLINE, Embase, Web of Science–Core Collection, Cochrane CENTRAL and Reviews, and PubMed Central. Predefined eligibility criteria focused on studies addressing clinical implementation, excluding those centered solely on technical development or model validation. The findings of each study were synthesized and analyzed through the QUEST human evaluation framework for quality and safety and the Systems Engineering Initiative for Patient Safety (SEIPS) 3.0 model to assess integration into clinicians’ workflows and experience. Results: Of the 1450 studies identified, 6 met the inclusion criteria. These studies included an observational study, a case report, a peer-matched cohort study, and survey-based assessments conducted across academic health systems, community settings, and outpatient practices. The major themes noted were as follows: (1) they decreased self-reported documentation times, with associated increased length of notes; (2) physician burnout measured using standardized scales was unaffected, but physician engagement improved; (3) physician productivity, assessed via billing metrics, was unchanged; and (4) the studies fell short when compared to standardized frameworks. Conclusions: Digital scribes show promise in reducing documentation burden and enhancing clinician satisfaction, thereby supporting workflow efficiency. However, the currently available evidence is sparse. Future real-world, multifaceted studies are needed before AI scribes can be recommended unequivocally.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Most existing Ambient AI implementation playbooks have been developed for outpatient provider (Physician and Advanced Practice Provider) workflows, which are characterized by bounded clinical encounters, primarily narrative documentation, and relatively controlled acoustic environments [23].”
From Protocol for an EHR-embedded pragmatic randomized control trial of Ambient AI to Reduce Nursing Staff Documentation Time (2026) · cites this paper as [23]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Munn, Z., Peters, M. D. J., Stern, C., Tufanaru, C., McArthur, A., & Aromataris, E. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0611-x · Cited by 11,385 · cited 1×
“Compared to scoping reviews, which broadly map research areas, our rapid review focuses on synthesizing actionable evidence on the effectiveness of digital scribes [22].”
Arndt, B. G., Beasley, J. W., Watkinson, M. D., Temte, J. L., Tuan, W.-J., Sinsky, C. A., & Gilchrist, V. J. (2017) · The Annals of Family Medicine · doi:10.1370/afm.2121 · Cited by 972 · cited 2×
“This shift toward increased documentation and EHR-driven tasks, driven by billing, medicolegal, and regulatory requirements, has led to more time in front of the computer and strained the patient-physician relationship [1,3,4].”
Trends in the Adoption of Robotic Surgery for Common Surgical Procedures
Sheetz, K. H., Claflin, J., & Dimick, J. B. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.18911 · Cited by 926
Expediting systematic reviews: methods and implications of rapid reviews
Ganann, R., Ciliska, D., & Thomas, H. (2010) · Implementation Science · doi:10.1186/1748-5908-5-56 · Cited by 752
Ferguson, T., Olds, T., Curtis, R., Blake, H., Crozier, A. J., Dankiw, K., Dumuid, D., Kasai, D., O'Connor, E., Virgara, R., et al. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00111-x · Cited by 605 · cited 1×
“Similarly, wearable health monitors such as fitness trackers and smartwatches, initially praised for enhancing patient engagement, often produce data that are not clinically actionable and can contribute to patient anxiety, without clear evidence of improved health outcomes [17,18].”
SEIPS 3.0: human-centered design of the patient journey for patient safety
Carayon, P., Wooldridge, A., Hoonakker, P., Hundt, A. S., & Kelly, M. M. (2020) · Applied Ergonomics · doi:10.1016/j.apergo.2019.103033 · Cited by 493
Tam, T. Y. C., Sivarajkumar, S., Kapoor, S., Stolyar, A. V., Polanska, K., McCarthy, K. R., Osterhoudt, H., Wu, X., Visweswaran, S., Fu, S., et al. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01258-7 · Cited by 424 · cited 3×
“The data synthesis for this study was conducted using a structured thematic approach guided by the QUEST human evaluation framework [23], Systems Engineering Initiative for Patient Safety (SEIPS) 3.0 model [24,25], and a study by Abbasian et al [26].”
InfluentialAmbient artificial intelligence scribes to alleviate the burden of clinical documentation.
Tierney, A. A., Gayre, G., Hoberman, B., Mattern, B., Ballesca, M., Kipnis, P., Liu, V., & Lee, K. (2024) · NEJM Catalyst · doi:10.1056/cat.23.0404 · Cited by 400 · cited 10×
“A notable concern, albeit briefly discussed, was the potential for “hallucinations” [11] —where the AI may fabricate information, thereby altering the accuracy of medical documentation.”
InfluentialHealth information technology: fallacies and sober realities
Karsh, B.-T., Weinger, M. B., Abbott, P. A., & Wears, R. L. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2010.005637 · Cited by 365 · cited 1×
“Medicine and health IT are replete with examples of prematurely adopted technologies that failed to meet expectations [15].”
All in the Family: systematic reviews, rapid reviews, scoping reviews, realist reviews, and more
Moher, D., Stewart, L., & Shekelle, P. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0163-7 · Cited by 288
Cited by
Guo, Y., Hu, D., Yang, Z., Chow, E., Tam, S., Perret, D., Pandita, D., & Zheng, K. (2026) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocag059 · Cited by 21
What do clinicians edit in ambient AI-drafted clinical documentation? A qualitative content analysis
Guo, Y., Hu, D., Yang, Z., Kim, S., Tran, B. D., Lee, J., Vallabhaneni, S., Zehrung, R., Sutari, S., Tam, S., et al. (2026) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocag073 · Cited by 19
AI Scribes: Are We Measuring What Matters?
Coiera, E. W., & Navarro, D. F. (2026) · JMIR Medical Informatics · doi:10.2196/89337 · Cited by 12
Atiku, S. O., & Olakotan, O. O. (2026) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.70516 · Cited by 6
Wolfe, J., & Welsh, S. (2026) · Cureus · doi:10.7759/cureus.106643 · Cited by 5
Metadata
- Authors
- Kanaparthy, N. S., Villuendas-Rey, Y., Bakare, T., Diao, Z., Iscoe, M., Loza, A., Wright, D., Safranek, C., Faustino, I. V., Brackett, A., Melnick, E. R., & Taylor, R. A.
- Affiliations
- Yale University (US)
- Instituto Politécnico Nacional (MX)
- Corresponding author
- Kanaparthy, Naga Sasidhar
- ORCID
- Venue
- JMIR AI
- Publisher
- JMIR Publications Inc.
- Published
- 2025-10-10
- Volume
- 4
- Pages
- e76743-e76743
- ISSN
- 2817-1705 (ISSN-L)
- PMC
- PMC12513689
- OpenAlex
- W4414318138
- Cited by
- 57
- References
- 43
- Citations by year
- 2026: 56 · 2025: 1
- FWCI
- 7.30
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- JMIR AI (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Institutes of Health (UL1TR001863, KL2TR001862)
- National Heart, Lung, and Blood Institute (T35HL007649)
- National Center for Advancing Translational Sciences
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Nursing › Research and Theory › Nursing Diagnosis and Documentation
- Keywords
- generative AI, electronic health record documentation, clinical workflow efficiency, physician burnout, physician engagement, physician productivity, provider satisfaction, AI scribes
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
