The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index; none of the 39 sources its claims cite is checked for support yet.
Challenges of developing a digital scribe to reduce clinical documentation burden
Open accessAbstract
Clinicians spend a large amount of time on clinical documentation of patient encounters, often impacting quality of care and clinician satisfaction, and causing physician burnout. Advances in artificial intelligence (AI) and machine learning (ML) open the possibility of automating clinical documentation with digital scribes, using speech recognition to eliminate manual documentation by clinicians or medical scribes. However, developing a digital scribe is fraught with problems due to the complex nature of clinical environments and clinical conversations. This paper identifies and discusses major challenges associated with developing automated speech-based documentation in clinical settings: recording high-quality audio, converting audio to transcripts using speech recognition, inducing topic structure from conversation data, extracting medical concepts, generating clinically meaningful summaries of conversations, and obtaining clinical data for AI and ML algorithms.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
This perspective paper identifies and discusses the major technical and data-related challenges to developing a "digital scribe" that automatically documents clinician–patient conversations using speech recognition and NLP. It argues that progress is best achieved by solving each pipeline challenge individually rather than pursuing a holistic solution.
Key findings
The paper is a challenge-identification piece rather than an empirical study, so it reports no primary outcomes of its own; its claims are framed around cited evidence and the authors' analysis.
- A cited study found word error rates of 35% or higher for simulated medical conversations using commercial ASR engines, and the authors note these were best-case results from controlled, near-ideal acoustic conditions.
- The authors enumerate challenges across five pipeline stages: audio recording/ASR, topic structuring, medical concept extraction, summarization, and data collection (summarized in Table 1).
- Existing tools such as MetaMap and cTAKES map text to UMLS concepts but were designed for written text; with default settings, "I am feeling fine" maps "I" to "blood group antibody I," "feeling" to "emotions," and "fine" to "qualitative concept" or "legal fine."
- One cited effort developed its own corpus of 3000 conversations annotated by medical scribes because no public corpus was available, described as a costly investment.
Methods
This is a conceptual/perspective review, not an empirical study; it identifies and discusses challenges via narrative synthesis of prior literature and a summary table (Table 1) mapping tasks to challenges. No dataset, sample, or statistical analysis is reported. The paper draws on cited prior work (e.g., ASR engine comparisons, diarization research, UMLS mapping tools) to illustrate each challenge.
Limitations
The paper does not present a formal limitations section; as a perspective piece it offers no empirical validation of the challenges it describes. The text makes evident that the challenges are largely illustrated through cited studies and hypothetical examples rather than systematic evidence, and the authors note that evaluation of digital scribes in clinical environments (quality of care, patient satisfaction, clinician efficiency, documentation time, organizational dynamics) remains to be conducted. The authors also state that collecting sufficient data at the scale needed for AI/ML could alone take years, and that the closed data-sharing environment slows progress.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
22 Not checked yet · 16 Own interpretation · 2 No basis given
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“However, UMLS was designed for written text, not for spoken medical conversations.”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Challenge 3: information extraction in clinical conversations
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“ASR produces a transcript of the clinician–patient conversation that lacks clear boundaries and structure due to the unconstrained nature of conversations.22”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Challenge 2: structuring clinician–patient conversations
What the sources say
- Not checked yetcites [22] Lacson, R. C., Barzilay, R. & Long, W. J. Automatic analysis of medical dialogue in the home hemodialysis domain: structure induction and summarization. J. Biomed. Inform. 39, 541–555 (2006). source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Spontaneous, conversational speech is not linguistically well-formed.21”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Challenge 1: audio recording and speech recognition
What the sources say
- Not checked yetcites [21] Xiong, W. et al. Toward human parity in conversational speech recognition. IEEE/ACM Trans. Audio Speech Lang. Proc. 25, 2410–2423 (2017). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“A recent study found that the word error rate of simulated medical conversations with commercial ASR engines was 35% or higher.17”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Challenge 1: audio recording and speech recognition
What the sources say
- Not checked yetcites [17] Kodish-Wachs, J., Agassi, E., Kenny, P. & Overhage, J. M. A systematic comparison of contemporary automatic speech recognition engines for conversational clinical speech. AMIA Annu. Symp. Proc. 2018, 683–689 (2018).
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Tools like MetaMap must also have their parameters tuned, as using them with default settings may result in the extraction of irrelevant terms.”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Challenge 3: information extraction in clinical conversations
What the sources say
- Not checked yetcites [29] Reátegui, R. & Ratté, S. Comparison of MetaMap and cTAKES for entity extraction in clinical notes. BMC Med. Inform. Decis. Mak. 18, 74 (2018). source
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“The position of the recording device also has a strong impact on the captured audio.18,20”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Challenge 1: audio recording and speech recognition
What the sources say
- Not checked yetcites [18] Vogel, A. P. & Morgan, A. T. Factors affecting the quality of sound recording for speech and voice analysis. Int. J. Speech-Lang. Pathol. 11, 431–437 (2009). source
- Not checked yetcites [20] Shafey, L. E., Soltau, H. & Shafran, I. Joint speech recognition and speaker diarization via sequence transduction. In Interspeech 2019, 396–400 (International Speech Communication Association, 2019). source
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Having multiple speakers participating in the conversation and differentiating them in the audio (speaker diarization) also adds a level of complexity and potential errors to ASR.7”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Challenge 1: audio recording and speech recognition
What the sources say
- Not checked yetcites [7] Finley, G. et al. An automated medical scribe for documenting clinical encounters. In Proc. 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations, 11–15 (Association for Computational Linguistics, 2018). source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“After conversion from speech to text, NLP techniques that perform well on grammatically correct sentences break down with conversational speech because of the lack of punctuation and sentence boundaries, grammatical differences between spoken and written language, and lack of structure.7,24,25”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Challenge 1: audio recording and speech recognition
What the sources say
- Not checked yetcites [7] Finley, G. et al. An automated medical scribe for documenting clinical encounters. In Proc. 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations, 11–15 (Association for Computational Linguistics, 2018). source
- Not checked yetcites [24] Kahn, J. G., Lease, M., Charniak, E., Johnson, M. & Ostendorf, M. Effective use of prosody in parsing conversational speech. In Proc. Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing, 233–240 (Association for Computational Linguistics, 2005). source
- Not checked yetcites [25] Jamshid Lou, P., Wang, Y. & Johnson, M. Neural constituency parsing of speech transcripts. In Proc. 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Vol. 1 (Long and Short Papers), 2756–2765 (Association for Computational Linguistics, 2019). source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Research on machine comprehension of written passages cannot be directly transferred to spoken conversations due to common phenomena in spontaneous speech, such as zero anaphora (using an expression whose interpretation depends upon a prior expression), thinking aloud, and topic drift.14”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Challenge 3: information extraction in clinical conversations
What the sources say
- Not checked yetcites [14] Liu, Z. et al. Fast prototyping a dialogue comprehension system for nurse-patient conversations on symptom monitoring. In Proc. 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Vol. 2 (Industry Papers), 24–31 (Association for Computational Linguistics, 2019).
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Knowing the current topic or medical activity during a consultation reduces the complexity of information extraction and summarization.”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Challenge 2: structuring clinician–patient conversations
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
- Probably not a substantial claim. 17
- It may state two separate claims as one. 11
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“To generate medical notes for the clinician–patient encounter, a digital scribe must be able to: (1) record the clinician–patient conversation, (2) convert the audio to text, and (3) extract salient information from the text and summarize the information (Fig. 1).”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Introduction
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Recently, advances in AI, machine learning (ML), NLP, natural language understanding, and automatic speech recognition (ASR), have raised the prospect of deploying effective and reliable digital scribes in clinical practice.”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Introduction
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“However, clinical encounters do not necessarily follow a linear order of their components,27,28 which exacerbates summarization or information extraction.22”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Challenge 2: structuring clinician–patient conversations
What the sources say
- Not checked yetcites [27] Waitzkin, H. A critical theory of medical discourse: ideology, social control, and the processing of social context in medical encounters. J. Health Soc. Behav. 30, 220–239 (1989). source
- Not checked yetcites [28] Kocaballi, A. B. et al. A network model of activities in primary care consultations. J. Am. Med. Inform. Assoc. 26, 1074–1082 (2019). source
- Not checked yetcites [22] Lacson, R. C., Barzilay, R. & Long, W. J. Automatic analysis of medical dialogue in the home hemodialysis domain: structure induction and summarization. J. Biomed. Inform. 39, 541–555 (2006). source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Medical conversations have different statistical properties than medical dictations, meaning that ASR trained with dictations is likely to underperform with medical conversations.7”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Challenge 1: audio recording and speech recognition
What the sources say
- Not checked yetcites [7] Finley, G. et al. An automated medical scribe for documenting clinical encounters. In Proc. 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations, 11–15 (Association for Computational Linguistics, 2018). source
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“High-quality audio minimizes errors across the processing pipeline of the digital scribe.”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Challenge 1: audio recording and speech recognition
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Clinical documentation is found to be associated with clinician burnout,1 increased cognitive load,2 information loss,3 and distractions.4”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Introduction
What the sources say
- Not checked yetcites [1] Friedberg, M. W. et al. Factors affecting physician professional satisfaction and their implications for patient care, health systems, and health policy. RAND Health Q. 3, 1 (2014).
- Not checked yetcites [2] Wachter, R. & Goldsmith, J. To combat physician burnout and improve care, fix the electronic health record. Harvard Bus. Rev. (2018) https://hbr.org/2018/03/to-combat-physician-burnout-and-improve-care-fix-the-electronic-health-record#comment-section.
- Not checked yetcites [3] Shachak, A., Hadas-Dayagi, M., Ziv, A. & Reis, S. Primary care physicians’ use of an electronic medical record system: a cognitive task analysis. J. Gen. Intern. Med. 24, 341–348 (2009). source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, developing a digital scribe is fraught with problems due to the complex nature of clinical environments and clinical conversations.”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Abstract
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Any digital scribe solution that requires ongoing input and supervision throughout the consultation will (1) distract clinicians from patients and (2) replace the distractions and disruptions of using an EHR with those of a digital scribe.”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Discussion: clinical practice implications
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“To generate effective medical notes, the summarization may need to draw on medical knowledge and capture nonverbal information during a consultation.”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Challenge 4: conversation summarization
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
In the paper
“The main concern raised is that manual documentation allows clinicians to structure their thoughts, think critically, reflect, and practice medicine effectively, such that removing it would adversely affect the way clinicians practice medicine.9”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Discussion: clinical practice implications
What the sources say
- Not checked yetcites [9] Willis, M. & Jarrahi, M. H. Automating documentation: a critical perspective into the role of artificial intelligence in clinical documentation. In Information in Contemporary Society (eds Taylor, N. G., Christian-Lamb, C., Martin, M. H. & Nardi, B.) 200–209 (Springer International Publishing, 2019). source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
In the paper
“In general, digital scribe research is hindered by (1) limited well-annotated large-scale data for modeling human–human spoken dialogs and (2) even scarcer conversation data in healthcare due to privacy issues.14”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Challenge 5: lack of clinical data
What the sources say
- Not checked yetcites [14] Liu, Z. et al. Fast prototyping a dialogue comprehension system for nurse-patient conversations on symptom monitoring. In Proc. 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Vol. 2 (Industry Papers), 24–31 (Association for Computational Linguistics, 2019).
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“However, obtaining the gold standard summary of each conversation is costly because of the medical expertize required to complete the task14 and the high variability in clinician notes’ content, style, organization, and quality.36”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Challenge 4: conversation summarization
What the sources say
- Not checked yetcites [14] Liu, Z. et al. Fast prototyping a dialogue comprehension system for nurse-patient conversations on symptom monitoring. In Proc. 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Vol. 2 (Industry Papers), 24–31 (Association for Computational Linguistics, 2019).
- Not checked yetcites [36] Edwards, S. T., Neri, P. M., Volk, L. A., Schiff, G. D. & Bates, D. W. Association of note quality and quality of care: a cross-sectional study. BMJ Qual. Saf. 23, 406–413 (2014). source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A dataset of medical conversations along with the corresponding summaries would allow far-reaching advances in the digital scribe and clinical documentation space.”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Challenge 5: lack of clinical data
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
None of the sources cited for this claim have been checked yet.
In the paper
“In addition, conversations do not fit a command-like structure, which makes it difficult to perform intent recognition—identifying a user’s intent from an utterance31—and to apply NLP techniques.19”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Challenge 3: information extraction in clinical conversations
What the sources say
- Not checked yetcites [31] Bhargava, A., Celikyilmaz, A., Hakkani-Tur, D. & Sarikaya, R. Easy contextual intent prediction and slot detection. In 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, 8337–8341 (IEEE, 2013). source
- Not checked yetcites [19] Ram, A. et al. Conversational AI: the science behind the Alexa prize. Preprint at arXiv:1801.03604 [cs] (2018).
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The currently closed environment for sharing sensitive data means that the few research teams with access to data are the only ones that can make advances, further slowing progress by impeding open science.”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Conclusion
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Rather than replacement of clinicians as depicted in many dystopic AI futures, the goal of digital scribes is the formation of a “human–AI symbiosis” that augments the clinician–patient experience and improves quality of care.6,8,9”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Discussion: clinical practice implications
What the sources say
- Not checked yetcites [6] Lin, S. Y., Shanafelt, T. D. & Asch, S. M. Reimagining clinical documentation with artificial intelligence. Mayo Clin. Proc. 93, 563–565 (2018). source
- Not checked yetcites [8] Coiera, E., Kocaballi, B., Halamka, J. & Laranjo, L. The digital scribe. npj Digit. Med. 1, 58 (2018). source
- Not checked yetcites [9] Willis, M. & Jarrahi, M. H. Automating documentation: a critical perspective into the role of artificial intelligence in clinical documentation. In Information in Contemporary Society (eds Taylor, N. G., Christian-Lamb, C., Martin, M. H. & Nardi, B.) 200–209 (Springer International Publishing, 2019). source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Due to the complexity of each task, we posit that research may reap the greatest benefits by focusing on solving the challenges individually, as opposed to seeking to build a holistic solution.”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Conclusion
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As a result, rich and accurate clinical data has become one of the most valuable intellectual property assets for industry and academia.”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Challenge 5: lack of clinical data
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Nevertheless, clinicians will only be convinced of embracing digital scribes if they believe that any reviewing and revising of summaries will be less time consuming than writing a summary from scratch.”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Challenge 4: conversation summarization
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
In the paper
“Current advocates of replacing the entire documentation process with AI also tend to overlook the complexities of healthcare sociotechnical systems.9”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Discussion: clinical practice implications
What the sources say
- Not checked yetcites [9] Willis, M. & Jarrahi, M. H. Automating documentation: a critical perspective into the role of artificial intelligence in clinical documentation. In Information in Contemporary Society (eds Taylor, N. G., Christian-Lamb, C., Martin, M. H. & Nardi, B.) 200–209 (Springer International Publishing, 2019). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In particular, conversational clinical data, transcripts, and summaries are needed to apply the recent advances in ML and AI to digital scribe development.”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Conclusion
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Collecting sufficient data at the scale needed for AI and ML algorithms could alone take years to complete.”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Conclusion
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“During a clinical encounter, it is common for a clinician to change their assessments or revise some observations.”
§ Challenges of developing a digital scribe to reduce clinical documentation burden > Challenge 4: conversation summarization
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Unfortunately as clinic encounter conversations are not routinely recorded and are difficult to ethically share due to patient confidentiality, there are no sufficiently large clinic dialogue-note datasets to benchmark this task.”
From Aci-bench: a Novel Ambient Clinical Intelligence Dataset for Benchmarking Automatic Visit Note Generation (2023) · cites this paper as [12]
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Sudlow, C., Gallacher, J., Allen, N., Beral, V., Burton, P., Danesh, J., Downey, P., Elliott, P., Green, J., Landray, M., et al. (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001779 · Cited by 12,728
MIMIC-III, a freely accessible critical care database
Johnson, A. E. W., Pollard, T. J., Shen, L., Lehman, L.-W. H., Feng, M., Ghassemi, M., Moody, B., Szolovits, P., Anthony Celi, L., & Mark, R. G. (2016) · Scientific Data · doi:10.1038/sdata.2016.35 · Cited by 8,141
A guide to deep learning in healthcare
Esteva, A., Robicquet, A., Ramsundar, B., Kuleshov, V., DePristo, M., Chou, K., Cui, C., Corrado, G., Thrun, S., & Dean, J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0316-z · Cited by 5,312
Artificial intelligence in healthcare
Yu, K.-H., Beam, A. L., & Kohane, I. S. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0305-z · Cited by 2,817
Deep Learning for Health Informatics
Ravì, D., Wong, C., Deligianni, F., Berthelot, M., Andreu-Perez, J., Lo, B., & Yang, G.-Z. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2016.2636665 · Cited by 2,000
Serving the enterprise and beyond with informatics for integrating biology and the bedside (i2b2)
Murphy, S. N., Weber, G. M., Mendis, M., Gainer, V. S., Chueh, H. C., Churchill, S. E., & Kohane, I. S. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2009.000893 · Cited by 926
Types of Unintended Consequences Related to Computerized Provider Order Entry
Campbell, E. M., Sittig, D. F., Ash, J. S., Guappone, K. P., & Dykstra, R. H. (2006) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2042 · Cited by 823
Recent automatic text summarization techniques: a survey
Gambhir, M., & Gupta, V. (2016) · Artificial Intelligence Review · doi:10.1007/s10462-016-9475-9 · Cited by 769
Friedberg, M., Chen, P., Van Busum, K., Aunon, F., Pham, C., Caloyeras, J., Mattke, S., Pitchforth, E., Quigley, D., Brook, R., et al. (2014) · RAND Health Quarterly · doi:10.7249/rhq-03-04-01 · Cited by 707
Cited by
Sorted by citations
Perceptions and Needs of Artificial Intelligence in Health Care to Increase Adoption: Scoping Review
Chew, H. S. J., & Achananuparp, P. (2022) · Journal of Medical Internet Research · doi:10.2196/32939 · Cited by 243
The impact of nuance DAX ambient listening AI documentation: a cohort study.
Haberle, T., Cleveland, C., Snow, G. L., Barber, C., Stookey, N., Thornock, C., Younger, L., Mullahkhel, B., & Ize-Ludlow, D. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae022 · Cited by 171
The digital scribe in clinical practice: a scoping review and research agenda
van Buchem, M. M., Boosman, H., Bauer, M. P., Kant, I. M. J., Cammel, S. A., & Steyerberg, E. W. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00432-5 · Cited by 152
Pavuluri, S., Sangal, R., Sather, J., & Taylor, R. A. (2024) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2024-101120 · Cited by 129
Thomas Craig, K. J., Willis, V. C., Gruen, D., Rhee, K., & Jackson, G. P. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa301 · Cited by 123
Kocaballi, A. B., Ijaz, K., Laranjo, L., Quiroz, J. C., Rezazadegan, D., Tong, H. L., Willcock, S., Berkovsky, S., & Coiera, E. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa131 · Cited by 112
Self-citationRoles and potential of Large language models in healthcare: A comprehensive review
Lin, C., & Kuo, C. (2025) · Biomedical Journal · doi:10.1016/j.bj.2025.100868 · Cited by 125
Automated evaluation of psychotherapy skills using speech and language technologies
Flemotomos, N., Martínez, V. R., Chen, Z., Singla, K., Ardulov, V., Peri, R., Caperton, D. D., Gibson, J., Tanana, M., Georgiou, P., et al. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01623-4 · Cited by 112
Automatic documentation of professional health interactions: A systematic review
Falcetta, F. S., de Almeida, F. K., Lemos, J., Goldim, J. R., & da Costa, C. A. (2023) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2023.102487 · Cited by 103
Digital health and primary care: Past, pandemic and prospects
Pagliari, C. (2021) · Journal of Global Health · doi:10.7189/jogh.11.01005 · Cited by 70
The Impact of AI Scribes on Streamlining Clinical Documentation: A Systematic Review
Sasseville, M., Yousefi, F., Ouellet, S., Naye, F., Stefan, T., Carnovale, V., Bergeron, F., Ling, L., Gheorghiu, B., Hagens, S., et al. (2025) · Healthcare · doi:10.3390/healthcare13121447 · Cited by 86
Comparison of MetaMap and cTAKES for entity extraction in clinical notes
Reátegui, R., & Ratté, S. (2018) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-018-0654-2 · Cited by 83
Transforming Healthcare with AI: Promises, Pitfalls, and Pathways Forward
Shuaib, A. S. (2024) · International Journal of General Medicine · doi:10.2147/ijgm.s449598 · Cited by 94
Digital scribe utility and barriers to implementation in clinical practice: a scoping review
Ghatnekar, S., Faletsky, A., & Nambudiri, V. E. (2021) · Health and Technology · doi:10.1007/s12553-021-00568-0 · Cited by 76
Impact of a Digital Scribe System on Clinical Documentation Time and Quality: Usability Study
van Buchem, M. M., Kant, I. M. J., King, L., Kazmaier, J., Steyerberg, E. W., & Bauer, M. P. (2024) · JMIR AI · doi:10.2196/60020 · Cited by 70
AI Scribes in Health Care: Balancing Transformative Potential With Responsible Integration
Leung, T. I., Coristine, A. J., & Benis, A. (2025) · JMIR Medical Informatics · doi:10.2196/80898 · Cited by 82
Yim, W.-W., Fu, Y., Ben Abacha, A., Snider, N., Lin, T., & Yetisgen, M. (2023) · Scientific Data · doi:10.1038/s41597-023-02487-3 · Cited by 64
“However, a massive bottleneck in understanding the state-of-the-art is the lack of publicly share-able data to train and evaluate 12 .”
BackgroundGenerating Medical Reports from Patient-Doctor Conversations Using Sequence-to-Sequence Models
Enarvi, S., Amoia, M., Teba, M. D.-A., Delaney, B., Diehl, F., Hahn, S., Harris, K., McGrath, L., Pan, Y., Pinto, J., et al. (2020) · doi:10.18653/v1/2020.nlpmc-1.4 · Cited by 69
Kocaballi, A., Sezgin, E., Clark, L., Carroll, J. M., Huang, Y., Huh-Yoo, J., Kim, J., Kocielnik, R., Lee, Y.-C., Mamykina, L., et al. (2022) · Journal of Medical Internet Research · doi:10.2196/38525 · Cited by 61
Self-citationZheng, W., Yan, L., Gou, C., Zhang, Z.-C., Zhang, J. J., Hu, M., & Wang, F. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.05.015 · Cited by 61
Artificial Intelligence Education for the Health Workforce: Expert Survey of Approaches and Needs
Gray, K. M., Slavotinek, J., Dimaguila, G. L., & Choo, D. (2022) · JMIR Medical Education · doi:10.2196/35223 · Cited by 62
Expectations for Artificial Intelligence (AI) in Psychiatry
Monteith, S., Glenn, T., Geddes, J. R., Whybrow, P. C., Achtyes, E. D., & Bauer, M. (2022) · Current Psychiatry Reports · doi:10.1007/s11920-022-01378-5 · Cited by 61
Natural Language Processing in medicine and ophthalmology: A review for the 21st-century clinician
Rojas-Carabali, W. A., Agrawal, R., Gutiérrez-Sinisterra, L., Baxter, S. L., Cifuentes‐González, C., Wei, Y. C., Abisheganaden, J. A., Kannapiran, P., Wong, S., Lee, B. T. K., et al. (2024) · Asia-Pacific Journal of Ophthalmology · doi:10.1016/j.apjo.2024.100084 · Cited by 70
Automatically Charting Symptoms From Patient-Physician Conversations Using Machine Learning
Rajkomar, A., Kannan, A., Chen, K., Vardoulakis, L., Chou, K., Cui, C. M., & Dean, J. (2019) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2018.8558 · Cited by 53
A patient-centered digital scribe for automatic medical documentation
Wang, J., Lavender, M., Hoque, M. E., Brophy, P. D., & Kautz, H. (2021) · JAMIA Open · doi:10.1093/jamiaopen/ooab003 · Cited by 48
Kanaparthy, N. S., Villuendas-Rey, Y., Bakare, T., Diao, Z., Iscoe, M., Loza, A., Wright, D., Safranek, C., Faustino, I. V., Brackett, A., et al. (2025) · JMIR AI · doi:10.2196/76743 · Cited by 57
A method to automate the discharge summary hospital course for neurology patients
Hartman, V., Bapat, S. S., Weiner, M. G., Navi, B. B., Sholle, E., & Campion, T. R. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad177 · Cited by 44
Matthiesen, S., Diederichsen, S. Z., Hansen, M. K. H., Villumsen, C., Lassen, M. C. H., Jacobsen, P. K., Risum, N., Winkel, B. G., Philbert, B. T., Svendsen, J. H., et al. (2021) · JMIR Human Factors · doi:10.2196/26964 · Cited by 45
Ha, E., Choon-Kon-Yune, I., Murray, L., Luan, S., Montague, E. N. H., Bhattacharyya, O. K., & Agarwal, P. (2025) · JMIR Human Factors · doi:10.2196/71434 · Cited by 42
Evans, K. A., Papinniemi, A., Ploderer, B., Nicholson, V., Hindhaugh, T., Vuvan, V., Cowley, N., Tariq, A., & Thomson, H. (2025) · Musculoskeletal Science and Practice · doi:10.1016/j.msksp.2025.103333 · Cited by 45
A dataset of simulated patient-physician medical interviews with a focus on respiratory cases
Fareez, F., Parikh, T., Wavell, C., Shahab, S., Chevalier, M., Good, S., De Blasi, I., Rhouma, R., McMahon, C., Lam, J.-P., et al. (2022) · Scientific Data · doi:10.1038/s41597-022-01423-1 · Cited by 39
Applications of natural language processing in ophthalmology: present and future
Chen, J., & Baxter, S. L. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2022.906554 · Cited by 43
Tran, B. D., Chen, Y., Liu, S., & Zheng, K. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa020 · Cited by 38
Artificial intelligence and the world of work, a co‐constitutive relationship
Østerlund, C. S., Jarrahi, M. H., Willis, M., Boyd, K., & Wolf, C. T. (2020) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24388 · Cited by 48
Alboksmaty, A., Aldakhil, R., Hayhoe, B. W. J., Ashrafian, H., Darzi, A. W., & Neves, A.-L. (2025) · EBioMedicine · doi:10.1016/j.ebiom.2025.105861 · Cited by 48
Levy, D. R., Withall, J. B., Mishuris, R. G., Tiase, V. L., Diamond, C., Douthit, B. J., Grabowska, M. E., Lee, R. Y., Moy, A. J., Sengstack, P. R., et al. (2024) · Applied Clinical Informatics · doi:10.1055/a-2385-1654 · Cited by 36
The Utility and Implications of Ambient Scribes in Primary Care
Seth, P., Carretas, R., & Rudzicz, F. (2024) · JMIR AI · doi:10.2196/57673 · Cited by 36
Language Model-Driven Chatbot for Business to Address Marketing and Selection of Products
Kushwaha, A. K., & Kar, A. K. (2020) · IFIP advances in information and communication technology · doi:10.1007/978-3-030-64849-7_3 · Cited by 34
Interfacing With the Electronic Health Record (EHR): A Comparative Review of Modes of Documentation
Avendano, J. P., Gallagher, D. O., Hawes, J., Boyle, J. J., Glasser, L., Aryee, J. N. A., & Katt, B. M. (2022) · Cureus · doi:10.7759/cureus.26330 · Cited by 31
Fraile Navarro, D., Kocaballi, A. B., Dras, M., & Berkovsky, S. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3569893 · Cited by 28
Self-citationTran, B. D., Latif, K., Reynolds, T. L., Park, J., Lafata, J. E., Tai‐Seale, M., & Zheng, K. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad001 · Cited by 31
Luo, X., Zhou, L., Adelgais, K., & Zhang, Z. (2025) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-025-00193-w · Cited by 30
Deep Learning based Transcribing and Summarizing Clinical Conversations
Menon, N. G., Shrivastava, A., Bhavana, N., & Simon, J. (2021) · International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC) · doi:10.1109/i-smac52330.2021.9640683 · Cited by 25
Saadat, S., Darounkolaei, M. K., Qorbani, M., Hemmat, A., & Hariri, S. (2025) · InfoScience Trends · doi:10.61186/ist.202502.01.01 · Cited by 22
Song, J., Zolnoori, M., Scharp, D., Vergez, S., McDonald, M. V., Sridharan, S., Kostić, Z., & Topaz, M. (2022) · JAMIA Open · doi:10.1093/jamiaopen/ooac034 · Cited by 23
Peters, F., Kreutzburg, T., Kuchenbecker, J., Marschall, U., Remmel, M., Dankhoff, M., Trute, H.-H., Repgen, T., Debus, E. S., & Behrendt, C. (2020) · Gefässchirurgie · doi:10.1007/s00772-020-00679-4 · Cited by 22
Bai, E., Luo, X., Zhang, Z., Adelgais, K., Ali, H., Finkelstein, J., & Kutzin, J. (2025) · Journal of Medical Systems · doi:10.1007/s10916-025-02197-w · Cited by 24
Ethical Issues in Near-Future Socially Supportive Smart Assistants for Older Adults
London, A., Razin, Y., Borenstein, J., Eslami, M., Perkins, R., & Robinette, P. (2023) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2023.3237124 · Cited by 18
Sezgın, E., Sirrianni, J., & Kranz, K. (2024) · Applied Clinical Informatics · doi:10.1055/a-2327-4121 · Cited by 30
Yim, W.-W., & Yetişgen, M. (2021) · doi:10.18653/v1/2021.nlpmc-1.2 · Cited by 19
Identifying relevant information in medical conversations to summarize a clinician-patient encounter
Quiroz, J. C., Laranjo, L., Kocaballi, A. B., Briatore, A., Berkovsky, S., Rezazadegan, D., & Coiera, E. W. (2020) · Health Informatics Journal · doi:10.1177/1460458220951719 · Cited by 19
Self-citationIslam, M. N., Mim, S. T., Tasfia, T., & Hossain, M. M. (2024) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2024.101456 · Cited by 17
Győrffy, Z., Radó, N., Pölczman, L., Sükösd, A., & Boros, J. (2023) · BMC Health Services Research · doi:10.1186/s12913-023-10101-w · Cited by 18
Navarro, D. F., Kocaballi, A. B., & Berkovsky, S. (2025) · Journal of Medical Systems · doi:10.1007/s10916-025-02234-8 · Cited by 16
Self-citationUnintended consequences of using ambient scribes in general practice
Eccles, A., Pelly, T., Pope, C. J., & Powell, J. (2025) · BMJ · doi:10.1136/bmj-2025-085754 · Cited by 14
Evaluating an artificial intelligence scribe for clinical documentation
Alpert, J. M., Saper, R. B., Boose, E., Ruff, J. M., Hopkins, K., Gaskins, D., Guo, N., Schneider, J. P., Scibona, A. G., Gutierrez, J., et al. (2025) · Digital Health · doi:10.1177/20552076251395588 · Cited by 15
Wolfe, A. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e14835 · Cited by 15
Machine learning-based speech recognition system for nursing documentation – A pilot study
Lee, T., Li, C.-C., Chou, K., Chung, M., Hsiao, S.-T. S., Guo, S.-L., Hung, L.-Y., & Wu, H. (2023) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2023.105213 · Cited by 16
Cano, A. M. C. (2023) · LatIA · doi:10.62486/latia20233 · Cited by 14
Clinician as editor: notes in the era of AI scribes
Altschuler, S., Huntington, I., Antoniak, M., & Klein, L. F. (2024) · The Lancet · doi:10.1016/s0140-6736(24)02568-6 · Cited by 14
How Artificial Intelligence for Healthcare Look Like in the Future?
Denecke, K., & Gabarrón, E. (2021) · Studies in health technology and informatics · doi:10.3233/shti210301 · Cited by 14
Onuh, O. C., Brydges, H. T., Nasr, H. Y., Savage, E., Gorenstein, S. A., & Chiu, E. S. (2022) · Advances in Skin & Wound Care · doi:10.1097/01.asw.0000852564.21370.a4 · Cited by 13
Transitioning Cognitive Aids into Decision Support Platforms: Requirements and Design Guidelines
Mastrianni, A., Sarcevic, A., Hu, A., Almengor, L., Tempel, P. E., Gao, S., & Burd, R. S. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3582431 · Cited by 11
General practitioners’ opinions of generative artificial intelligence in the UK: An online survey
Kharko, A., Sanchez, C. G., Hagström, J., Gaab, J., Locher, C., McMillan, B., Sundemo, D. S., & Blease, C. (2025) · Digital Health · doi:10.1177/20552076251360863 · Cited by 15
Pyne, Y., Wong, Y. M., Fang, H., & Simpson, E. (2023) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2022-100659 · Cited by 12
Benchmarking Recording-Level Clinical Speech De-identification for Privacy-Preserving Clinical AudioPreprint
Dai, H.-J., Le, H. T. B., Fang, L.-C., Mir, T. H., Chen, C.-T., Feng, H.-H., Lai, J.-R., Hsu, H.-C., Nandy, P., Liao, W.-H., et al. (2026) · medRxiv · doi:10.64898/2026.04.13.26349911 · Cited by 11
Clinical AI Scribes in primary care: accuracy, error severity and implications for clinical practice
Draper, T. C., Cox, T., Lamb-Riddell, K., Moretti, L. A., McCormick, J., Trowell, S., Kiely, J., & Luxton, R. (2025) · BMJ Digital Health & AI · doi:10.1136/bmjdhai-2025-000092 · Cited by 10
Impact of acoustic and informational noise on AI-generated clinical summaries
Draper, T. C., Leake, J., Lamb-Riddell, K., Cox, T. M., McCormick, J., Trowell, S., Kiely, J., & Luxton, R. W. (2025) · BMJ Digital Health & AI · doi:10.1136/bmjdhai-2025-000057 · Cited by 10
Rodenhouse, A. J., Davis, E., Burger, P., Nicandri, G. T., & DiGiovanni, B. F. (2025) · Journal of the American Academy of Orthopaedic Surgeons · doi:10.5435/jaaos-d-24-01321 · Cited by 10
Khosla, S., Vashishth, S., Lehman, J. F., & Rosé, C. P. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.626 · Cited by 11
Barr, P. J., Ryan, J., & Jacobson, N. C. (2021) · Journal of Medical Internet Research · doi:10.2196/20545 · Cited by 10
Medical Term and Status Generation From Chinese Clinical Dialogue With Multi-Granularity Transformer
Li, M., Xiang, L., Kang, X., Zhao, Y., Yu, Z., & Zong, C. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3122301 · Cited by 10
Sezgın, E., Sirrianni, J., & Kranz, K. (2023) · medRxiv · doi:10.1101/2023.12.06.23299573 · Cited by 10
Merriweather, Lyytinen, K., Aron, D., & Cauley, M. R. (2026) · npj Digital Medicine · doi:10.1038/s41746-025-02243-4 · Cited by 9
“These sociotechnical challenges persist even with the introduction of digital scribe technologies, underscoring the need to differentiate betweentheEHRasadatainfrastructureandtheuserinterface(UI)through whichphysiciansinteractwiththatinfrastructure 11 .”
Tran, B. D., Mangu, R., Tai‐Seale, M., Lafata, J. E., & Zheng, K. (2022) · PubMed Central · Cited by 8
Transcription Accuracy of Automatic Speech Recognition for Orthodontic Clinical Records
O’Kane, R., Stonehouse‐Smith, D., Ota, L. C. U., Patel, R., Johnson, N., Slipper, C., Seehra, J., Papageorgiou, S. N., & Cobourne, M. T. (2025) · Journal of Dental Research · doi:10.1177/00220345251382452 · Cited by 8
Fogleman, B. M., Goldman, M., Holland, A. B., Dyess, G. A., & Patel, A. (2024) · Cureus · doi:10.7759/cureus.58032 · Cited by 12
Artificial intelligence medical scribes in allied health: a solution in search of evidence?
Ryan, L., & Hattingh, L. (2025) · Australian Health Review · doi:10.1071/ah25064 · Cited by 7
Keyword-augmented and semi-automatic generation of FESS reports: a proof-of-concept study
Kunz, V., Wildfeuer, V., Bieck, R., Sorge, M., Zebralla, V., Dietz, A., Neumuth, T., & Pirlich, M. (2022) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-022-02791-0 · Cited by 7
Adaptation of Autoencoder for Sparsity Reduction From Clinical Notes Representation Learning
Le, T.-D., Noumeir, R., Rambaud, J., Sans, G., & Jouvet, P. A. (2023) · IEEE Journal of Translational Engineering in Health and Medicine · doi:10.1109/jtehm.2023.3241635 · Cited by 8
Martín-Méndez, M., García-Díaz, V., Madera, P. Z., Fernández‐Feito, A., Jimeno-Demuth, F., & Lana, A. (2021) · CIN Computers Informatics Nursing · doi:10.1097/cin.0000000000000759 · Cited by 7
Digital Technology in Healthcare—An Ethical Overview
Hansson, S. O., & Fröding, B. E. E. (2024) · Digital Society · doi:10.1007/s44206-024-00121-2 · Cited by 11
The Current State of Digital Scribes in Primary Care: A Scoping Review
Nair, R. P., Hashmi, M. M., Kassim, S. S., & Singer, A. G. (2026) · Journal of Medical Systems · doi:10.1007/s10916-025-02319-4 · Cited by 6
Lumbiganon, S., Chawareb, E. A., Hammad, M. A. M., Azad, B. K., Shah, D., & Yafi, F. A. (2024) · Current Urology Reports · doi:10.1007/s11934-024-01237-1 · Cited by 6
Natural Language Processing: Set to Transform Pediatric Research
Bannett, Y., Bassett, H. K., & Morse, K. (2024) · Hospital Pediatrics · doi:10.1542/hpeds.2024-008115 · Cited by 6
Artificial Intelligence (AI) and Men’s Health Clinic Efficiency and Clinic Billing
Kinachtchouk, N., & Canes, D. (2024) · Current Urology Reports · doi:10.1007/s11934-024-01252-2 · Cited by 6
BERT-Driven Automation in Electronic Health Record Management System
Khan, F. A., & Hajiarbabi, M. (2024) · IEEE SoutheastCon · doi:10.1109/southeastcon52093.2024.10500252 · Cited by 6
Peters, F., Kreutzburg, T., Kuchenbecker, J., Marschall, U., Remmel, M., Dankhoff, M., Trute, H.-H., Repgen, T., Debus, E. S., & Behrendt, C. (2020) · Gefässchirurgie · doi:10.1007/s00772-020-00664-x · Cited by 6
Flemotomos, N., Martínez, V., Chen, Z., Singla, K., Ardulov, V., Peri, R., Caperton, D. D., Gibson, J., Tanana, M., Georgiou, P., et al. (2021) · arXiv (Cornell University) · Cited by 6
Eshel, R., Bellolio, F., Boggust, A. J., Shapiro, N. I., Mullan, A. F., Heaton, H. A., Madsen, B. E., Homme, J. L., Iliff, B. W., Sunga, K., et al. (2022) · The American Journal of Emergency Medicine · doi:10.1016/j.ajem.2022.10.009 · Cited by 5
AI-Based Medical Scribe to Support Clinical Consultations: A Proposed System Architecture
Montenegro, L., Gomes, L. M., & Machado, J. M. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-49011-8_22 · Cited by 5
Clinical Dialogue Transcription Error Correction Using Seq2Seq Models
Nanayakkara, G., Wiratunga, N., Corsar, D., Martin, K., & Wijekoon, A. (2022) · Studies in computational intelligence · doi:10.1007/978-3-031-14771-5_4 · Cited by 6
Sanchez, C. G., Kharko, A., Hägglund, M., Riggare, S. S., & Blease, C. (2025) · JMIR Research Protocols · doi:10.2196/73602 · Cited by 4
Kapoor, V., Skellern, C., McGrath, P., Brosnan, S., Gofer, Y., & Thorburn, L. (2026) · Journal of Paediatrics and Child Health · doi:10.1111/jpc.70419 · Cited by 4
Real concerns, artificial intelligence: Reality testing for psychiatrists
Dube, A. R., Ambrose, A. J. H., Velez, G. E., & Jadhav, M. (2024) · International Review of Psychiatry · doi:10.1080/09540261.2024.2363374 · Cited by 5
The promises and challenges of clinical AI in community paediatric medicine
Singh, D. A., Nagaraj, S., Daniel, R. C., Flood, C. M., Kulik, D. M., Flook, R., Goldenberg, A., Brudno, M., & Stedman, I. (2023) · Paediatrics & Child Health · doi:10.1093/pch/pxac080 · Cited by 4
Behrendt, C. (2020) · VASA · doi:10.1024/0301-1526/a000847 · Cited by 4
Artificial intelligence in dermatology: Clinical promise and environmental impact
Shen, C. Z., Zhao, A. T., Rotemberg, V. M., Daneshjou, R., Parker, E. R., & Rosenbach, M. A. (2026) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2026.03.039 · Cited by 3
Vidal‐Alaball, J., Alonso, C. V., Heinisch, D. H., Castaño, A., Sánchez-Freire, E., Serrano, M. L. B., Pascual, C. F., Menacho, I., Acosta‐Rojas, R., Gubert, O. C., et al. (2025) · JMIR Research Protocols · doi:10.2196/66232 · Cited by 3
Metadata
- Authors
- Quiroz, J. C., Laranjo, L., Kocaballi, A. B., Berkovsky, S., Rezazadegan, D., & Coiera, E.
- Affiliations
- Macquarie University (AU)
- Corresponding author
- Quiroz, Juan C.
- ORCID
- Venue
- npj Digital Medicine
- Published
- 2019-11-22
- Volume
- 2
- Issue
- 1
- Pages
- 114-114
- ISSN
- 2398-6352 (ISSN-L)
- PMC
- PMC6874666
- OpenAlex
- W2989925457
- Semantic Scholar
- bfcfdf78801e224e88016c04e973130e5944ee8f
- Cited by
- 162
- References
- 47
- Citations by year
- 2026: 26 · 2025: 37 · 2024: 26 · 2023: 24 · 2022: 18 · 2021: 16 · 2020: 12 · 2019: 1
- FWCI
- 2.21
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- npj Digital Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- UTS ePRESS (University of Technology Sydney) (submittedVersion, other-oa)
- Swinburne figshare (Swinburne University of Technology) (submittedVersion, cc-by)
- Funders
- Department of Health | National Health and Medical Research Council (APP1134919)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Nursing › Research and Theory › Nursing Diagnosis and Documentation
- Keywords
- clinical documentation burden, speech recognition, medical scribes, speech-to-text, topic modeling, medical concept extraction, physician burnout
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-06, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-06 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
