Efficiency and safety of speech recognition for documentation in the electronic health record
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Objective: To compare the efficiency and safety of using speech recognition (SR) assisted clinical documentation within an electronic health record (EHR) system with use of keyboard and mouse (KBM). Methods: Thirty-five emergency department clinicians undertook randomly allocated clinical documentation tasks using KBM or SR on a commercial EHR system. Tasks were simple or complex, and with or without interruption. Outcome measures included task completion times and observed errors. Errors were classed by their potential for patient harm. Error causes were classified as due to IT system/system integration, user interaction, comprehension, or as typographical. User-related errors could be by either omission or commission. Results: Mean task completion times were 18.11% slower overall when using SR compared to KBM (P = .001), 16.95% slower for simple tasks (P = .050), and 18.40% slower for complex tasks (P = .009). Increased errors were observed with use of SR (KBM 32, SR 138) for both simple (KBM 9, SR 75; P < 0.001) and complex (KBM 23, SR 63; P < 0.001) tasks. Interruptions did not significantly affect task completion times or error rates for either modality. Discussion: For clinical documentation, SR was slower and increased the risk of documentation errors, including errors with the potential to cause clinical harm compared to KBM. Some of the observed increase in errors may be due to suboptimal SR to EHR integration and workflow. Conclusion: Use of SR to drive interactive clinical documentation in the EHR requires careful evaluation. Current generation implementations may require significant development before they are safe and effective. Improving system integration and workflow, as well as SR accuracy and user-focused error correction strategies, may improve SR performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“For example, a recent study of speech recognition for electronic health record documentation found an increased risk of errors, including errors with the potential to cause patient harm.”
From Conversational agents in healthcare: a systematic review (2018) · cites this paper as [51]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971
Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026256 · Cited by 8,736 · cited 1×
“Inter-rater agreement was calculated using Cohen’s kappa.(11) Initial observed agreement was robust across all three categories: (1) 81.”
MethodAchieving Human Parity in Conversational Speech Recognition
Xiong, W., Droppo, J., Huang, X., Seide, F. T. B., Seltzer, M., Stolcke, A., Yu, D., & Zweig, G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.05256 · Cited by 451 · cited 1×
“There continue to be rapid changes in SR technologies; a recent study reports SR systems that now exceed human performance for conversational speech.(16) One recent study examined the potential for EHR transcription using SR together with natural language processing and found potential time and usability benefits for…”
BackgroundCoiera, E. (2015) · CRC Press eBooks · doi:10.1201/b13617 · Cited by 415
Self-citationCommunication loads on clinical staff in the emergency department
Coiera, E. W., Jayasuriya, R. A., Hardy, J., Bannan, A., & Thorpe, M. E. C. (2002) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2002.tb04482.x · Cited by 379
Self-citationThe impact of interruptions on clinical task completion
Westbrook, J. I., Coiera, E., Dunsmuir, W. T. M., Brown, B. M., Kelk, N., Paoloni, R., & Tran, C. (2010) · Quality and Safety in Health Care · doi:10.1136/qshc.2009.039255 · Cited by 341 · cited 1×
“A previous observational study on the impact of interruptions on ED physicians’ task time showed a reduction in task time following interruptions, possibly because physicians hurry to complete tasks after being interrupted when they are under time pressure.(14) Our results suggest that documentation tasks might not be…”
BackgroundSelf-citationToward Human Parity in Conversational Speech Recognition
Xiong, W., Droppo, J., Huang, X., Seide, F., Seltzer, M. L., Stolcke, A., Yu, D., & Zweig, G. (2017) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2017.2756440 · Cited by 245
Coiera, E., Kocaballi, B., Halamka, J., & Laranjo, L. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0066-9 · Cited by 132
Self-citationElectronic Health Record Interactions through Voice: A Review
Kumah-Crystal, Y., Pirtle, C., Whyte, H., Goode, E., Anders, S., & Lehmann, C. (2018) · Applied Clinical Informatics · doi:10.1055/s-0038-1666844 · Cited by 113
Risks and benefits of speech recognition for clinical documentation: a systematic review
Hodgson, T., & Coiera, E. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv152 · Cited by 102 · cited 4×
“None explored the use of SR for general input and navigation of the EHR, and very few directly compared SR to the use of KBM, the most common input modality for EHR documentation.(3)”
BackgroundMethodResultInfluentialSelf-citationCoiera, E. (2012) · BMJ Quality & Safety · doi:10.1136/bmjqs-2012-000783 · Cited by 95 · cited 1×
“Given that interruptions are commonplace in clinical settings and can contribute to documentation error, 4 of the 8 tasks included a randomly assigned interruption condition.(7,8) Interrupts were generated by a popup with a multiple-choice question taken from an Australasian College for Emergency Medicine fellowship e…”
MethodSelf-citationZhou, L., Blackley, S. V., Kowalski, L., Doan, R., Acker, W. W., Landman, A. B., Kontrient, E., Mack, D., Meteer, M., Bates, D. W., et al. (2018) · JAMA Network Open · doi:10.1001/jamanetworkopen.2018.0530 · Cited by 94
Chiang, M. F., Read-Brown, S., Tu, D. C., Choi, D., Sanders, D. S., Hwang, T. S., Bailey, S. T., Karr, D. J., Cottle, E., Morrison, J. C., et al. (2013) · Europe PMC (PubMed Central) · Cited by 75
Accelerating the Use of Electronic Health Records in Physician Practices
Shea, S., & Hripcsak, G. (2010) · New England Journal of Medicine · doi:10.1056/nejmp0910140 · Cited by 74 · cited 1×
“SR is also considered a viable option for clinicians who cannot touch-type or are untrained in EHR use.(4,5) SR is an increasingly common input modality across a range of consumer devices, from smartphones to refrigerators,(6) and has”
BackgroundMagrabi, F., Li, S. Y. W., Day, R. O., & Coiera, E. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2009.001719 · Cited by 67 · cited 1×
“This is consistent with another controlled experiment, where interruptions did not affect electronic prescribing tasks.(13) A previous observational study on the impact of interruptions on ED physicians’ task time showed a reduction in task time following interruptions, possibly because physicians hurry to complete ta…”
ResultSelf-citationKaufman, D. R., Sheehan, B., Stetson, P., Bhatt, A. R., Field, A. I., Patel, C., & Maisel, J. M. (2016) · JMIR Medical Informatics · doi:10.2196/medinform.5544 · Cited by 58 · cited 1×
“One recent study examined the potential for EHR transcription using SR together with natural language processing and found potential time and usability benefits for electronic documentation.(17) These results are in accord with our recent systematic review that identified benefits (and risks) of using SR for clinical…”
ResultYadav, S., Kazanji, N., K C, N., Paudel, S., Falatko, J., Shoichet, S., Maddens, M., & Barnes, M. A. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw067 · Cited by 52 · cited 1×
“EHRs.(15) Our results thus support calls to improve the quality of clinical documentation independent of modality of input.”
ResultCruz, J. E. D., Shabosky, J. C., Albrecht, M., Clark, T. R., Milbrandt, J. C., Markwell, S. J., & Kegg, J. A. (2014) · Western Journal of Emergency Medicine · doi:10.5811/westjem.2014.3.19658 · Cited by 24 · cited 1×
“These results are different from those of a recent observational study that found no difference in charting time when a voice driven EHR at one site was compared to a KBM driven EHR at another.(12) However, the study sample size was too small to determine if this result was statistically significant, and the EHRs at t…”
ResultAsynchronous Speech Recognition Affects Physician Editing of Notes
Lybarger, K., Mari Ostendorf, E., Riskin, E. A., Payne, T. H., White, A. A., & Yetişgen, M. (2018) · Applied Clinical Informatics · doi:10.1055/s-0038-1673417 · Cited by 6
Research works printed but not linked: 3
- Communications, Speech Recognition Accelerating the Adoption of Electronic Health Records
- Food, 2005, Guidance for the content of premarket submissions for software contained in medical devices, Center Devices Radiol Health
- PricewaterhouseCoopers, 2014, The Wearable Future. Consumer Intelligence Series
Cited by
Conversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388
“For example, a recent study of speech recognition for electronic health record documentation found an increased risk of errors, including errors with the potential to cause patient harm.(51) As such, more complex methods of verification of user input (or “grounding”) may be needed, as well as a thorough evaluation of…”
BackgroundSelf-citationShifting machine learning for healthcare from development to deployment and from models to data
Zhang, A., Xing, L., Zou, J., & Wu, J. C. (2022) · Nature Biomedical Engineering · doi:10.1038/s41551-022-00898-y · Cited by 420
Speech Technology for Healthcare: Opportunities, Challenges, and State of the Art
Latif, S., Qadir, J., Qayyum, A., Usama, M., & Younis, S. (2021) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2020.3006860 · Cited by 173
“Furthermore, improved system interoperability and workflow are needed for their successful integration in the clinical setting [119].”
BackgroundCoiera, E., Kocaballi, B., Halamka, J., & Laranjo, L. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0066-9 · Cited by 132
Self-citationKernberg, A., Gold, J. A., & Mohan, V. (2024) · Journal of Medical Internet Research · doi:10.2196/54419 · Cited by 120
“It should be acknowledged that this study only used transcripts, eliminating the confounder of any potential errors introduced by the speech recognition aspect [23,24].”
Metadata
- Authors
- Hodgson, T., Magrabi, F., & Coiera, E.
- Affiliations
- Macquarie University (AU)
- Corresponding author
- Hodgson, Tobias
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2017-07-27
- Volume
- 24
- Issue
- 6
- Pages
- 1127-1133
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC7651984
- OpenAlex
- W2740281359
- Cited by
- 63
- References
- 18
- Citations by year
- 2026: 4 · 2025: 7 · 2024: 4 · 2023: 7 · 2022: 9 · 2021: 8 · 2020: 8 · 2019: 4 · 2018: 11 · 2017: 1
- FWCI
- 9.01
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of the American Medical Informatics Association (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Funders
- National Health and Medical Research Council (APP1032664)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Nursing › Research and Theory › Nursing Diagnosis and Documentation
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Keywords
- speech recognition, clinical documentation, electronic health records, keyboard and mouse input, documentation errors, task completion time, emergency department clinicians, electronic health record integration, workflow, patient safety
- MeSH terms
- Documentation, Efficiency, Emergency Service, Hospital, Humans, Random Allocation, User-Computer Interface, Computer Peripherals, Medical Errors, Speech Recognition Software, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.


