Efficiency and safety of speech recognition for documentation in the electronic health record
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Objective: To compare the efficiency and safety of using speech recognition (SR) assisted clinical documentation within an electronic health record (EHR) system with use of keyboard and mouse (KBM). Methods: Thirty-five emergency department clinicians undertook randomly allocated clinical documentation tasks using KBM or SR on a commercial EHR system. Tasks were simple or complex, and with or without interruption. Outcome measures included task completion times and observed errors. Errors were classed by their potential for patient harm. Error causes were classified as due to IT system/system integration, user interaction, comprehension, or as typographical. User-related errors could be by either omission or commission. Results: Mean task completion times were 18.11% slower overall when using SR compared to KBM (P = .001), 16.95% slower for simple tasks (P = .050), and 18.40% slower for complex tasks (P = .009). Increased errors were observed with use of SR (KBM 32, SR 138) for both simple (KBM 9, SR 75; P < 0.001) and complex (KBM 23, SR 63; P < 0.001) tasks. Interruptions did not significantly affect task completion times or error rates for either modality. Discussion: For clinical documentation, SR was slower and increased the risk of documentation errors, including errors with the potential to cause clinical harm compared to KBM. Some of the observed increase in errors may be due to suboptimal SR to EHR integration and workflow. Conclusion: Use of SR to drive interactive clinical documentation in the EHR requires careful evaluation. Current generation implementations may require significant development before they are safe and effective. Improving system integration and workflow, as well as SR accuracy and user-focused error correction strategies, may improve SR performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“For example, a recent study of speech recognition for electronic health record documentation found an increased risk of errors, including errors with the potential to cause patient harm.”
From Conversational agents in healthcare: a systematic review (2018) · cites this paper as [51]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971
Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026256 · Cited by 8,736 · cited 1×
“Inter-rater agreement was calculated using Cohen’s kappa.(11) Initial observed agreement was robust across all three categories: (1) 81.”
MethodAchieving Human Parity in Conversational Speech Recognition
Xiong, W., Droppo, J., Huang, X., Seide, F. T. B., Seltzer, M., Stolcke, A., Yu, D., & Zweig, G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.05256 · Cited by 451
Coiera, E. (2015) · CRC Press eBooks · doi:10.1201/b13617 · Cited by 415
Self-citationCommunication loads on clinical staff in the emergency department
Coiera, E. W., Jayasuriya, R. A., Hardy, J., Bannan, A., & Thorpe, M. E. C. (2002) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2002.tb04482.x · Cited by 379
Self-citationThe impact of interruptions on clinical task completion
Westbrook, J. I., Coiera, E., Dunsmuir, W. T. M., Brown, B. M., Kelk, N., Paoloni, R., & Tran, C. (2010) · Quality and Safety in Health Care · doi:10.1136/qshc.2009.039255 · Cited by 341
Self-citationToward Human Parity in Conversational Speech Recognition
Xiong, W., Droppo, J., Huang, X., Seide, F., Seltzer, M. L., Stolcke, A., Yu, D., & Zweig, G. (2017) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2017.2756440 · Cited by 245
Coiera, E., Kocaballi, B., Halamka, J., & Laranjo, L. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0066-9 · Cited by 132
Self-citationElectronic Health Record Interactions through Voice: A Review
Kumah-Crystal, Y., Pirtle, C., Whyte, H., Goode, E., Anders, S., & Lehmann, C. (2018) · Applied Clinical Informatics · doi:10.1055/s-0038-1666844 · Cited by 113
Risks and benefits of speech recognition for clinical documentation: a systematic review
Hodgson, T., & Coiera, E. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv152 · Cited by 102
Self-citation
Research works printed but not linked: 3
- Communications, Speech Recognition Accelerating the Adoption of Electronic Health Records
- Food, 2005, Guidance for the content of premarket submissions for software contained in medical devices, Center Devices Radiol Health
- PricewaterhouseCoopers, 2014, The Wearable Future. Consumer Intelligence Series
Cited by
Conversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388
“For example, a recent study of speech recognition for electronic health record documentation found an increased risk of errors, including errors with the potential to cause patient harm.(51) As such, more complex methods of verification of user input (or “grounding”) may be needed, as well as a thorough evaluation of…”
BackgroundSelf-citationShifting machine learning for healthcare from development to deployment and from models to data
Zhang, A., Xing, L., Zou, J., & Wu, J. C. (2022) · Nature Biomedical Engineering · doi:10.1038/s41551-022-00898-y · Cited by 420
Speech Technology for Healthcare: Opportunities, Challenges, and State of the Art
Latif, S., Qadir, J., Qayyum, A., Usama, M., & Younis, S. (2021) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2020.3006860 · Cited by 173
Coiera, E., Kocaballi, B., Halamka, J., & Laranjo, L. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0066-9 · Cited by 132
Self-citationKernberg, A., Gold, J. A., & Mohan, V. (2024) · Journal of Medical Internet Research · doi:10.2196/54419 · Cited by 120
“It should be acknowledged that this study only used transcripts, eliminating the confounder of any potential errors introduced by the speech recognition aspect [23,24].”
Metadata
- Authors
- Hodgson, T., Magrabi, F., & Coiera, E.
- Affiliations
- Macquarie University (AU)
- Corresponding author
- Hodgson, Tobias
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2017-07-27
- Volume
- 24
- Issue
- 6
- Pages
- 1127-1133
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC7651984
- OpenAlex
- W2740281359
- Cited by
- 63
- References
- 18
- Citations by year
- 2026: 4 · 2025: 7 · 2024: 4 · 2023: 7 · 2022: 9 · 2021: 8 · 2020: 8 · 2019: 4 · 2018: 11 · 2017: 1
- FWCI
- 9.01
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of the American Medical Informatics Association (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Funders
- National Health and Medical Research Council (APP1032664)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Nursing › Research and Theory › Nursing Diagnosis and Documentation
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Keywords
- speech recognition, clinical documentation, electronic health records, keyboard and mouse input, documentation errors, task completion time, emergency department clinicians, electronic health record integration, workflow, patient safety
- MeSH terms
- Documentation, Efficiency, Emergency Service, Hospital, Humans, Random Allocation, User-Computer Interface, Computer Peripherals, Medical Errors, Speech Recognition Software, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Efficiency and safety of speech recognition for documentation in the electronic health record. https://app.cochat.ai/papers/10.1093/jamia/ocx073
- The paper
- Hodgson, T., Magrabi, F., & Coiera, E. (2017). Efficiency and safety of speech recognition for documentation in the electronic health record. Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocx073
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.


