Error Rates in Breast Imaging Reports: Comparison of Automatic Speech Recognition and Dictation Transcription
The DOI matches its Crossref record.
Abstract
OBJECTIVE: The purpose of this study was to compare the error rates in breast imaging reports generated with automated speech recognition (ASR) technology as opposed to conventional dictation transcription. MATERIALS AND METHODS: Breast imaging reports reviewed from January 2009 to April 2010 during multidisciplinary tumor board meetings at two hospitals were scrutinized for minor and major errors. RESULTS: Of 615 reports obtained, 308 were generated with ASR and 307 with conventional dictation transcription. At least one major error was found in 23% of ASR reports, as opposed to 4% of conventional dictation transcription reports (p < 0.01). Major errors were more common in breast MRI reports (35% of ASR and 7% of conventional reports), the lowest error rates occurring in reports of interventional procedures (13% of ASR and 4% of conventional reports) and mammography reports (15% of ASR and no conventional reports) (p < 0.01). The error rates did not differ substantially between reports generated by staff radiologists and trainees or between reports generated by speakers who spoke English as their first language and those whose native language was not English. After adjustment for academic rank, native language, and imaging modality, reports generated with ASR were 8 times as likely as conventional dictation transcription reports to contain major errors (p < 0.01). CONCLUSION: Reports generated with ASR are associated with higher error rates than reports generated with conventional dictation transcription. The imaging modality used is a predictor of the occurrence of reporting errors. Conversely, native language and academic rank of the speaker do not have a significant influence on error rate.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Speech recognition for clinical documentation from 1990 to 2018: a systematic review
Blackley, S. V., Huynh, J., Wang, L., Korach, Z., & Zhou, L. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy179 · Cited by 97
Zhou, L., Blackley, S. V., Kowalski, L., Doan, R., Acker, W. W., Landman, A. B., Kontrient, E., Mack, D., Meteer, M., Bates, D. W., et al. (2018) · JAMA Network Open · doi:10.1001/jamanetworkopen.2018.0530 · Cited by 94
Improving Radiology Report Quality by Rapidly Notifying Radiologist of Report Errors
Minn, M. J., Zandieh, A. R., & Filice, R. W. (2015) · Journal of Digital Imaging · doi:10.1007/s10278-015-9781-9 · Cited by 37
Onitilo, A. A., Shour, A. R., Puthoff, D. S., Tanimu, Y., Joseph, A., & Sheehan, M. T. (2023) · PLOS ONE · doi:10.1371/journal.pone.0272545 · Cited by 21
“At least one study has found that a higher error rate is found in speech recognition than in traditional dictation [30].”
BackgroundA Speech-to-Text Interface for MammoClass
Rocha, R. S., Ferreira, P., Dutra, I., Correia, R., Salvini, R., & Burnside, E. (2016) · 2016 IEEE 29th International Symposium on Computer-Based Medical Systems (CBMS) · doi:10.1109/cbms.2016.25 · Cited by 6
Metadata
- Authors
- Basma, S., Lord, B., Jacks, L. M., Rizk, M., & Scaranelo, A. M.
- Venue
- American Journal of Roentgenology
- Publisher
- American Roentgen Ray Society
- Published
- 2011-10
- Volume
- 197
- Issue
- 4
- Pages
- 923-927
- ISSN
- 0002-9580 (ISSN-L)
- 0361-803X
- 1546-3141
- OpenAlex
- W1976253314
- Cited by
- 44
- References
- 0
- FWCI
- 1.15
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Error Rates in Breast Imaging Reports: Comparison of Automatic Speech Recognition and Dictation Transcription. https://app.cochat.ai/papers/10.2214/ajr.11.6691
- The paper
- Basma, S., Lord, B., Jacks, L. M., Rizk, M., & Scaranelo, A. M. (2011). Error Rates in Breast Imaging Reports: Comparison of Automatic Speech Recognition and Dictation Transcription. American Journal of Roentgenology. https://doi.org/10.2214/ajr.11.6691
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.