Comparing human and automatic speech recognition in simple and complex acoustic scenes
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Abstract Former comparisons of human speech recognition (HSR) and automatic speech recognition (ASR) have shown that humans outperform ASR systems in nearly all speech recognition tasks. However, recent progress in ASR has led to substantial improvements of recognition accuracy, and it is therefore unclear how large the task-dependent human-machine gap still remains. This paper investigates this gap between HSR and ASR based on deep neural networks (DNNs) in different acoustic conditions, with the aim of comparing differences and identifying processing strategies that should be considered in ASR. We find that DNN-based ASR reaches human performance for single-channel, small-vocabulary tasks in the presence of speech-shaped noise and in multi-talker babble noise, which is an important difference to previous human-machine comparisons: The speech reception threshold, i.e., the signal-to-noise ratio with 50% word recognition rate is at about −7 to −8 dB both for HSR and ASR. However, in more complex spatial scenes with diffuse noise and moving talkers, the SRT gap amounts to approximately 12 dB. Based on cross comparisons that use oracle knowledge (e.g., the speakers’ true position), incorrect responses are attributed to localization errors or missing pitch information to distinguish between speakers with different gender. In terms of the SRT, localization errors and missing spectral information amount to 2.1 and 3.2 dB, respectively. The comparison hence identifies specific components in ASR that can profit from learning from auditory signal processing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Davis, S., & Mermelstein, P. (1980) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1980.1163420 · Cited by 5,465
Toward Human Parity in Conversational Speech Recognition
Xiong, W., Droppo, J., Huang, X., Seide, F., Seltzer, M. L., Stolcke, A., Yu, D., & Zweig, G. (2017) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2017.2756440 · Cited by 245
Goldwater, S., Jurafsky, D., & Manning, C. D. (2010) · Speech Communication · doi:10.1016/j.specom.2009.10.001 · Cited by 166
Cited by
Artificial Intelligence in academic library strategy in the United Kingdom and the Mainland of China
Huang, Y., Cox, A. M., & Cox, J. (2023) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2023.102772 · Cited by 74
Evaluating the Efficiency of Voice Control as Human Machine Interface in Production
Norda, M., Engel, C., Rennies, J., Appell, J.-E., Lange, S. C., & Hahn, A. (2024) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2023.3302951 · Cited by 26
“Modern common ASR systems can usually reach up to 90 % recognition accuracy [20], or even up to 100 % in specific scenarios, mainly depending on the prevailing signal to noise ratio (SNR) [33].”
BackgroundAll-in-One Transformer: Unifying Speech Recognition, Audio Tagging, and Event Detection
Moritz, N., Wichern, G., Hori, T., & Roux, J. L. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-2757 · Cited by 20
Metadata
- Authors
- Spille, C., Kollmeier, B., & Meyer, B. T.
- Venue
- Computer Speech & Language
- Publisher
- Elsevier BV
- Published
- 2018-11
- Volume
- 52
- Pages
- 123-140
- ISSN
- 0885-2308 (ISSN-L)
- OpenAlex
- W2801659857
- Cited by
- 47
- References
- 4
- FWCI
- 2.40
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Comparing human and automatic speech recognition in simple and complex acoustic scenes. https://app.cochat.ai/papers/10.1016/j.csl.2018.04.003
- The paper
- Spille, C., Kollmeier, B., & Meyer, B. T. (2018). Comparing human and automatic speech recognition in simple and complex acoustic scenes. Computer Speech & Language. https://doi.org/10.1016/j.csl.2018.04.003
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.