The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
A post-processing system to yield reduced word error rates: Recognizer Output Voting Error Reduction (ROVER)
Abstract
Describes a system developed at NIST to produce a composite automatic speech recognition (ASR) system output when the outputs of multiple ASR systems are available, and for which, in many cases, the composite ASR output has a lower error rate than any of the individual systems. The system implements a "voting" or rescoring process to reconcile differences in ASR system outputs. We refer to this system as the NIST Recognizer Output Voting Error Reduction (ROVER) system. As additional knowledge sources are added to an ASR system (e.g. acoustic and language models), error rates are typically decreased. This paper describes a post-recognition process which models the output generated by multiple ASR systems as independent knowledge sources that can be combined and used to generate an output with reduced error rate. To accomplish this, the outputs of multiple of ASR systems are combined into a single, minimal-cost word transition network (WTN) via iterative applications of dynamic programming (DP) alignments. The resulting network is searched by an automatic rescoring or "voting" process that selects the output sequence with the lowest score.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Tools for the analysis of benchmark speech recognition tests
Pallett, D. S., Fisher, W. M., & Fiscus, J. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1990.115546 · Cited by 132
Self-citation
Cited by
SRILM - an extensible language modeling toolkit
Stolcke, A. (2002) · 7th International Conference on Spoken Language Processing (ICSLP 2002) · doi:10.21437/icslp.2002-303 · Cited by 4,326
Weighted finite-state transducers in speech recognition
Mohri, M., Pereira, F., & Riley, M. (2002) · Computer Speech & Language · doi:10.1006/csla.2001.0184 · Cited by 885
Schuller, B., Batliner, A., Steidl, S., & Seppi, D. (2011) · Speech Communication · doi:10.1016/j.specom.2011.01.011 · Cited by 758
Mangu, L., Brill, E., & Stolcke, A. (2000) · Computer Speech & Language · doi:10.1006/csla.2000.0152 · Cited by 646
The Application of Hidden Markov Models in Speech Recognition
Gales, M., & Young, S. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601981219 · Cited by 557
Automatic speech recognition and speech variability: A review
Benzeghiba, M., De Mori, R., Deroo, O., Dupont, S., Erbes, T., Jouvet, D., Fissore, L., Laface, P., Mertins, A., Ris, C., et al. (2007) · Speech Communication · doi:10.1016/j.specom.2007.02.006 · Cited by 529
Continuous space language models
Schwenk, H. (2007) · Computer Speech & Language · doi:10.1016/j.csl.2006.09.003 · Cited by 516
The NIST speaker recognition evaluation – Overview, methodology, systems, results, perspective
Doddington, G. R., Przybocki, M. A., Martin, A. F., & Reynolds, D. A. (2000) · Speech Communication · doi:10.1016/s0167-6393(99)00080-1 · Cited by 365
A review of speaker diarization: Recent advances with deep learning
Park, T. J., Kanda, N., Dimitriadis, D., Han, K. J., Watanabe, S., & Narayanan, S. (2022) · Computer Speech & Language · doi:10.1016/j.csl.2021.101317 · Cited by 354
An analysis of environment, microphone and data simulation mismatches in robust speech recognition
Vincent, E., Watanabe, S., Nugraha, A. A., Barker, J., & Marxer, R. (2017) · Computer Speech & Language · doi:10.1016/j.csl.2016.11.005 · Cited by 351
Toward Human Parity in Conversational Speech Recognition
Xiong, W., Droppo, J., Huang, X., Seide, F., Seltzer, M. L., Stolcke, A., Yu, D., & Zweig, G. (2017) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2017.2756440 · Cited by 245
“While ensemble classifier methods have long been popular in speech recognition systems [40]–”
MethodCombining Efforts for Improving Automatic Classification of Emotional User States
Batliner, A., Steidl, S., Schuller, B., Seppi, D., Laskowski, K., Vogt, T., Devillers, L., Vidrascu, L., Amir, N., Kessous, L., et al. (2006) · Jožef Stefan Institute, Ljubljana · doi:10.5281/zenodo.14167504 · Cited by 119
Automatic detection of articulation disorders in children with cleft lip and palate
Maier, A., Hönig, F., Bocklet, T., Nöth, E., Stelzle, F., Nkenke, E., & Schuster, M. (2009) · The Journal of the Acoustical Society of America · doi:10.1121/1.3216913 · Cited by 71
Lecouteux, B., Vacher, M., & Portet, F. (2011) · Interspeech 2011 · doi:10.21437/interspeech.2011-604 · Cited by 58
“At the ASR combination level, a ROVER [11] was applied.”
Influential“Automatic spontaneous speech grading: a novel feature derivation technique using the crowd,”
Shashidhar, V., Pandey, N., & Aggarwal, V. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1105 · Cited by 24
Metadata
- Authors
- Fiscus, J. G.
- Venue
- 1997 IEEE Workshop on Automatic Speech Recognition and Understanding Proceedings
- Publisher
- IEEE
- Published
- 2002-11-23
- Pages
- 347-354
- OpenAlex
- W1904457459
- Cited by
- 1,091
- References
- 1
- FWCI
- 31.81
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.