The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
The microsoft 2016 conversational speech recognition system
Open accessAbstract
We describe Microsoft's conversational speech recognition system, in which we combine recent developments in neural-network-based acoustic and language modeling to advance the state of the art on the Switchboard recognition task. Inspired by machine learning ensemble techniques, the system uses a range of convolutional and recurrent neural networks. I-vector modeling and lattice-free MMI training provide significant gains for all acoustic model architectures. Language model rescoring with multiple forward and backward running RNNLMs, and word posterior-based system combination provide a 20% boost. The best single system uses a ResNet architecture acoustic model with RNNLM rescoring, and achieves a word error rate of 6.9% on the NIST 2000 Switchboard task. The combined system has an error rate of 6.2%, representing an improvement over previously reported results on this benchmark task.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“which is comparable to state-of-the-art speech recognition systems (e.g. word error rates of 4–5% 14,15), putting it well within the range of usability.”
From High-performance brain-to-text communication via handwriting (2021) · cites this paper as [14]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891
Framewise phoneme classification with bidirectional LSTM and other neural network architectures
Graves, A., & Schmidhuber, J. (2005) · Neural Networks · doi:10.1016/j.neunet.2005.06.042 · Cited by 5,839
Recurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390 · cited 3×
“2, 3, 4, 5, 6, 7], it is only recently that they have emerged as the best models for speech recognition. Surprisingly, this is the case for both acoustic modeling [8, 9, 10, 11] and language modeling [12, 13]. In comparison to standard feed-forward MLPs or DNNs, these acoustic models have the ability to model a large…”
BackgroundMethodInfluentialA Learning Algorithm for Continually Running Fully Recurrent Neural Networks
Williams, R. J., & Zipser, D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.2.270 · Cited by 4,369 · cited 1×
“While the basic structures have been well known for a long period [1, 2, 3, 4, 5, 6, 7], it is only recently that they have emerged as the best models for speech recognition.”
BackgroundSRILM - an extensible language modeling toolkit
Stolcke, A. (2002) · 7th International Conference on Spoken Language Processing (ICSLP 2002) · doi:10.21437/icslp.2002-303 · Cited by 4,326
Self-citationConvolutional networks for images, speech, and time series
LeCun, Y., & Bengio, Y. (1998) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.5555/303568.303704 · Cited by 4,231
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.03385 · Cited by 4,196
Front-End Factor Analysis for Speaker Verification
Dehak, N., Kenny, P. J., Dehak, R., Dumouchel, P., & Ouellet, P. (2011) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2010.2064307 · Cited by 3,549
Noise-contrastive estimation: A new estimation principle for unnormalized statistical models
Gutmann, M. U., & Hyvärinen, A. (2010) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 2,992
Long short-term memory recurrent neural network architectures for large scale acoustic modeling
Sak, H., Senior, A., & Beaufays, F. (2014) · Interspeech 2014 · doi:10.21437/interspeech.2014-80 · Cited by 2,973
Linguistic Regularities in Continuous Space Word Representations
Mikolov, T., Yih, W.-T., & Zweig, G. (2013) · North American Chapter of the Association for Computational Linguistics · Cited by 2,912
Self-citationDeep convolutional neural networks for LVCSR
Sainath, T. N., Mohamed, A.-R., Kingsbury, B., & Ramabhadran, B. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639347 · Cited by 1,053
Generalization of back-propagation to recurrent neural networks
Pineda, F. J. (1987) · Physical Review Letters · doi:10.1103/physrevlett.59.2229 · Cited by 931 · cited 1×
“While the basic structures have been well known for a long period [1, 2, 3, 4, 5, 6, 7], it is only recently that they have emerged as the best models for speech recognition.”
BackgroundSrivastava, R. K., Greff, K., & Schmidhuber, J. (2015) · arXiv · doi:10.48550/arxiv.1505.00387 · Cited by 912
Applying Convolutional Neural Networks concepts to hybrid NN-HMM model for speech recognition
Abdel-Hamid, O., Mohamed, A.-R., Jiang, H., & Penn, G. (2012) · 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2012.6288864 · Cited by 876
Purely Sequence-Trained Neural Networks for ASR Based on Lattice-Free MMI
Povey, D., Peddinti, V., Galvez, D., Ghahremani, P., Manohar, V., Na, X., Wang, Y., & Khudanpur, S. (2016) · Interspeech 2016 · doi:10.21437/interspeech.2016-595 · Cited by 740
Sequence-discriminative training of deep neural networks
Veselý, K., Ghoshal, A., Burget, L., & Povey, D. (2013) · Interspeech 2013 · doi:10.21437/interspeech.2013-548 · Cited by 657
Speaker adaptation of neural network acoustic models using i-vectors
Saon, G., Soltau, H., Nahamoo, D., & Picheny, M. (2013) · 2013 IEEE Workshop on Automatic Speech Recognition and Understanding · doi:10.1109/asru.2013.6707705 · Cited by 577
Context dependent recurrent neural network language model
Mikolov, T., & Zweig, G. (2012) · 2012 IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2012.6424228 · Cited by 560
Self-citationAchieving Human Parity in Conversational Speech Recognition
Xiong, W., Droppo, J., Huang, X., Seide, F. T. B., Seltzer, M., Stolcke, A., Yu, D., & Zweig, G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.05256 · Cited by 451
Self-citationSeide, F., Fu, H., Droppo, J., Li, G., & Yu, D. (2014) · Interspeech 2014 · doi:10.21437/interspeech.2014-274 · Cited by 443
Self-citationFast and accurate recurrent neural network acoustic models for speech recognition
Sak, H., Senior, A., Rao, K., & Beaufays, F. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-350 · Cited by 385
Very Deep Convolutional Neural Networks for Noise Robust Speech Recognition
Qian, Y., Bi, M., Tan, T., & Yu, K. (2016) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2016.2602884 · Cited by 343
An Introduction to Computational Networks and the Computational Network Toolkit
Yu, D., Eversole, A., Seltzer, M., Yao, K., Kuchaiev, O., Zhang, Y., Seide, F. T. B., Huang, Z., Guenter, B. K., Wang, H., et al. (2014) · Cited by 332
Self-citationPhoneme Recognition Using Time-Delay Neural Networks
WAIBEL, A., HANAZAWA, T., HINTON, G., SHIKANO, K., & LANG, K. J. (1990) · Readings in Speech Recognition · doi:10.1016/b978-0-08-051584-7.50037-1 · Cited by 302
Toward Human Parity in Conversational Speech Recognition
Xiong, W., Droppo, J., Huang, X., Seide, F., Seltzer, M. L., Stolcke, A., Yu, D., & Zweig, G. (2017) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2017.2756440 · Cited by 245
Self-citationVery deep multilingual convolutional neural networks for LVCSR
Sercu, T., Puhrsch, C., Kingsbury, B., & LeCun, Y. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472620 · Cited by 205
Consonant recognition by modular construction of large phonemic time-delay neural networks
Waibel, A. H., Sawai, H., & Shikano, K. (2003) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1989.266376 · Cited by 153
THE SRI MARCH 2000 HUB-5 CONVERSATIONAL SPEECH TRANSCRIPTION SYSTEM
Stolcke, A., Bratt, H., Butzberger, J., Franco, H., Gadde, V. R. R., Richey, C., Shriberg, E. E., Weng, F. Y., & Zheng, J. (2000) · Cited by 145
Self-citationA recurrent error propagation network speech recognition system
Robinson, T., & Fallside, F. (1991) · Computer Speech & Language · doi:10.1016/0885-2308(91)90010-n · Cited by 140
Advances in speech transcription at IBM under the DARPA EARS program
Chen, S. F., Kingsbury, B. E. D., Mangu, L., Povey, D., Saon, G., Soltau, H., & Zweig, G. (2006) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2006.879814 · Cited by 125
Self-citationThe IBM 2015 English conversational telephone speech recognition system
Saon, G., Kuo, H.-K. J., Rennie, S. J., & Picheny, M. (2015) · Interspeech (USB) · doi:10.21437/interspeech.2015-632 · Cited by 122
The IBM 2016 English Conversational Telephone Speech Recognition System
Saon, G., Sercu, T., Rennie, S. J., & Kuo, H.-K. J. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-1460 · Cited by 106
Chen, X., Liu, X., Qian, Y., Gales, M., & Woodland, P. C. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472829 · Cited by 83
Deep Convolutional Neural Networks with Layer-Wise Context Expansion and Attention
Yu, D., Xiong, W., Droppo, J., Stolcke, A., Ye, G., Li, J., & Zweig, G. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-251 · Cited by 82
Self-citationConsonant Recognition by Modular Construction of Large Phonemic Time-Delay Neural Networks
Waibel, A., Sawai, H., & Shikano, K. (1990) · Elsevier eBooks · doi:10.1016/b978-0-08-051584-7.50038-3 · Cited by 58
Very deep convolutional neural networks for LVCSR
Bi, M., Qian, Y., & Yu, K. (2015) · Interspeech (USB) · doi:10.21437/interspeech.2015-656 · Cited by 46
Efficient estimation of maximum entropy language models with n-gram features: an SRILM extension
Alumäe, T., & Kurimo, M. (2010) · Interspeech (USB) · doi:10.21437/interspeech.2010-519 · Cited by 43
Sequential classification criteria for NNs in automatic speech recognition
Wang, G., & Sim, K. C. (2011) · Interspeech (USB) · doi:10.21437/interspeech.2011-170 · Cited by 21
Linearly augmented deep neural network
Ghahremani, P., Droppo, J., & Seltzer, M. L. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472646 · Cited by 19
Self-citationParallelizing WFST speech decoders
Mendis, C., Droppo, J., Maleki, S., Musuvathi, M., Mytkowicz, T., & Zweig, G. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472694 · Cited by 12
Self-citation(2014) · doi:10.4230/oasics.slate.2021.16 · Cited by 1
Research works printed but not linked: 7
- chen, 2016, ICASSP, 6000
- mendis, 2016, ICASSP, 5325
- sercu, 2016, ICASSP, 4955
- waibel, 1989, ICASSP, 112
- ghahremani, 2016, ICASSP, 5085
- abdel-hamid, 2012, ICASSP, 4277
- sainath, 2013, ICA SSP, 8614
Cited by
Aggregated Residual Transformations for Deep Neural Networks
Xie, S., Girshick, R., Dollar, P., Tu, Z., & He, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.634 · Cited by 12,465
Wang, X., Girshick, R., Gupta, A., & He, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00813 · Cited by 11,596
“, non-recurrent) networks for modeling sequences in speech and language [36, 54, 15].”
BackgroundDeepXplore: Automated Whitebox Testing of Deep Learning Systems
Pei, K., Cao, Y., Yang, J., & Jana, S. (2017) · Proceedings of the 26th Symposium on Operating Systems Principles · doi:10.1145/3132747.3132785 · Cited by 1,217
High-performance brain-to-text communication via handwriting
Willett, F. R., Avansino, D. T., Hochberg, L. R., Henderson, J. M., & Shenoy, K. V. (2021) · Nature · doi:10.1038/s41586-021-03506-2 · Cited by 1,024
Convolutional neural network for earthquake detection and location
Perol, T., Gharbi, M., & Denolle, M. (2018) · Science Advances · doi:10.1126/sciadv.1700578 · Cited by 921
Metadata
- Authors
- Xiong, W., Droppo, J., Huang, X., Seide, F., Seltzer, M., Stolcke, A., Yu, D., & Zweig, G.
- Affiliations
- Microsoft (United States) (US)
- Venue
- 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
- Publisher
- IEEE
- Published
- 2017-03
- Pages
- 5255-5259
- ISSN
- 1520-6149 (ISSN-L)
- OpenAlex
- W2519224033
- Cited by
- 326
- References
- 46
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 7 · 2023: 15 · 2022: 17 · 2021: 36 · 2020: 40 · 2019: 57 · 2018: 102 · 2017: 44
- FWCI
- 30.31
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE International Conference on Acoustics Speech and Signal Processing (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- conversational speech recognition, Switchboard corpus, recurrent neural networks, convolutional neural networks, i-vectors, ResNet, word error rate
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.