Achieving Human Parity in Conversational Speech Recognition
Open accessThe DOI matches its OpenAlex record; 54 of the 54 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Recurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390 · cited 2×
“Surprisingly, this is the case for both acoustic modeling [28, 29, 30, 31, 32, 33] and language modeling [34, 35, 36, 37].”
BackgroundA Learning Algorithm for Continually Running Fully Recurrent Neural Networks
Williams, R. J., & Zipser, D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.2.270 · Cited by 4,369 · cited 1×
“While the basic structures have been well known for a long period [21, 22, 23, 24, 25, 26, 27], it is only recently that they have dominated the field as the best models for speech recognition.”
BackgroundSRILM - an extensible language modeling toolkit
Stolcke, A. (2002) · 7th International Conference on Spoken Language Processing (ICSLP 2002) · doi:10.21437/icslp.2002-303 · Cited by 4,326
Self-citationNoise-contrastive estimation: A new estimation principle for unnormalized statistical models
Gutmann, M. U., & Hyvärinen, A. (2010) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 3,010
Phoneme recognition using time-delay neural networks
Waibel, A., Hanazawa, T., Hinton, G., Shikano, K., & Lang, K. J. (1989) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/29.21701 · Cited by 2,643 · cited 4×
“While the basic structures have been well known for a long period [21, 22, 23, 24, 25, 26, 27], it is only recently that they have dominated the field as the best models for speech recognition.”
BackgroundMethodInfluentialSWITCHBOARD: telephone speech corpus for research and development
Godfrey, J. J., Holliman, E. C., & McDaniel, J. (1992) · [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1992.225858 · Cited by 2,134 · cited 17×
“The 500-best lists from the lattices generated with the ResNet CNN system had an oracle (lowest achievable) WER of 2.7% on the Switchboard portion of the NIST 2000 evaluation set, and an oracle WER of 4.9% on the CallHome portion.”
BackgroundInfluentialDeep Speech 2: End-to-End Speech Recognition in English and Mandarin
Amodei, D., Anubhai, R., Battenberg, E., Case, C. T., Casper, J., Catanzaro, B., Chen, J., Chrzanowski, M., Coates, A., Diamos, G., et al. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.02595 · Cited by 2,110
Learning deep structured semantic models for web search using clickthrough data
Huang, P.-S., He, X., Gao, J., Deng, L., Acero, A., & Heck, L. (2013) · Proceedings of the 22nd ACM international conference on Information & Knowledge Management · doi:10.1145/2505515.2505665 · Cited by 2,009
LSTM neural networks for language modeling
Sundermeyer, M., Schlüter, R., & Ney, H. (2012) · Interspeech 2012 · doi:10.21437/interspeech.2012-65 · Cited by 1,963
The design for the wall street journal-based CSR corpus
Paul, D. B., & Baker, J. M. (1992) · Proceedings of the workshop on Speech and Natural Language - HLT '91 · doi:10.3115/1075527.1075614 · Cited by 1,099
Deep convolutional neural networks for LVCSR
Sainath, T. N., Mohamed, A.-R., Kingsbury, B., & Ramabhadran, B. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639347 · Cited by 1,053
Generalization of back-propagation to recurrent neural networks
Pineda, F. J. (1987) · Physical Review Letters · doi:10.1103/physrevlett.59.2229 · Cited by 931 · cited 1×
“While the basic structures have been well known for a long period [21, 22, 23, 24, 25, 26, 27], it is only recently that they have dominated the field as the best models for speech recognition.”
BackgroundSrivastava, R. K., Greff, K., & Schmidhuber, J. (2015) · arXiv · doi:10.48550/arxiv.1505.00387 · Cited by 912
Applying Convolutional Neural Networks concepts to hybrid NN-HMM model for speech recognition
Abdel-Hamid, O., Mohamed, A.-R., Jiang, H., & Penn, G. (2012) · 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2012.6288864 · Cited by 876
Conversational speech transcription using context-dependent deep neural networks
Seide, F., Li, G., & Yu, D. (2011) · Interspeech 2011 · doi:10.21437/interspeech.2011-169 · Cited by 852
Self-citationPurely Sequence-Trained Neural Networks for ASR Based on Lattice-Free MMI
Povey, D., Peddinti, V., Galvez, D., Ghahremani, P., Manohar, V., Na, X., Wang, Y., & Khudanpur, S. (2016) · Interspeech 2016 · doi:10.21437/interspeech.2016-595 · Cited by 740
Sequence-discriminative training of deep neural networks
Veselý, K., Ghoshal, A., Burget, L., & Povey, D. (2013) · Interspeech 2013 · doi:10.21437/interspeech.2013-548 · Cited by 657
Using the Output Embedding to Improve Language Models
Press, O., & Wolf, L. (2017) · Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers · doi:10.18653/v1/e17-2025 · Cited by 596
Speaker adaptation of neural network acoustic models using i-vectors
Saon, G., Soltau, H., Nahamoo, D., & Picheny, M. (2013) · 2013 IEEE Workshop on Automatic Speech Recognition and Understanding · doi:10.1109/asru.2013.6707705 · Cited by 577
Context dependent recurrent neural network language model
Mikolov, T., & Zweig, G. (2012) · 2012 IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2012.6424228 · Cited by 560
Self-citationSpeech recognition by machines and humans
Lippmann, R. P. (1997) · Speech Communication · doi:10.1016/s0167-6393(97)00021-6 · Cited by 529
The Fisher Corpus: a Resource for the Next Generations of Speech-to-Text
Cieri, C., Miller, D. A. B., & Walker, K. P. (2004) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/5q862povzthr · Cited by 464
Seide, F., Fu, H., Droppo, J., Li, G., & Yu, D. (2014) · Interspeech 2014 · doi:10.21437/interspeech.2014-274 · Cited by 443
Self-citationFast and accurate recurrent neural network acoustic models for speech recognition
Sak, H., Senior, A., Rao, K., & Beaufays, F. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-350 · Cited by 385
An Introduction to Computational Networks and the Computational Network Toolkit
Yu, D., Eversole, A., Seltzer, M., Yao, K., Kuchaiev, O., Zhang, Y., Seide, F. T. B., Huang, Z., Guenter, B. K., Wang, H., et al. (2014) · Cited by 365
Self-citationVery Deep Convolutional Neural Networks for Noise Robust Speech Recognition
Qian, Y., Bi, M., Tan, T., & Yu, K. (2016) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2016.2602884 · Cited by 343
The DARPA 1000-word resource management database for continuous speech recognition
Price, P., Fisher, W. M., Bernstein, J., & Pallett, D. S. (2003) · ICASSP-88., International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1988.196669 · Cited by 341
Very deep multilingual convolutional neural networks for LVCSR
Sercu, T., Puhrsch, C., Kingsbury, B., & LeCun, Y. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472620 · Cited by 205
Super-human multi-talker speech recognition: A graphical modeling approach
Hershey, J. R., Rennie, S. J., Olsen, P. A., & Kristjansson, T. T. (2010) · Computer Speech & Language · doi:10.1016/j.csl.2008.11.001 · Cited by 166
Consonant recognition by modular construction of large phonemic time-delay neural networks
Waibel, A., Sawai, H., & Shikano, K. (2003) · International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1989.266376 · Cited by 153
THE SRI MARCH 2000 HUB-5 CONVERSATIONAL SPEECH TRANSCRIPTION SYSTEM
Stolcke, A., Bratt, H., Butzberger, J., Franco, H., Gadde, V. R. R., Richey, C., Shriberg, E. E., Weng, F. Y., & Zheng, J. (2000) · Cited by 145
Self-citationA recurrent error propagation network speech recognition system
Robinson, T., & Fallside, F. (1991) · Computer Speech & Language · doi:10.1016/0885-2308(91)90010-n · Cited by 140
Advances in speech transcription at IBM under the DARPA EARS program
Chen, S. F., Kingsbury, B., Mangu, L., Povey, D., Saon, G., Soltau, H., & Zweig, G. (2006) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tasl.2006.879814 · Cited by 125
Self-citationThe IBM 2015 English conversational telephone speech recognition system
Saon, G., Kuo, H.-K. J., Rennie, S., & Picheny, M. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-632 · Cited by 91
Recent innovations in speech-to-text transcription at SRI-ICSI-UW
Stolcke, A., Chen, B., Franco, H., Gadde, V. R. R., Graciarena, M., Hwang, M.-Y., Kirchhoff, K., Mandal, A., Morgan, N., Lei, X., et al. (2006) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tasl.2006.879807 · Cited by 86
Self-citationDeep Convolutional Neural Networks with Layer-Wise Context Expansion and Attention
Yu, D., Xiong, W., Droppo, J., Stolcke, A., Ye, G., Li, J., & Zweig, G. (2016) · Interspeech 2016 · doi:10.21437/interspeech.2016-251 · Cited by 83
Self-citationA look at NIST'S benchmark ASR tests: past, present, and future
Pallett, D. S. (2004) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2003.1318488 · Cited by 77
Chen, X., Liu, X., Qian, Y., Gales, M. J. F., & Woodland, P. C. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472829 · Cited by 77
Matsoukas, S., Gauvain, J.-L., Adda, G., Colthurst, T., Kao, C.-L., Kimball, O., Lamel, L. F., Lefèvre, F., Ma, J. Z., Makhoul, J., et al. (2006) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2006.878257 · Cited by 55
Development of the 2003 CU-HTK conversational telephone speech transcription system
Evermann, G., Chan, H. Y., Gales, M. J. F., Hain, T., Liu, X., Mrva, D., Wang, L., & Woodland, P. C. (2004) · 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.2004.1325969 · Cited by 53
Very deep convolutional neural networks for LVCSR
Bi, M., Qian, Y., & Yu, K. (2015) · Interspeech (USB) · doi:10.21437/interspeech.2015-656 · Cited by 46
Efficient estimation of maximum entropy language models with n-gram features: an SRILM extension
Alumäe, T., & Kurimo, M. (2010) · Interspeech (USB) · doi:10.21437/interspeech.2010-519 · Cited by 43
Conversational telephone speech recognition
Gauvain, J.-L., Lamel, L. F., Schwenk, H., Adda, G., Chen, L., & Lefèvre, F. (2003) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2003.1198755 · Cited by 43
Single-channel mixed speech recognition using deep neural networks
Weng, C., Yu, D., Seltzer, M. L., & Droppo, J. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6854681 · Cited by 38
Self-citationStimulated Deep Neural Network for Speech Recognition
Wu, C., Karanasou, P., Gales, M., & Sim, K. C. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-580 · Cited by 37
Improving English Conversational Telephone Speech Recognition
Medennikov, I., Prudnikov, A., & Zatvornitskiy, A. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-473 · Cited by 20
Linearly augmented deep neural network
Ghahremani, P., Droppo, J., & Seltzer, M. L. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472646 · Cited by 19
Self-citationParallelizing WFST speech decoders
Mendis, C., Droppo, J., Maleki, S., Musuvathi, M., Mytkowicz, T., & Zweig, G. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472694 · Cited by 12
Self-citationSelf-stabilized deep neural network
Ghahremani, P., & Droppo, J. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472719 · Cited by 8
Self-citation(2014) · doi:10.4230/oasics.slate.2021.16 · Cited by 1
Cited by
On calibration of modern neural networks
Guo, C., Pleiss, G., Sun, Y., & Weinberger, K. Q. (2017) · arXiv · doi:10.48550/arxiv.1706.04599 · Cited by 3,435
“guage model in speech recognition (Hannun et al., 2014; Xiong et al., 2016), or with camera information for object detection (Kendall & Cipolla, 2016).”
MethodOpportunities and obstacles for deep learning in biology and medicine
Ching, T., Himmelstein, D. S., Beaulieu-Jones, B. K., Kalinin, A. A., Do, B. T., Way, G. P., Ferrero, E., Agapow, P.-M., Zietz, M., Hoffman, M. M., et al. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0387 · Cited by 2,310
DeepXplore: Automated Whitebox Testing of Deep Learning Systems
Pei, K., Cao, Y., Yang, J., & Jana, S. (2017) · Proceedings of the 26th Symposium on Operating Systems Principles · doi:10.1145/3132747.3132785 · Cited by 1,217
Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoning
Chen, X., Liu, C., Li, B., Lu, K., & Song, D. (2017) · arXiv · doi:10.48550/arxiv.1712.05526 · Cited by 1,039
“Deep learning has led to tremendous success in various fields, such as image classification, speech recognition, and game playing [32], [69], [60].”
BackgroundKolbaek, M., Yu, D., Tan, Z.-H., & Jensen, J. (2017) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2017.2726762 · Cited by 820
Self-citation
Metadata
- Authors
- Xiong, W., Droppo, J., Huang, X., Seide, F. T. B., Seltzer, M., Stolcke, A., Yu, D., & Zweig, G.
- Venue
- arXiv (Cornell University)
- Publisher
- Cornell University
- Published
- 2016-10-17
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1610.05256
- OpenAlex
- W2533523411
- Cited by
- 451
- References
- 54
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.