The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Convolutional Neural Networks for Distant Speech Recognition
Open accessAbstract
We investigate convolutional neural networks (CNNs) for large vocabulary distant speech recognition, trained using speech recorded from a single distant microphone (SDM) and multiple distant microphones (MDM). In the MDM case we explore a beamformed signal input representation compared with the direct use of multiple acoustic channels as a parallel input to the CNN. We have explored different weight sharing approaches, and propose a channel-wise convolution with two-way pooling. Our experiments, using the AMI meeting corpus, found that CNNs improve the word error rate (WER) by 6.5% relative compared to conventional deep neural network (DNN) models and 15.7% over a discriminatively trained Gaussian mixture model (GMM) baseline. For cross-channel CNN training, the WER improves by 3.5% relative over the comparable DNN structure. Compared with the best beamformed GMM system, cross-channel convolution reduces the WER by 9.7% relative, and matches the accuracy of a beamformed DNN.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Kaldi Speech Recognition Toolkit
Povey, D. (2024) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · doi:10.57702/jb3fvbn9 · Cited by 4,609
Convolutional networks for images, speech, and time series
LeCun, Y., & Bengio, Y. (1998) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.5555/303568.303704 · Cited by 4,231
The Handbook of brain theory and neural networks
(1996) · Choice Reviews Online · doi:10.5860/choice.33-4484 · Cited by 3,870
Hierarchical models of object recognition in cortex
Riesenhuber, M., & Poggio, T. (1999) · Nature Neuroscience · doi:10.1038/14819 · Cited by 3,309
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011 · cited 1×
“tended the state-of-the-art in acoustic modelling for automatic speech recognition (ASR), using both hybrid configurations [6]–[11] in which the neural network is used to estimate hidden Markov model (HMM) output probabilities and posteriorgram configurations [12]–[15] in which the neural network provides discriminati…”
MethodPhoneme recognition using time-delay neural networks
Waibel, A., Hanazawa, T., Hinton, G., Shikano, K., & Lang, K. J. (1989) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/29.21701 · Cited by 2,643
An empirical study of smoothing techniques for language modeling
Chen, S. F., & Goodman, J. (1999) · Computer Speech & Language · doi:10.1006/csla.1999.0128 · Cited by 2,066
Connectionist Speech Recognition: A Hybrid Approach
Bourlard, H. A., & Morgan, N. H. (1993) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 1,115
Unsupervised Learning of Invariant Feature Hierarchies with Applications to Object Recognition
Ranzato, M., Huang, F. J., Boureau, Y.-L., & LeCun, Y. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383157 · Cited by 1,086
Deep convolutional neural networks for LVCSR
Sainath, T. N., Mohamed, A.-R., Kingsbury, B., & Ramabhadran, B. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639347 · Cited by 1,053
Neural Network Classifiers Estimate Bayesian a posteriori Probabilities
Richard, M. D., & Lippmann, R. P. (1991) · Neural Computation · doi:10.1162/neco.1991.3.4.461 · Cited by 986
(2009) · neural information processing systems · Cited by 962
Applying Convolutional Neural Networks concepts to hybrid NN-HMM model for speech recognition
Abdel-Hamid, O., Mohamed, A.-R., Jiang, H., & Penn, G. (2012) · 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2012.6288864 · Cited by 876
Tandem connectionist feature extraction for conventional HMM systems
Hermansky, H., Ellis, D. P. W., & Sharma, S. (2002) · 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100) · doi:10.1109/icassp.2000.862024 · Cited by 693
A time-delay neural network architecture for isolated word recognition
Lang, K. J., Waibel, A. H., & Hinton, G. E. (1990) · Neural Networks · doi:10.1016/0893-6080(90)90044-l · Cited by 596
Connectionist Speech Recognition
Bourlard, H. A., & Morgan, N. (1994) · Springer eBooks · doi:10.1007/978-1-4615-3210-1 · Cited by 585
Semi-tied covariance matrices for hidden Markov models
Gales, M. J. F. (1999) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.759034 · Cited by 537
Acoustic Beamforming for Speaker Diarization of Meetings
Anguera, X., Wooters, C., & Hernando, J. (2007) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tasl.2007.902460 · Cited by 397
Unleashing the killer corpus: experiences in creating the multi-everything AMI Meeting Corpus
Carletta, J. (2007) · Language Resources and Evaluation · doi:10.1007/s10579-007-9040-x · Cited by 359
Boosted MMI for model and feature-space discriminative training
Povey, D., Kanevsky, D., Kingsbury, B., Ramabhadran, B., Saon, G., & Visweswariah, K. (2008) · 2008 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2008.4518545 · Cited by 341
Probabilistic and Bottle-Neck Features for LVCSR of Meetings
Grezl, F., Karafiat, M., Kontar, S., & Cernocky, J. (2007) · 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07 · doi:10.1109/icassp.2007.367023 · Cited by 340
(2009) · Wiley eBooks · Cited by 321
Improvements to Deep Convolutional Neural Networks for LVCSR
Sainath, T. N., Kingsbury, B., Mohamed, A.-R., Dahl, G. E., Saon, G., Soltau, H., Beran, T., Aravkin, A. Y., & Ramabhadran, B. (2013) · 2013 IEEE Workshop on Automatic Speech Recognition and Understanding · doi:10.1109/asru.2013.6707749 · Cited by 243
Wölfel, M., & McDonough, J. (2009) · Wiley eBooks · doi:10.1002/9780470714089 · Cited by 240
Connectionist probability estimators in HMM speech recognition
Renals, S., Morgan, N., Bourlard, H., Cohen, M., & Franco, H. (1994) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.260359 · Cited by 228
Self-citationMaking Deep Belief Networks effective for large vocabulary continuous speech recognition
Sainath, T. N., Kingsbury, B., Ramabhadran, B., Fousek, P., Novak, P., & Mohamed, A.-R. (2011) · 2011 IEEE Workshop on Automatic Speech Recognition & Understanding · doi:10.1109/asru.2011.6163900 · Cited by 189
Palaz, D., Collobert, R., & Magimai-Doss, M. (2013) · Interspeech 2013 · doi:10.21437/interspeech.2013-438 · Cited by 185
Auto-encoder bottleneck features using deep belief networks
Sainath, T. N., Kingsbury, B., & Ramabhadran, B. (2012) · 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2012.6288833 · Cited by 182
Pylearn2: a machine learning research library
Goodfellow, I., Warde-Farley, D., Lamblin, P., Dumoulin, V., Mirza, M., Pascanu, R., Bergstra, J., Bastien, F., & Bengio, Y. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1308.4214 · Cited by 180
Neural networks for statistical recognition of continuous speech
Morgan, N., & Bourlard, H. A. (1995) · Proceedings of the IEEE · doi:10.1109/5.381844 · Cited by 144
Kumatani, K., McDonough, J. W., & Raj, B. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205285 · Cited by 123
Improving wideband speech recognition using mixed-bandwidth training data in CD-DNN-HMM
Li, J., Yu, D., Huang, J.-T., & Gong, Y. (2012) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2012.6424210 · Cited by 114
Transcribing Meetings With the AMIDA Systems
Hain, T., Burget, L., Dines, J., Garner, P. N., Grézl, F., Hannani, A. E., Huijbregts, M., Karafiát, M., Lincoln, M., & Wan, V. (2011) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2163395 · Cited by 114
Hybrid acoustic models for distant and multichannel large vocabulary speech recognition
Świętojański, P., Ghoshal, A. K., & Renals, S. J. (2013) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2013.6707744 · Cited by 102
Self-citationUsing MLP features in SRI's conversational speech recognition system
Zhu, Q., Stolcke, A., Chen, B. Y., & Morgan, N. H. (2005) · Interspeech (USB) · doi:10.21437/interspeech.2005-695 · Cited by 96
Fiscus, J. G., Ajot, J., Radde, N., & Laprun, C. (2006) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/3uua35tezuwd · Cited by 55
Connectionist speech recognition of Broadcast News
Robinson, A. J., Cook, G., Ellis, D. P. W., Fosler‐Lussier, E., Renals, S. J., & Williams, D. (2002) · Speech Communication · doi:10.1016/s0167-6393(01)00058-9 · Cited by 54
Self-citationConvolutional networks for speech detection
Sukittanon, S., Surendran, A. C., Platt, J. C., & Burges, C. J. C. (2004) · Interspeech (USB) · doi:10.21437/interspeech.2004-376 · Cited by 45
Making themost from multiple microphones in meeting recognition
Stolcke, A. (2011) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2011.5947477 · Cited by 22
Improving the MS-TDNN for word spotting
Zeppenfeld, T., Houghton, R., & Waibel, A. (1993) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1993.319344 · Cited by 14
Research works printed but not linked: 2
- abdel-hamid, 2013, Exploring convolutional neural network structures and optimisation techniques for speech recognition, Proc INTERSPEECH
- cieri, 2003, From switchboard to fisher: Telephone collection protocols, their uses and yields, Proc EUROSPEECH, 10.21437/Eurospeech.2003-466 · doi:10.21437/eurospeech.2003-466
Cited by
A survey on deep learning for big data
Zhang, Q., Yang, L. T., Chen, Z., & Li, P. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.10.006 · Cited by 1,226
Human activity recognition with smartphone sensors using deep learning neural networks
Ronao, C. A., & Cho, S.-B. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.04.032 · Cited by 1,215
Speech Recognition Using Deep Neural Networks: A Systematic Review
Nassif, A. B., Shahin, I., Attili, I., Azzeh, M., & Shaalan, K. (2019) · IEEE Access · doi:10.1109/access.2019.2896880 · Cited by 1,152
Deep learning approach for active classification of electrocardiogram signals
Rahhal, M. M. A., Bazi, Y., AlHichri, H., Alajlan, N., Melgani, F., & Yager, R. R. (2016) · Information Sciences · doi:10.1016/j.ins.2016.01.082 · Cited by 627
Adavanne, S., Politis, A., Nikunen, J., & Virtanen, T. (2019) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2018.2885636 · Cited by 534
Metadata
- Authors
- Swietojanski, P., Ghoshal, A., & Renals, S.
- Venue
- IEEE Signal Processing Letters
- Published
- 2014-09
- Volume
- 21
- Issue
- 9
- Pages
- 1120-1124
- ISSN
- 1070-9908 (ISSN-L)
- 1558-2361
- OpenAlex
- W2103088716
- Cited by
- 253
- References
- 43
- FWCI
- 25.42
- Type
- journal article
- Language
- en
- Open access
- green
- Funders
- Engineering and Physical Sciences Research Council (EP/I031022/1)
- European Commission (287872)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.