The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Small-footprint keyword spotting using deep neural networks
Abstract
Our application requires a keyword spotting system with a small memory footprint, low computational cost, and high precision. To meet these requirements, we propose a simple approach based on deep neural networks. A deep neural network is trained to directly predict the keyword(s) or subword units of the keyword(s) followed by a posterior handling method producing a final confidence score. Keyword recognition results achieve 45% relative improvement with respect to a competitive Hidden Markov Model-based system, while performance in the presence of babble noise shows 39% relative improvement.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636
Large Scale Distributed Deep Networks
Dean, J. B., Corrado, G. S., Monga, R., Chen, K., Devin, M., Mao, M., Ranzato, M., Senior, A., Tucker, P. A., Yang, K., et al. (2012) · neural information processing systems · Cited by 4,489
Building high-level features using large scale unsupervised learning
Le, Q. V. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639343 · Cited by 1,695 · cited 4×
“We also thank Mark Mao for his help with DistBelief.”
MethodInfluentialCaruana, R. (1998) · Cited by 1,110
Building high-level features using large scale unsupervised learning
Ranzato, M., Monga, R., Devin, M., Chen, K., Corrado, G. S., Dean, J., Le, Q. V., & Ng, A. Y. (2012) · International Conference on Machine Learning · Cited by 823
On rectified linear units for speech processing
Zeiler, M. D., Ranzato, M., Monga, R., Mao, M., Yang, K., Le, Q. V., Nguyen, P., Senior, A., Vanhoucke, V., Dean, J., et al. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638312 · Cited by 420
A hidden Markov model based keyword recognition system
Rose, R. C., & Paul, D. B. (2002) · International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1990.115555 · Cited by 413
Multilingual acoustic models using distributed deep neural networks
Heigold, G., Vanhoucke, V., Senior, A., Nguyen, P., Ranzato, M., Devin, M., & Dean, J. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639348 · Cited by 273
Self-citationAn Application of Recurrent Neural Networks to Discriminative Keyword Spotting
Fernández, S., Graves, A., & Schmidhuber, J. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74695-9_23 · Cited by 251
Application of pretrained deep neural networks to large vocabulary speech recognition
Jaitly, N., Nguyen, P., Senior, A., & Vanhoucke, V. (2012) · Interspeech 2012 · doi:10.21437/interspeech.2012-10 · Cited by 243
Continuous hidden Markov modeling for speaker-independent word spotting
Rohlicek, J. R., Russell, W., Roukos, S., & Gish, H. (2003) · International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1989.266505 · Cited by 240
“Your Word is my Command”: Google Search by Voice: A Case Study
Schalkwyk, J., Beeferman, D., Beaufays, F., Byrne, B., Chelba, C., Cohen, M., Kamvar, M., & Strope, B. (2010) · Advances in Speech Recognition · doi:10.1007/978-1-4419-5951-5_4 · Cited by 232
Recurrent neural networks for voice activity detection
Hughes, T., & Mierle, K. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639096 · Cited by 188
Vocabulary independent spoken term detection
Mamou, J., Ramabhadran, B., & Siohan, O. (2007) · Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1277741.1277847 · Cited by 182
Large vocabulary continuous speech recognition with context-dependent DBN-HMMS
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2011) · 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2011.5947401 · Cited by 178
Accurate and compact large vocabulary speech recognition on mobile devices
Lei, X., Senior, A., Gruenstein, A., & Sorensen, J. S. (2013) · Interspeech (USB) · doi:10.21437/interspeech.2013-189 · Cited by 120
Discriminative keyword spotting
Keshet, J., Grangier, D., & Samy Bengio, A. (2008) · Speech Communication · doi:10.1016/j.specom.2008.10.002 · Cited by 115
Keyword-spotting using SRI's DECIPHER large-vocabulary speech-recognition system
Weintraub, M. (1993) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1993.319341 · Cited by 67
Silaghi, M. C. (2005) · Cited by 33
A whole word recurrent neural network for keyword spotting
Li, K., Naylor, J. A., & Rossen, M. L. (1992) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1992.226115 · Cited by 25
An evolutionary based discriminative system for keyword spotting
Tabibian, S., Akbari, A., & Nasersharif, B. (2011) · CSI International Symposium on Artificial Intelligence and Signal Processing · doi:10.1109/aisp.2011.5960990 · Cited by 12
Cited by
Generalized End-to-End Loss for Speaker Verification
Wan, L., Wang, Q., Papir, A., & Moreno, I. L. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8462665 · Cited by 820
Convolutional neural networks for small-footprint keyword spotting
Sainath, T. N., & Parada, C. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-352 · Cited by 521
Self-citationTensorFlow Lite Micro: Embedded Machine Learning on TinyML Systems
David, R., Duke, J., Jain, A., Reddi, V. J., Jeffries, N., Li, J., Kreeger, N., Nappier, I., Natraj, M., Regev, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.08678 · Cited by 470
“The most well-known and widely deployed example of this new TinyML technology is keyword spotting, also called hotword or wakeword detection (Chen et al., 2014; Gru-enstein et al., 2017; Zhang et al., 2017).”
BackgroundDeepX: A Software Accelerator for Low-Power Deep Learning Inference on Mobile Devices
Lane, N. D., Bhattacharya, S., Georgiev, P., Forlivesi, C., Jiao, L., Qendro, L., & Kawsar, F. (2016) · 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · doi:10.1109/ipsn.2016.7460664 · Cited by 450
Light Gated Recurrent Units for Speech Recognition
Ravanelli, M., Brakel, P., Omologo, M., & Bengio, Y. (2018) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2017.2762739 · Cited by 411
Metadata
- Authors
- Chen, G., Parada, C., & Heigold, G.
- Venue
- 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
- Publisher
- IEEE
- Published
- 2014-05
- Pages
- 4087-4091
- ISSN
- 1520-6149 (ISSN-L)
- OpenAlex
- W2034940213
- Cited by
- 545
- References
- 21
- FWCI
- 15.42
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.