Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups
The DOI matches its Crossref record; 68 of the 71 references it cites were found in a registry or an index.
Abstract
Most current speech recognition systems use hidden Markov models (HMMs) to deal with the temporal variability of speech and Gaussian mixture models (GMMs) to determine how well each state of each HMM fits a frame or a short window of frames of coefficients that represents the acoustic input. An alternative way to evaluate the fit is to use a feed-forward neural network that takes several frames of coefficients as input and produces posterior probabilities over HMM states as output. Deep neural networks (DNNs) that have many hidden layers and are trained using new methods have been shown to outperform GMMs on a variety of speech recognition benchmarks, sometimes by a large margin. This article provides an overview of this progress and represents the shared views of four research groups that have had recent successes in using DNNs for acoustic modeling in speech recognition.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Deep Learning has largely alleviated the need for manual feature extraction, achieving state-ofthe-art performance in fields such as computer vision and speech recognition [13,14].”
From EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces (2018) · cites this paper as [13]
In the citing paper
“In particular, neural networks became competitive, solving problems in speech recognition [68], image recognition [69] and language translation [70].”
From The growing ubiquity of algorithms in society: implications, impacts and innovations (2018) · cites this paper as [68]
In the citing paper
“Apart from images, sequential data such as text and audio can also be processed with DNNs to reach state-of-the-art performance for document classification and speech recognition.”
From Deep learning for time series classification: a review (2019) · cites this paper as Hinton et al., 2012
In the citing paper
“The other more direct reason behind the high accuracies of deep CNNs on time series data is its success in other sequential data such as speech recognition (Hinton et al., 2012) and sentence classification (Kim, 2014)”
From Deep learning for time series classification: a review (2019) · cites this paper as Hinton et al., 2012
In the citing paper
“Recent studies have reported that deep learning methods have been successfully applied to many applications areas e.g., image and video classification [11-13], visual tracking [14], speech recognition [15] and natural language processing [16].”
From Medical image retrieval using deep convolutional neural network (2017) · cites this paper as [15]
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Self-citationReducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Self-citationA fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Self-citation(2010) · Cited by 14,134
Training Products of Experts by Minimizing Contrastive Divergence
Hinton, G. E. (2002) · Neural Computation · doi:10.1162/089976602760128018 · Cited by 4,879 · cited 3×
“…learning algorithm for a restricted Boltzmann machine (RBM) which consists of a layer of stochastic binary " visible " units that represent binary input data connected to a layer of stochastic binary hidden units that learn to model significant nonindependencies between the visible units [20].”
InfluentialSelf-citation(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011
Self-citationA Practical Guide to Training Restricted Boltzmann Machines
Hinton, G. E. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_32 · Cited by 2,852 · cited 2×
“Learning the standard deviations of a GRBM is problematic for reasons described in [21], so for pretraining using CD 1 , the data are normalized so that each coefficient has zero mean and unit variance, the standard deviations are set to one when computing ( ) v h p ; , and no noise is added to the…”
Self-citationPerceptual linear predictive (PLP) analysis of speech
Hermansky, H. (1990) · The Journal of the Acoustical Society of America · doi:10.1121/1.399423 · Cited by 2,536
Acoustic Modeling Using Deep Belief Networks
Mohamed, A.-R., Dahl, G. E., & Hinton, G. (2012) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2011.2109382 · Cited by 1,727
Self-citation
Research works printed but not linked: 5
- sainath, 2011, Improvements in using deep belief networks for large vocabulary continuous speech recognition, Speech and Language Algorithm Group IBM Yorktown Heights NY Tech Rep UTML TR 2010-003
- rifai, 0, Contractive autoencoders: Explicit invariance during feature extraction, Proc 28th Int Conf Machine Learning, 833
- yu, 2011, Discriminative pretraining of deep neural networks, U S Patent Filing
- mohamed, 0, Deep belief networks for phone recognition, Proc NIPS Workshop Deep Learning for Speech Recognition and Related Applications
- pearl, 1988, Probabilistic Inference in Intelligent Systems Networks of Plausible Inference
Cited by
Items 801–900 of 1,106
Deep Machine Learning Techniques for the Detection and Classification of Sperm Whale Bioacoustics
Bermant, P. C., Bronstein, M. M., Wood, R. J., Gero, S., & Gruber, D. F. (2019) · Scientific Reports · doi:10.1038/s41598-019-48909-4 · Cited by 152
Weed Detection in Perennial Ryegrass With Deep Learning Convolutional Neural Network
Yu, J., Schumann, A. W., Cao, Z., Sharpe, S. M., & Boyd, N. S. (2019) · Frontiers in Plant Science · doi:10.3389/fpls.2019.01422 · Cited by 171
“…as an effective application in various scientific domains, including computer vision (LeCun et al., 2015; Kendall and Gal, 2017; Gu et al., 2018), natural language processing (Collobert and Weston, 2008; Collobert et al., 2011), and speech recognition (Hinton et al., 2012; LeCun et al., 2015).”
BackgroundJiang, M., Liu, J., Zhang, L., & Liu, C. (2020) · Physica A: Statistical Mechanics and its Applications · doi:10.1016/j.physa.2019.122272 · Cited by 155
Si, X., Tu, Y.-N., Huang, W.-H., Su, J.-W., Lu, P.-J., Wang, J., Liu, T.-W., Wu, S.-Y., Liu, R., Chou, Y.-C., et al. (2021) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2021.3073254 · Cited by 161
WENETSPEECH: A 10000+ Hours Multi-Domain Mandarin Corpus for Speech Recognition
Zhang, B., Lv, H., Guo, P., Shao, Q., Yang, C., Xie, L., Xu, X., Bu, H., Chen, X., Zeng, C., et al. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746682 · Cited by 409
Iqbal, R., Doctor, F., More, B., Mahmud, S., & Yousuf, U. (2020) · Future Generation Computer Systems · doi:10.1016/j.future.2017.10.021 · Cited by 155
Deep feature for text-dependent speaker verification
Liu, Y., Qian, Y., Chen, N., Fu, T., Zhang, Y., & Yu, K. (2015) · Speech Communication · doi:10.1016/j.specom.2015.07.003 · Cited by 155
Automating model search for large scale machine learning
Sparks, E. R., Talwalkar, A., Haas, D., Franklin, M. J., Jordan, M. I., & Kraska, T. (2015) · Proceedings of the Sixth ACM Symposium on Cloud Computing · doi:10.1145/2806777.2806945 · Cited by 152
Using convolutional features and a sparse autoencoder for land-use scene classification
Othman, E., Bazi, Y., Alajlan, N., Alhichri, H., & Melgani, F. (2016) · International Journal of Remote Sensing · doi:10.1080/01431161.2016.1171928 · Cited by 154
HomeBank: An Online Repository of Daylong Child-Centered Audio Recordings
Warlaumont, A. S., Bergelson, E., Cristià, A., Söderström, M., Palma, P. D., MacWhinney, B., & VanDam, M. (2016) · Seminars in Speech and Language · doi:10.1055/s-0036-1580745 · Cited by 186
An unsupervised deep domain adaptation approach for robust speech recognition
Sun, S., Zhang, B., Xie, L., & Zhang, Y. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.11.063 · Cited by 180
Zhu, Q., Li, X., Conesa, A., & Pereira, C. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx815 · Cited by 159
Convolutional neural networks for crowd behaviour analysis: a survey
Tripathi, G., Singh, K., & Vishwakarma, D. K. (2018) · The Visual Computer · doi:10.1007/s00371-018-1499-5 · Cited by 168
Deep Learning and Its Applications to Machine Health Monitoring: A Survey
Zhao, R., Yan, R., Chen, Z., Mao, K., Wang, P. E., & Gao, R. X. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.07640 · Cited by 147
Hutchinson, B., Deng, L., & Yu, D. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.268 · Cited by 154
Self-citationSkoraczyński, G., Dittwald, P., Miasojedow, B., Szymkuć, S., Gajewska, E. P., Grzybowski, B. A., & Gambin, A. (2017) · Scientific Reports · doi:10.1038/s41598-017-02303-0 · Cited by 153
Deep reinforcement learning approaches for process control
Spielberg, S. P. K., Gopaluni, R. B., & Loewen, P. D. (2017) · International Symposium on Advanced Control of Industrial Processes · doi:10.1109/adconip.2017.7983780 · Cited by 178
Semisupervised Autoencoders for Speech Emotion Recognition
Deng, J., Xu, X., Zhang, Z., Frühholz, S., & Schuller, B. W. (2017) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2017.2759338 · Cited by 165
Deep Learning Methods and Applications
Ahmad, J., Farman, H., & Jan, Z. (2018) · SpringerBriefs in computer science · doi:10.1007/978-981-13-3459-7_3 · Cited by 177
Trabelsi, A., Chaabane, M., & Ben-Hur, A. (2019) · Bioinformatics · doi:10.1093/bioinformatics/btz339 · Cited by 153
“In recent years, deep neural networks have become the technique of choice for challenging tasks in computer vision (Krizhevsky et al. 2012, LeCun et al. 2015), speech recognition (Hinton et al. 2012), machine translation (Sutskever et al. 2014), and computational biology (Angermueller et al. 2016).”
MethodDeep neural network and whale optimization algorithm to assess flyrock induced by blasting
Guo, H., Zhou, J., Koopialipoor, M., Armaghani, D. J., & Tahir, M. M. (2019) · Engineering With Computers · doi:10.1007/s00366-019-00816-y · Cited by 160
Hanif, H., Nasir, M. H. N. M., Razak, M. F. A., Firdaus, A., & Anuar, N. B. (2021) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2021.103009 · Cited by 216
Evaluating Bayesian Deep Learning Methods for Semantic Segmentation
Mukhoti, J., & Gal, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.12709 · Cited by 138
“Deep learning has had tremendous success in quite a few fields including computer vision [37, 62, 18, 32], natural language processing [25, 60, 49, 50, 39], speech recognition [51, 16, 29, 26, 3], bioinformatics [41, 64, 2] and others.”
BackgroundPipeDream: Fast and Efficient Pipeline Parallel DNN Training
Harlap, A., Narayanan, D., Phanishayee, A., Seshadri, V., Devanur, N., Ganger, G., & Gibbons, P. (2018) · arXiv · doi:10.48550/arxiv.1806.03377 · Cited by 153
“…five years has seen a rapid increase in the use of Deep Neural Networks (DNNs), with researchers and practitioners applying these models to great effect across a wide range of applications, including image and video classification, speech recognition, and language translation [16, 17, 21, 22, 44].”
BackgroundKwon, H., Tong, C., Haresamudram, H., Gao, Y., Abowd, G. D., Lane, N. D., & Plötz, T. (2020) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3411841 · Cited by 152
“Regardless of its utility, the HAR field has yet to experience significant improvements in recognition accuracy, in contrast to the breakthroughs in other fields, such as speech recognition [34], natural language processing [19], and computer vision [32].”
BackgroundQuery-by-example keyword spotting using long short-term memory networks
Chen, G., Parada, C., & Sainath, T. N. (2015) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2015.7178970 · Cited by 154
Self-citationAbbas, Q., Fondón, I., Sarmiento, A., Jiménez, S., & Alemany, P. (2017) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-017-1638-6 · Cited by 166
Deep Convolutional Neural Network with Mixup for Environmental Sound Classification
Zhang, Z., Xu, S., Cao, S. C., & Zhang, S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-03335-4_31 · Cited by 152
RETRACTED ARTICLE: LSTM Model for Prediction of Heart Failure in Big Data
Maragatham, G., & Devi, S. (2019) · Journal of Medical Systems · doi:10.1007/s10916-019-1243-3 · Cited by 175
“In the meantime, variants of neural system applications have been investigated deep designs in the domain of computer vision, [23 – 25] processing of sound, [26, 27] and (NLP) natural language processing, [20, 28 – 30] among different fields.”
BackgroundRetractedDeep Robust Reinforcement Learning for Practical Algorithmic Trading
Li, Y., Zheng, W., & Zheng, Z. (2019) · IEEE Access · doi:10.1109/access.2019.2932789 · Cited by 195
“state-of-the-art results in a variety of sequential data prediction problems [15]–[17] shows that the convolutional neural network (CNN) is better suited for predicting the price movements of stocks than multilayer neural networks and support vector machines.”
BackgroundPredicting the Landscape of Recombination Using Deep Learning
Adrion, J. R., Galloway, J. G., & Kern, A. D. (2020) · Molecular Biology and Evolution · doi:10.1093/molbev/msaa038 · Cited by 150
Wang, Y., You, Z., Yang, S., Yi, H.-C., Chen, Z., & Zheng, K. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-1052-0 · Cited by 173
Bode, M., Gauding, M., Lian, Z., Denker, D., Davidovic, M., Kleinheinz, K., Jitsev, J., & Pitsch, H. G. (2021) · Proceedings of the Combustion Institute · doi:10.1016/j.proci.2020.06.022 · Cited by 168
A Survey of Attacks on Controller Area Networks and Corresponding Countermeasures
Jo, H. J., & Choi, W. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3078740 · Cited by 164
Classification of Hyperspectral Images by Gabor Filtering Based Deep Network
Kang, X., Li, C., Li, S., & Lin, H. (2018) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2017.2767185 · Cited by 151
Deep learning methods for underwater target feature extraction and recognition
Hu, G., Wang, K., Peng, Y., Qiu, M., Shi, J., & Liu, L. (2018) · Computational Intelligence and Neuroscience · doi:10.1155/2018/1214301 · Cited by 151
“In 2013, Brian Kingsbury, researcher of IBM, and several other persons [16] took the logarithmic Mel filter coefficient as the input of deep convolution network and further extracted the “original” features (Mel filter coefficient), and the experiment shows that the recognition rate has a relative increase of 13–30% c…”
BackgroundDeep Neural Network Based Predictions of Protein Interactions Using Primary Sequences
Li, H., Gong, X., Yu, H., & Zhou, C. (2018) · Molecules · doi:10.3390/molecules23081923 · Cited by 180
He, X., Luo, J., Zuo, G., & Xie, J. (2019) · Water Resources Management · doi:10.1007/s11269-019-2183-x · Cited by 151
“In recent years, DNN has facilitated great progress in analysis in fields such as speech recognition (Hinton et al. 2012), computer vision (Krizhevsky et al. 2017), text processing (Ciresan et al. 2010), and natural language processing (Collobert and Weston 2008).”
BackgroundChampion-challenger analysis for credit card fraud detection: Hybrid ensemble and deep learning
Kim, E., Lee, J., Shin, H., Yang, H., Cho, S., Nam, S.-K., Song, Y., Yoon, J.-A., & Kim, J. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.03.042 · Cited by 171
Xie, T., Zhang, G., Hou, J., Xie, J., Lv, M., & Liu, F. (2019) · Journal of Hydrology · doi:10.1016/j.jhydrol.2019.123915 · Cited by 156
Graph Convolutional Networks using Heat Kernel for Semi-supervised Learning
Xu, B., Shen, H., Cao, Q., Cen, K., & Cheng, X. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/267 · Cited by 195
Deep Contextualized Acoustic Representations for Semi-Supervised Speech Recognition
Ling, S., Liu, Y., Salazar, J., & Kirchhoff, K. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9053176 · Cited by 145
Deep Learning for RFID-Based Activity Recognition
Li, X., Zhang, Y., Marsic, I., Sarcevic, A., & Burd, R. S. (2016) · Proceedings of the 14th ACM Conference on Embedded Networked Sensor Systems CD-ROM · doi:10.1145/2994551.2994569 · Cited by 150
“The use of deep learning in recent years has led to great leaps in many fields, from image classification [2] to speech recognition [19].”
Improving EEG-Based Driver Fatigue Classification Using Sparse-Deep Belief Networks
Chai, R., Ling, S. H., San, P. P., Naik, G. R., Nguyen, T. N., Tran, Y., Craig, A. R., & Nguyen, H. T. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00103 · Cited by 156
A Survey of Available Corpora For Building Data-Driven Dialogue Systems: The Journal Version
Serban, I. V., Lowe, R., Henderson, P., Charlin, L., & Pineau, J. (2018) · Dialogue & Discourse · doi:10.5087/dad.2018.101 · Cited by 150
Grohs, P., Hornung, F., Jentzen, A., & von Wurstemberger, P. (2023) · Memoirs of the American Mathematical Society · doi:10.1090/memo/1410 · Cited by 191
Is neuron coverage a meaningful measure for testing deep neural networks?
Harel-Canada, F., Wang, L., Gulzar, M. A., Gu, Q., & Kim, M. (2020) · Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3368089.3409754 · Cited by 145
“DNNs have achievedmany breakthroughs in the field of artificial intelligence, such as speech recognition [18], image processing [28], statistical machine translation [3], and game playing [55].”
Yang, J., Wang, X., Wang, R., & Wang, H. (2020) · Geoderma · doi:10.1016/j.geoderma.2020.114616 · Cited by 166
Collaborative filtering recommender systems taxonomy
Papadakis, H., Papagrigoriou, A., Panagiotakis, C., Kosmas, E., & Fragopoulou, P. (2022) · Knowledge and Information Systems · doi:10.1007/s10115-021-01628-7 · Cited by 193
“NNs have been proven to be capable of approximating any continuous function [42] and more recently deep neural networks (DNNs) have been found to be effective in several domains including computer vision and pattern recognition [60], signal processing and speech recognition [41], compression [32], text processing [28]…”
Hybrid Macro/Micro Level Backpropagation for Training Deep Spiking Neural NetworksPreprint
Jin, Y., Zhang, W., & Li, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.07866 · Cited by 178
Ling, Z.-H., Deng, L., & Yu, D. (2013) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2013.2269291 · Cited by 173
Self-citationChen, Z., Watanabe, S., Erdoğan, H., & Hershey, J. R. (2015) · Interspeech (USB) · doi:10.21437/interspeech.2015-659 · Cited by 149
Liu, Y., Dinh, N. T., Sato, Y., & Ničeno, B. (2018) · Applied Thermal Engineering · doi:10.1016/j.applthermaleng.2018.08.041 · Cited by 152
Long short-term memory recurrent neural network architectures for Urdu acoustic modeling
Zia, T., & Zahid, U. (2018) · International Journal of Speech Technology · doi:10.1007/s10772-018-09573-7 · Cited by 162
“Although feed-forward networks known as deep neural networks (DNNs) are considered as established state-of-art in acoustic modeling (Hinton et al. 2012; Graves et al. 2013a), they have different disadvantages over RNNs.”
BackgroundMethodStar-Based Reachability Analysis of Deep Neural Networks
Tran, H.-D., Lopez, D. M., Musau, P., Yang, X., Nguyen, L. V., Xiang, W., & Johnson, T. T. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-30942-8_39 · Cited by 237
Few Sample Knowledge Distillation for Efficient Network Compression
Li, T., Li, J., Liu, Z., & Zhang, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01465 · Cited by 149
Named Entity Recognition in Chinese Clinical Text Using Deep Neural Network
Yonghui, W., Min, J., Jianbo, L., & Hua, X. (2015) · Studies in Health Technology and Informatics · doi:10.3233/978-1-61499-564-7-624 · Cited by 143
Curriculum Adversarial Training
Cai, Q.-Z., Liu, C., & Song, D. X. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/520 · Cited by 222
Zeng, N., Li, H., Wang, Z., Liu, W., Liu, S., Alsaadi, F. E., & Liu, X. (2021) · Neurocomputing · doi:10.1016/j.neucom.2020.04.001 · Cited by 147
“Notice that the DBN has been successfully applied to segment the two lines in the GICS images in [41].”
MethodInfluentialPhysical reservoir computing using magnetic skyrmion memristor and spin torque nano-oscillator
Jiang, W., Chen, L., Zhou, K., Li, L., Fu, Q., Du, Y., & Liu, R. (2019) · Applied Physics Letters · doi:10.1063/1.5115183 · Cited by 159
Efficient softmax approximation for GPUs
Grave, É., Joulin, A., Cissé, M., Grangier, D., & Jeǵou, H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.04309 · Cited by 132
On the depth of deep neural networks: a theoretical view
Sun, S., Chen, W., Wang, L., Liu, X., & Liu, T.-Y. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10243 · Cited by 147
“…achieved great practical success in many machine learning tasks, such as speech recognition, image classification, and natural language processing (Hinton and Salakhutdinov 2006; Krizhevsky, Sutskever, and Hinton 2012; Hinton et al. 2012; Ciresan, Meier, and Schmidhuber 2012; Weston et al. 2012).”
BackgroundA Joint Training Framework for Robust Automatic Speech Recognition
Wang, Z.-Q., & Wang, D. (2016) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2016.2528171 · Cited by 145
Chen, K., & Huo, Q. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472805 · Cited by 147
Novelty detection meets collider physics
Hajer, J., Li, Y.-Y., Liu, T., & Wang, H. (2020) · Physical review. D/Physical review. D. · doi:10.1103/physrevd.101.076015 · Cited by 167
Memristor devices for neural networks
Jeong, H., & Shi, L. (2019) · Journal of Physics D: Applied Physics · doi:10.1088/1361-6463/aae223 · Cited by 147
Application of deep neural networks in predicting the penetration rate of tunnel boring machines
Koopialipoor, M., Tootoonchi, H., Armaghani, D. J., Mohamad, E. T., & Hedayat, A. (2019) · Bulletin of Engineering Geology and the Environment · doi:10.1007/s10064-019-01538-7 · Cited by 153
Rzepka, C., Berger, B., & Hess, T. (2022) · Information Systems Frontiers · doi:10.1007/s10796-021-10226-5 · Cited by 146
“While speech-and text-based CAs face the same challenges in interpreting language, advances in artificial intelligence enabled VAs to successfully map sound signals to sequences of words, thereby overcoming what is arguably the biggest difficulty in attaching meaning to speech (Hinton et al., 2012).”
A Survey of Recent Advances in Optimization Methods for Wireless Communications
Liu, Y., Chang, T., Hong, M., Wu, Z., So, A. M., Jorswieck, E. A., & Yu, W. (2024) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2024.3443759 · Cited by 225
“Historically, image/speech recognition is among the first successful applications of deep learning [197], [198]—broadly speaking, these are all sensing tasks.”
BackgroundPattern Recognition and Neural Networks
Wittek, P. (2014) · Elsevier eBooks · doi:10.1016/b978-0-12-800953-6.00006-2 · Cited by 147
Fusion Methods for CNN-Based Automatic Modulation Classification
Zheng, S., Qi, P., Chen, S., & Yang, X. (2019) · IEEE Access · doi:10.1109/access.2019.2918136 · Cited by 158
ViraMiner: Deep learning on raw DNA sequences for identifying viral genomes in human samples
Tampuu, A., Bzhalava, Z., Dillner, J., & Vicente, R. (2019) · PLOS ONE · doi:10.1371/journal.pone.0222271 · Cited by 146
Deep learning in robotics: survey on model structures and training strategies
Karoly, A. I., Galambos, P., Kuti, J., & Rudas, I. J. (2021) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2020.3018325 · Cited by 146
Convolutional Neural Network for Multi-Category Rapid Serial Visual Presentation BCI
Manor, R., & Geva, A. B. (2015) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2015.00146 · Cited by 144
Learning Invariant Feature Hierarchies
LeCun, Y. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33863-2_51 · Cited by 164
Malware detection based on deep learning algorithm
Yuxin, D., & Zhu, S. (2017) · Neural Computing and Applications · doi:10.1007/s00521-017-3077-6 · Cited by 159
Adversarial Robustness vs. Model Compression, or Both?
Ye, S., Xu, K., Liu, S., Cheng, H., Lambrechts, J.-H., Zhang, H., Zhou, A., Ma, K., Wang, Y., & Lin, X. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00020 · Cited by 133
“or deep neural networks (DNNs) have achieved extraordinary performance in many application domains such as image classification [22, 46], object detection and recognition [31, 42], speech recognition [24, 53], natural language processing [10, 38], medical image analysis [32, 44], and disease diagnosis [11, 13]. Besides…”
BackgroundZazo, R., Lozano-Díez, A., Gónzalez-Domínguez, J., Toledano, D. T., & González-Rodríguez, J. (2016) · PLoS ONE · doi:10.1371/journal.pone.0146917 · Cited by 162
Jiang, S., Chin, K., Wang, L., Qu, G., & Tsui, K. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.04.017 · Cited by 156
Burlina, P., Billings, S., Joshi, N., & Albayda, J. (2017) · PLOS ONE · doi:10.1371/journal.pone.0184059 · Cited by 144
Machine Learning Approach to RF Transmitter Identification
Youssef, K., Bouchard, L., Haigh, K. Z., Silovský, J., Thapa, B., & Valk, C. V. (2018) · IEEE Journal of Radio Frequency Identification · doi:10.1109/jrfid.2018.2880457 · Cited by 155
A survey of fault prediction and location methods in electrical energy distribution networks
Dashti, R., Daisy, M., Mirshekali, H., Shaker, H. R., & Aliabadi, M. H. (2021) · Measurement · doi:10.1016/j.measurement.2021.109947 · Cited by 144
Enable Deep Learning on Mobile Devices: Methods, Systems, and Applications
Cai, H., Lin, J., Lin, Y., Liu, Z., Tang, H., Wang, H., Zhu, L., & Han, S. (2022) · ACM Transactions on Design Automation of Electronic Systems · doi:10.1145/3486618 · Cited by 195
An enhanced multimodal fusion deep learning neural network for lung cancer classification
Sangeetha, S. K. B., Mathivanan, S. K., Karthikeyan, P., Rajadurai, H., Shivahare, B. D., Mallik, S., & Qin, H. H. (2023) · Systems and Soft Computing · doi:10.1016/j.sasc.2023.200068 · Cited by 185
Gist: Efficient Data Encoding for Deep Neural Network Training
Jain, A., Phanishayee, A., Mars, J., Tang, L., & Pekhimenko, G. (2018) · 2018 ACM/IEEE 45th Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2018.00070 · Cited by 140
Jiang, J., Chen, R., Chen, M., Wang, W., & Zhang, C. (2019) · IEEE Transactions on Power Delivery · doi:10.1109/tpwrd.2019.2900543 · Cited by 143
Deng, L., Jiao, P., Pei, J., Wu, Z., & Li, G. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.01.010 · Cited by 178
Self-citationJamming transition as a paradigm to understand the loss landscape of deep neural networks
Geiger, M., Spigler, S., d'Ascoli, S., Sagun, L., Baity-Jesi, M., Biroli, G., & Wyart, M. (2019) · Physical Review E · doi:10.1103/physreve.100.012115 · Cited by 143
“Deep neural networks are now central tools for a variety of tasks including image classification [1, 2], speech recognition [3] and the development of artificial intelligence that can for example master the game of Go beyond human level [4, 5].”
BackgroundDeep neural networks with weighted spikes
Kim, J., Kim, H., Huh, S., Lee, J., & Choi, K. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.05.087 · Cited by 156
Mao, Z., & Meng, X. (2023) · Applied Mathematics and Mechanics · doi:10.1007/s10483-023-2994-7 · Cited by 167
Searching by Talking: Analysis of Voice Queries on Mobile Web Search
Guy, I. (2016) · Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval · doi:10.1145/2911451.2911525 · Cited by 140
Low-Complexity Multiclass Encryption by Compressed Sensing
Cambareri, V., Mangia, M., Pareschi, F., Rovatti, R., & Setti, G. (2015) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2015.2407315 · Cited by 149
Speaker verification with short utterances: a review of challenges, trends and opportunities
Poddar, A., Sahidullah, M., & Saha, G. (2017) · IET Biometrics · doi:10.1049/iet-bmt.2017.0065 · Cited by 160
Privacy Preserving Synthetic Data Release Using Deep Learning
Abay, N. C., Zhou, Y., Kantarcıoğlu, M., Thuraisingham, B., & Sweeney, L. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-10925-7_31 · Cited by 223
Zhu, L., Peng, Z., McClellan, J. H., Li, C., Yao, D., Li, Z., & Fang, L. (2019) · Physics of The Earth and Planetary Interiors · doi:10.1016/j.pepi.2019.05.004 · Cited by 141
Silent Speech Interfaces for Speech Restoration: A Review
González, J. A., Gomez-Alanis, A., Martín-Doñas, J. M., Pérez-Córdoba, J. L., & Gomez, A. M. (2020) · IEEE Access · doi:10.1109/access.2020.3026579 · Cited by 188
Unsupervised learning of acoustic features via deep canonical correlation analysis
Wang, W., Arora, R., Livescu, K., & Bilmes, J. A. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178840 · Cited by 137
Ma, M., Sun, C., & Chen, X. (2017) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2017.2735661 · Cited by 140
Effective neural network training with adaptive learning rate based on training loss
Takase, T., Oyama, S., & Kurihara, M. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.01.016 · Cited by 144
Park, Y., Kwon, B., Heo, J., Hu, X., Liu, Y., & Moon, T. (2020) · Environmental Pollution · doi:10.1016/j.envpol.2019.113395 · Cited by 139
Metadata
- Authors
- Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., & Kingsbury, B.
- Affiliations
- University of Toronto (CA)
- University of Waterloo (CA)
- Microsoft (United States) (US)
- Google (United States) (US)
- IBM (United States) (US)
- Michigan State University (US)
- Venue
- IEEE Signal Processing Magazine
- Published
- 2012-11
- Volume
- 29
- Issue
- 6
- Pages
- 82-97
- ISSN
- 1053-5888 (ISSN-L)
- OpenAlex
- W2160815625
- Cited by
- 10,260
- References
- 71
- Citations by year
- 2026: 253 · 2025: 526 · 2024: 610 · 2023: 696 · 2022: 837 · 2021: 978 · 2020: 1232 · 2019: 1313 · 2018: 1220 · 2017: 967 · 2016: 712 · 2015: 498 · 2014: 276 · 2013: 128 · 2012: 9
- FWCI
- 284.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Signal Processing Magazine (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- deep neural network, acoustic modeling, speech recognition, hidden Markov models, Gaussian mixture model, feedforward neural networks, posterior probability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.