Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups
The DOI matches its Crossref record; 68 of the 71 references it cites were found in a registry or an index.
Abstract
Most current speech recognition systems use hidden Markov models (HMMs) to deal with the temporal variability of speech and Gaussian mixture models (GMMs) to determine how well each state of each HMM fits a frame or a short window of frames of coefficients that represents the acoustic input. An alternative way to evaluate the fit is to use a feed-forward neural network that takes several frames of coefficients as input and produces posterior probabilities over HMM states as output. Deep neural networks (DNNs) that have many hidden layers and are trained using new methods have been shown to outperform GMMs on a variety of speech recognition benchmarks, sometimes by a large margin. This article provides an overview of this progress and represents the shared views of four research groups that have had recent successes in using DNNs for acoustic modeling in speech recognition.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Deep Learning has largely alleviated the need for manual feature extraction, achieving state-ofthe-art performance in fields such as computer vision and speech recognition [13,14].”
From EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces (2018) · cites this paper as [13]
In the citing paper
“In particular, neural networks became competitive, solving problems in speech recognition [68], image recognition [69] and language translation [70].”
From The growing ubiquity of algorithms in society: implications, impacts and innovations (2018) · cites this paper as [68]
In the citing paper
“Apart from images, sequential data such as text and audio can also be processed with DNNs to reach state-of-the-art performance for document classification and speech recognition.”
From Deep learning for time series classification: a review (2019) · cites this paper as Hinton et al., 2012
In the citing paper
“The other more direct reason behind the high accuracies of deep CNNs on time series data is its success in other sequential data such as speech recognition (Hinton et al., 2012) and sentence classification (Kim, 2014)”
From Deep learning for time series classification: a review (2019) · cites this paper as Hinton et al., 2012
In the citing paper
“Recent studies have reported that deep learning methods have been successfully applied to many applications areas e.g., image and video classification [11-13], visual tracking [14], speech recognition [15] and natural language processing [16].”
From Medical image retrieval using deep convolutional neural network (2017) · cites this paper as [15]
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Self-citationReducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Self-citationA fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Self-citation(2010) · Cited by 14,134
Training Products of Experts by Minimizing Contrastive Divergence
Hinton, G. E. (2002) · Neural Computation · doi:10.1162/089976602760128018 · Cited by 4,879 · cited 3×
“…learning algorithm for a restricted Boltzmann machine (RBM) which consists of a layer of stochastic binary " visible " units that represent binary input data connected to a layer of stochastic binary hidden units that learn to model significant nonindependencies between the visible units [20].”
InfluentialSelf-citation(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011
Self-citationA Practical Guide to Training Restricted Boltzmann Machines
Hinton, G. E. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_32 · Cited by 2,852 · cited 2×
“Learning the standard deviations of a GRBM is problematic for reasons described in [21], so for pretraining using CD 1 , the data are normalized so that each coefficient has zero mean and unit variance, the standard deviations are set to one when computing ( ) v h p ; , and no noise is added to the…”
Self-citationPerceptual linear predictive (PLP) analysis of speech
Hermansky, H. (1990) · The Journal of the Acoustical Society of America · doi:10.1121/1.399423 · Cited by 2,536
Acoustic Modeling Using Deep Belief Networks
Mohamed, A.-R., Dahl, G. E., & Hinton, G. (2012) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2011.2109382 · Cited by 1,727
Self-citation
Research works printed but not linked: 5
- sainath, 2011, Improvements in using deep belief networks for large vocabulary continuous speech recognition, Speech and Language Algorithm Group IBM Yorktown Heights NY Tech Rep UTML TR 2010-003
- rifai, 0, Contractive autoencoders: Explicit invariance during feature extraction, Proc 28th Int Conf Machine Learning, 833
- yu, 2011, Discriminative pretraining of deep neural networks, U S Patent Filing
- mohamed, 0, Deep belief networks for phone recognition, Proc NIPS Workshop Deep Learning for Speech Recognition and Related Applications
- pearl, 1988, Probabilistic Inference in Intelligent Systems Networks of Plausible Inference
Cited by
Items 1,001–1,100 of 1,106
Photo-real talking head with deep bidirectional LSTM
Fan, B., Wang, L., Soong, F. K., & Xie, L. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178899 · Cited by 122
Recurrent deep neural networks for robust speech recognition
Weng, C., Yu, D., Watanabe, S., & Juang, B.-H. F. (2014) · 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2014.6854661 · Cited by 124
Self-citationRoy, S., Das, N., Kundu, M., & Nasipuri, M. (2017) · Pattern Recognition Letters · doi:10.1016/j.patrec.2017.03.004 · Cited by 133
A Deep Learning Approach for Motor Imagery EEG Signal Classification
Kumar, S., Sharma, A., Mamun, K., & Tsunoda, T. (2016) · 2016 3rd Asia-Pacific World Congress on Computer Science and Engineering (APWC on CSE) · doi:10.1109/apwc-on-cse.2016.017 · Cited by 121
Migrating Knowledge between Physical Scenarios Based on Artificial Neural Networks
Qu, Y., Jing, L., Shen, Y., Qiu, M., & Marin Soljacic, A. (2019) · ACS Photonics · doi:10.1021/acsphotonics.8b01526 · Cited by 134
A Self-Adaptive Mutation Neural Architecture Search Algorithm Based on Blocks
Xue, Y., Wang, Y., Liang, J., & Słowik, A. (2021) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2021.3084435 · Cited by 135
Colbrook, M. J., Antun, V., & Hansen, A. C. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2107151119 · Cited by 241
“Deep learning (DL) has demonstrated unparalleled accomplishments in fields ranging from image classification and computer vision [73, 85, 96], voice recognition and automated diagnosis in medicine [55, 87, 104], to inverse problems and image reconstruction [17, 80, 89, 107] (this list of areas is by no means exhaustiv…”
BackgroundKim, H. B., Lee, W. W., Kim, A., Lee, H. J., Park, H. Y., Jeon, H. S., Kim, S. K., Jeon, B., & Park, K. S. (2018) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2018.02.007 · Cited by 124
Compositional Falsification of Cyber-Physical Systems with Machine Learning Components
Dreossi, T., Donzé, A., & Seshia, S. A. (2019) · Journal of Automated Reasoning · doi:10.1007/s10817-018-09509-5 · Cited by 124
The growing ubiquity of algorithms in society: implications, impacts and innovations
Olhede, S. C., & Wolfe, P. J. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2017.0364 · Cited by 120
“In particular, neural networks became competitive, solving problems in speech recognition [68], image recognition [69] and language translation [70].”
Learning Functional Causal Models with Generative Neural Networks
Goudet, O., Kalainathan, D., Caillou, P., Guyon, I., Lopez-Paz, D., & Sebag, M. (2018) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-319-98131-4_3 · Cited by 123
ACDIN: Bridging the gap between artificial and real bearing damages for bearing fault diagnosis
Chen, Y., Peng, G., Xie, C., Zhang, W., Li, C., & Liu, S. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.03.014 · Cited by 121
ChatGPT for digital forensic investigation: The good, the bad, and the unknown
Scanlon, M., Breitinger, F., Hargreaves, C., Hilgert, J.-N., & Sheppard, J. (2023) · Forensic Science International: Digital Investigation · doi:10.1016/j.fsidi.2023.301609 · Cited by 118
Towards Proving the Adversarial Robustness of Deep Neural Networks
Katz, G., Barrett, C., Dill, D. L., Julian, K., & Kochenderfer, M. J. (2017) · Electronic Proceedings in Theoretical Computer Science · doi:10.4204/eptcs.257.3 · Cited by 115
Bradshaw, J., Matthews, A. G. D. G., & Ghahramani, Z. (2017) · arXiv · doi:10.48550/arxiv.1707.02476 · Cited by 109
Neuroinspired unsupervised learning and pruning with subquantum CBRAM arrays
Shi, Y., Nguyen, L., Oh, S., Liu, X., Koushan, F., Jameson, J. R., & Kuzum, D. (2018) · Nature Communications · doi:10.1038/s41467-018-07682-0 · Cited by 106
Data Augmentation for Deep Neural Networks Model in EEG Classification Task: A Review
He, C., Liu, J., Zhu, Y., & Du, W. (2021) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2021.765525 · Cited by 105
Malik, H., Farooq, M. S., Khelifi, A., Abid, A., Nasir Qureshi, J., & Hussain, M. (2020) · IEEE Access · doi:10.1109/access.2020.3004766 · Cited by 104
Consistency and fluctuations for stochastic gradient Langevin dynamics
(2016) · Warwick Research Archive Portal (University of Warwick) · doi:10.5555/2946645.2946652 · Cited by 104
On the Binding Problem in Artificial Neural Networks
Greff, K., van Steenkiste, S., & Schmidhuber, J. (2020) · arXiv · doi:10.48550/arxiv.2012.05208 · Cited by 102
Automatic Emotion Recognition Using Temporal Multimodal Deep Learning
Nakisa, B., Rastgoo, M. N., Rakotonirainy, A., Maire, F., & Chandran, V. (2020) · IEEE Access · doi:10.1109/access.2020.3027026 · Cited by 101
Towards real-time Speech Emotion Recognition using deep neural networks
Fayek, H. M., Lech, M., & Cavedon, L. (2015) · 2015 9th International Conference on Signal Processing and Communication Systems (ICSPCS) · doi:10.1109/icspcs.2015.7391796 · Cited by 103
A survey on machine learning from few samples
Lu, J., Gong, P., Ye, J., Zhang, J., & Zhang, C. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.109480 · Cited by 100
Adaptive Demodulator Using Machine Learning for Orbital Angular Momentum Shift Keying
Li, J., Zhang, M., & Wang, D. (2017) · IEEE Photonics Technology Letters · doi:10.1109/lpt.2017.2726139 · Cited by 94
Nokkala, J., Martínez-Peña, R., Giorgi, G. L., Parigi, V., Soriano, M. C., & Zambrini, R. (2020) · arXiv · doi:10.48550/arxiv.2006.04821 · Cited by 94
Analyzing machine learning models to accelerate generation of fundamental materials insights
Umehara, M., Stein, H. S., Guevarra, D., Newhouse, P. F., Boyd, D. A., & Gregoire, J. M. (2019) · npj Computational Materials · doi:10.1038/s41524-019-0172-5 · Cited by 91
Benou, A., Veksler, R., Friedman, A., & Riklin Raviv, T. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.006 · Cited by 91
When deep learning meets edge computing
Huang, Y., Ma, X., Fan, X., Liu, J., & Gong, W. (2017) · 2017 IEEE 25th International Conference on Network Protocols (ICNP) · doi:10.1109/icnp.2017.8117585 · Cited by 89
An integrated model of voice-user interface continuance intention: The gender effect
Nguyen, Q. N., Ta, A., & Prybutok, V. (2019) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2018.1525023 · Cited by 87
McInnes, G., Sharo, A. G., Koleske, M. L., Brown, J. E. H., Norstad, M., Adhikari, A. N., Wang, S., Brenner, S. E., Halpern, J., Koenig, B. A., et al. (2021) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2021.03.003 · Cited by 86
Wiebe, N., Kapoor, A., & Svore, K. M. (2016) · Quantum Information and Computation · doi:10.26421/qic16.7-8-1 · Cited by 85
“Our algorithms can also be better parallelized over multiple quantum processors, addressing a shortcoming of deep learning [30].”
BackgroundMethodRevisiting Hidden Markov Models for Speech Emotion Recognition
Mao, S., Tao, D., Zhang, G., Ching, P. C., & Lee, T. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683172 · Cited by 83
Guo, J., Zhang, W., Fan, W., & Li, W. (2018) · Journal of Management Information Systems · doi:10.1080/07421222.2018.1523564 · Cited by 85
Clune, J. (2019) · arXiv · doi:10.48550/arxiv.1905.10985 · Cited by 82
“This same phenomenon has occurred in other modes of machine learning, such as sound (e.g. speech-to-text systems) [63], touch [49], natural language understanding and translation [36, 8, 177], and many more [52].”
BackgroundEom, Y. H., Chung, Y., Park, M., Hong, S. B., & Kim, M. S. (2021) · Energy · doi:10.1016/j.energy.2021.120542 · Cited by 81
Li, G., Liu, L., Wang, X., Dong, X., Zhao, P., & Feng, X. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01418-6_40 · Cited by 80
AI Systems Under Criminal Law: a Legal Analysis and a Regulatory Perspective
Lagioia, F., & Sartor, G. (2020) · Philosophy & Technology · doi:10.1007/s13347-019-00362-x · Cited by 75
The Characteristics of Voice Search: Comparing Spoken with Typed-in Mobile Web Search Queries
Guy, I. (2018) · ACM Transactions on Information Systems · doi:10.1145/3182163 · Cited by 71
A Survey of Deep Learning Applications to Autonomous Vehicle Control
Kuutti, S., Bowden, R., Jin, Y., Barber, P., & Fallah, S. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2962338 · Cited by 96
Improving Deep Learning for HAR with Shallow LSTMs
Bock, M., Hölzemann, A., Moeller, M., & Van Laerhoven, K. (2021) · 2021 International Symposium on Wearable Computers · doi:10.1145/3460421.3480419 · Cited by 74
Knaak, C., von Eßen, J., Kröger, M., Schulze, F., Abels, P., & Gillner, A. (2021) · Sensors · doi:10.3390/s21124205 · Cited by 73
A study of deep neural networks for human activity recognition
Sansano, E., Montoliu, R., & Belmonte Fernández, Ó. (2020) · Computational Intelligence · doi:10.1111/coin.12318 · Cited by 73
Gudivada, V. N., Irfan, M. T., Fathi, E., & Rao, D. L. (2016) · Handbook of Statistics · doi:10.1016/bs.host.2016.07.010 · Cited by 70
The Machine Learning Algorithm as Creative Musical Tool
Fiebrink, R., & Caramiaux, B. (2016) · arXiv · doi:10.48550/arxiv.1611.00379 · Cited by 69
“features are driving improvements in many applications involving analysis of rich media, including speech [Hinton et al., 2012], video [Mobahi et al.”
BackgroundMethodInfluentialMathur, A., Zhang, T., Bhattacharya, S., Velickovic, P., Joffe, L., Lane, N. D., Kawsar, F., & Lio, P. (2018) · 2018 17th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · doi:10.1109/ipsn.2018.00048 · Cited by 70
DNN Filter Bank Cepstral Coefficients for Spoofing Detection
Yu, H., Tan, Z.-H., Zhang, Y., Ma, Z., & Guo, J. (2017) · IEEE Access · doi:10.1109/access.2017.2687041 · Cited by 67
Understanding spoken language through TalkBank
MacWhinney, B. (2019) · Behavior Research Methods · doi:10.3758/s13428-018-1174-9 · Cited by 66
Rainey, S., Martin, S., Christen, A., Mégevand, P., & Fourneret, E. (2020) · Science and Engineering Ethics · doi:10.1007/s11948-020-00218-0 · Cited by 65
Uncertainty Assessment of Hyperspectral Image Classification: Deep Learning vs. Random Forest
Shadman Roodposhti, M., Aryal, J., Lucieer, A., & Bryan, B. A. (2019) · Entropy · doi:10.3390/e21010078 · Cited by 65
“Deep Neural Network (DNN) Here, multiple layers of hidden units were applied between the inputs and the outputs of the model [52 – 54]. deep learning algorithm applied in this research is Each hidden unit, j, typically uses the logistic function β the closely related hyperbolic tangent is also…”
MethodHidden neural states underlie canary song syntax
Cohen, Y., Shen, J., Semu, D., Leman, D. P., Liberti, W. A., Perkins, L. N., Liberti, D. C., Kotton, D. N., & Gardner, T. J. (2020) · Nature · doi:10.1038/s41586-020-2397-3 · Cited by 65
iHear Food: Eating Detection Using Commodity Bluetooth Headsets
Gao, Y., Zhang, N., Wang, H., Ding, X., Ye, X., Chen, G., & Cao, Y. (2016) · 2016 IEEE First International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE) · doi:10.1109/chase.2016.14 · Cited by 63
Qian, Y., Ubale, R., Ramanaryanan, V., Lange, P., Suendermann-Oeft, D., Evanini, K., & Tsuprun, E. (2017) · 2017 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU) · doi:10.1109/asru.2017.8268987 · Cited by 62
Hyper-Dimensional Computing Challenges and Opportunities for AI Applications
Hassan, E., Halawani, Y., Mohammad, B., & Saleh, H. (2022) · IEEE Access · doi:10.1109/access.2021.3059762 · Cited by 61
Ensemble classification method for structural damage assessment under varying temperature
Fallahian, M., Khoshnoudian, F., & Meruane, V. (2018) · Structural Health Monitoring · doi:10.1177/1475921717717311 · Cited by 60
Recognizing Human Activities from Raw Accelerometer Data Using Deep Neural Networks
Zhang, L., Wu, X., & Luo, D. (2015) · 2015 IEEE 14th International Conference on Machine Learning and Applications (ICMLA) · doi:10.1109/icmla.2015.48 · Cited by 59
Qu, R., Xu, G., Ding, C., Jia, W., & Sun, M. (2020) · IEEE Access · doi:10.1109/access.2020.2991845 · Cited by 59
Georgiev, P., Lane, N. D., Rachuri, K. K., & Mascolo, C. (2016) · Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking · doi:10.1145/2973750.2973777 · Cited by 58
Regularized Speaker Adaptation of KL-HMM for Dysarthric Speech Recognition
Kim, M., Kim, Y., Yoo, J., Wang, J., & Kim, H. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2017.2681691 · Cited by 56
Real-Time Underwater Image Recognition with FPGA Embedded System for Convolutional Neural Network
Zhao, M., Hu, C., Wei, F., Wang, K., Wang, C., & Jiang, Y. (2019) · Sensors · doi:10.3390/s19020350 · Cited by 55
Zhang, Y., Liu, Y., Weninger, F., & Schuller, B. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7953106 · Cited by 55
“This point is particularly crucial when it comes to deep neural networks without special pre-training, which require significant amount of learning data [17].”
Background selection schema on deep learning-based classification of dermatological disease
Zhou, J., Wu, Z., Jiang, Z., Huang, K., Guo, K., & Zhao, S. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105966 · Cited by 53
Privacy-Preserving Deep Learning Based on Multiparty Secure Computation: A Survey
Zhang, Q., Xin, C., & Wu, H. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3058638 · Cited by 53
Orimaye, S. O., Wong, J. S.-M., & Wong, C. P. (2018) · PLOS ONE · doi:10.1371/journal.pone.0205636 · Cited by 52
Mariana: tencent deep learning platform and its applications
Zou, Y., Jin, X., Li, Y., Guo, Z., Wang, E., & Xiao, B. (2014) · Proceedings of the VLDB Endowment · doi:10.14778/2733004.2733082 · Cited by 49
Safety First: Conversational Agents for Health Care
Bickmore, T., Trinh, H., Asadi, R., & Olafsson, S. (2018) · Human–Computer Interaction Series · doi:10.1007/978-3-319-95579-7_3 · Cited by 50
User adaptation of convolutional neural network for human activity recognition
Matsui, S., Inoue, N., Akagi, Y., Nagino, G., & Shinoda, K. (2017) · 2017 25th European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco.2017.8081308 · Cited by 46
Zhao, C., Jiang, J., Guan, Y., Guo, X., & He, B. (2018) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2018.03.005 · Cited by 41
Modeling multimodal cues in a deep learning-based framework for emotion recognition in the wild
Pini, S., Ahmed, O. B., Cornia, M., Baraldi, L., Cucchiara, R., & Huet, B. (2017) · Proceedings of the 19th ACM International Conference on Multimodal Interaction · doi:10.1145/3136755.3143006 · Cited by 44
Mercury: Efficient On-Device Distributed DNN Training via Stochastic Importance Sampling
Zeng, X., Yan, M., & Zhang, M. (2021) · Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/3485730.3485930 · Cited by 43
Improving Design Preference Prediction Accuracy Using Feature Learning
Burnap, A., Pan, Y., Liu, Y., Ren, Y., Lee, H., Gonzalez, R., & Papalambros, P. Y. (2016) · Journal of Mechanical Design · doi:10.1115/1.4033427 · Cited by 42
QuClassi: A Hybrid Deep Neural Network Architecture based on Quantum State Fidelity
Stein, S. A., Baheri, B., Chen, D., Mao, Y., Guan, Q., Li, A., Xu, S., & Ding, C. (2021) · arXiv · doi:10.48550/arxiv.2103.11307 · Cited by 41
A Deep Learning Method Combined Sparse Autoencoder with SVM
Ju, Y., Guo, J., & Liu, S. (2015) · 2015 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery · doi:10.1109/cyberc.2015.39 · Cited by 37
Cunningham, R. J., & Loram, I. D. (2020) · Journal of The Royal Society Interface · doi:10.1098/rsif.2019.0715 · Cited by 36
Real-Time Activity Recognition on Smartphones Using Deep Neural Networks
Zhang, L., Wu, X., & Luo, D. (2015) · 2015 IEEE 12th Intl Conf on Ubiquitous Intelligence and Computing and 2015 IEEE 12th Intl Conf on Autonomic and Trusted Computing and 2015 IEEE 15th Intl Conf on Scalable Computing and Communications and Its Associated Workshops (UIC-ATC-ScalCom) · doi:10.1109/uic-atc-scalcom-cbdcom-iop.2015.224 · Cited by 35
Lea, C., Huang, Z., Narain, J., Tooley, L., Yee, D., Tran, D. T., Georgiou, P., Bigham, J. P., & Findlater, L. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581224 · Cited by 35
Shahin, M., Ahmed, B., McKechnie, J., Ballard, K., & Gutierrez-Osuna, R. (2014) · Interspeech 2014 · doi:10.21437/interspeech.2014-377 · Cited by 34
“We compare the performance of two different acoustic models, the conventional GMM-HMM and the hybrid DNN-HMM [14], which has been reported to outperform the conventional GMM-HMM model in other applications [15], [16] particularly with smaller training datasets [17].”
Representing high throughput expression profiles via perturbation barcodes reveals compound targets
Filzen, T. M., Kutchukian, P. S., Hermes, J. D., Li, J., & Tudor, M. (2017) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005335 · Cited by 31
Image-based Deep Reinforcement Learning for Autonomous Lunar Landing
Scorsoglio, A., Furfaro, R., Linares, R., & Gaudet, B. (2020) · AIAA Scitech 2020 Forum · doi:10.2514/6.2020-1910 · Cited by 31
Anelli, V. W., Deldjoo, Y., Di Noia, T., Malitesta, D., & Merra, F. A. (2021) · Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3404835.3462848 · Cited by 31
Automated Speech Recognition in Adult Stroke Survivors: Comparing Human and Computer Transcriptions
Jacks, A., Haley, K. L., Bishop, G., & Harmon, T. G. (2019) · Folia Phoniatrica et Logopaedica · doi:10.1159/000499156 · Cited by 30
Free range startups? Market scope, academic founders, and the role of general knowledge in AI
Chattopadhyay, S., Honoré, F., & Won, S. (2025) · Strategic Management Journal · doi:10.1002/smj.3685 · Cited by 30
Mathematical Models of Overparameterized Neural Networks
Fang, C., Dong, H., & Zhang, T. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2020.3048020 · Cited by 26
Progress and Prospects for Spoken Language Technology: What Ordinary People Think
Moore, R. K., Li, H., & Liao, S.-H. (2016) · Interspeech 2016 · doi:10.21437/interspeech.2016-874 · Cited by 24
P300 event-related potential detection using one-dimensional convolutional capsule networks
Liu, X., Xie, Q., Lv, J., Huang, H., & Wang, W. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.114701 · Cited by 23
Real-time system for automatic cold strip surface defect detection
Kostenetskiy, P., Alkapov, R., Vetoshkin, N., Chulkevich, R., Napolskikh, I., & Poponin, O. (2019) · FME Transactions · doi:10.5937/fmet1904765k · Cited by 23
Herath, H. M. D. P. M., Weraniyagoda, W. A. S. A., Rajapaksha, R. T. M., Wijesekara, P. A. D. S. N., Sudheera, K. L. K., & Chong, P. H. J. (2022) · Sensors · doi:10.3390/s22186966 · Cited by 23
Classification of anti-submarine warfare sonar targets using a deep neural network
Berg, H., & Hjelmervik, K. T. (2018) · OCEANS 2018 MTS/IEEE Charleston · doi:10.1109/oceans.2018.8604847 · Cited by 22
Pelka, O., Friedrich, C. M., Nensa, F., Mönninghoff, C., Bloch, L., Jöckel, K.-H., Schramm, S., Sanchez Hoffmann, S., Winkler, A., Weimar, C., et al. (2020) · PLoS ONE · doi:10.1371/journal.pone.0236868 · Cited by 22
“Deep learning techniques [10] have improved prediction accuracies in object detection [11], speech recognition [12] and in medical imaging [13, 14].”
BackgroundKobler, R. J., & Scherer, R. (2016) · 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC) · doi:10.1109/smc.2016.7844284 · Cited by 20
Online normalizer calculation for softmax
Milakov, M., & Gimelshein, N. (2018) · arXiv · doi:10.48550/arxiv.1805.02867 · Cited by 27
“Neural networks models are widely used for language modeling, for tasks such as machine translation [1] and speech recognition [2].”
Adaptive e-Learning AI-Powered Chatbot based on Multimedia Indexing
Janati, S. E., Maach, A., & El, D. (2020) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2020.0111238 · Cited by 20
Preserving Patient Privacy while Training a Predictive Model of In-hospital Mortality
Sharma, P., Shamout, F. E., & Clifton, D. A. (2019) · arXiv · doi:10.48550/arxiv.1912.00354 · Cited by 18
“In recent years, deep learning has achieved state-of-the-art performance that surpasses human level performance across various tasks in computer vision, speech recognition, and natural language processing [1, 2, 3].”
Jo, T., Kim, J., Bice, P., Huynh, K., Wang, T., Arnold, M., Meikle, P. J., Giles, C., Kaddurah-Daouk, R., Saykin, A. J., et al. (2023) · eBioMedicine · doi:10.1016/j.ebiom.2023.104820 · Cited by 15
“11 However, its application to tabular data, 12 which often has a smaller sample size and a more straightforward feature set, has not consistently shown effectiveness.”
BackgroundKwon, H., Tong, C., Haresamudram, H., Gao, Y., Abowd, G. D., Lane, N. D., & Ploetz, T. (2020) · arXiv · doi:10.48550/arxiv.2006.05675 · Cited by 14
“Regardless of its utility, the HAR field has yet to experience significant improvements in recognition accuracy, in contrast to the breakthroughs in other fields, such as speech recognition [34], natural language processing [19], and computer vision [32].”
BackgroundHolzinger, A., Carrington, A., & Müller, H. (2019) · arXiv · doi:10.48550/arxiv.1912.09024 · Cited by 11
Failure Prediction by Confidence Estimation of Uncertainty-Aware Dirichlet Networks
Tsiligkaridis, T. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9414153 · Cited by 11
Person Re-ID by Fusion of Video Silhouettes and Wearable Signals for Home Monitoring Applications
Masullo, A., Burghardt, T., Damen, D., Perrett, T., & Mirmehdi, M. (2020) · Sensors · doi:10.3390/s20092576 · Cited by 10
State and capacity in neural models of cognition and consciousness
Wang, P., Liu, H., Ilievski, F., Ganushchak, L., Zou, L., Laureys, S., & Paas, F. (2026) · Trends Open · doi:10.1016/j.treopn.2026.04.004 · Cited by 8
A deep neural network for audio-visual person recognition
Alam, M. R., Bennamoun, M., Togneri, R., & Sohel, F. (2015) · 2015 IEEE 7th International Conference on Biometrics Theory, Applications and Systems (BTAS) · doi:10.1109/btas.2015.7358754 · Cited by 8
Zeki Güngördü, M., Kung, P., & Kim, S. M. (2023) · Optics Express · doi:10.1364/oe.481094 · Cited by 5
Metadata
- Authors
- Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., & Kingsbury, B.
- Affiliations
- University of Toronto (CA)
- University of Waterloo (CA)
- Microsoft (United States) (US)
- Google (United States) (US)
- IBM (United States) (US)
- Michigan State University (US)
- Venue
- IEEE Signal Processing Magazine
- Published
- 2012-11
- Volume
- 29
- Issue
- 6
- Pages
- 82-97
- ISSN
- 1053-5888 (ISSN-L)
- OpenAlex
- W2160815625
- Cited by
- 10,260
- References
- 71
- Citations by year
- 2026: 253 · 2025: 526 · 2024: 610 · 2023: 696 · 2022: 837 · 2021: 978 · 2020: 1232 · 2019: 1313 · 2018: 1220 · 2017: 967 · 2016: 712 · 2015: 498 · 2014: 276 · 2013: 128 · 2012: 9
- FWCI
- 284.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Signal Processing Magazine (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- deep neural network, acoustic modeling, speech recognition, hidden Markov models, Gaussian mixture model, feedforward neural networks, posterior probability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.