Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups
The DOI matches its Crossref record; 68 of the 71 references it cites were found in a registry or an index.
Abstract
Most current speech recognition systems use hidden Markov models (HMMs) to deal with the temporal variability of speech and Gaussian mixture models (GMMs) to determine how well each state of each HMM fits a frame or a short window of frames of coefficients that represents the acoustic input. An alternative way to evaluate the fit is to use a feed-forward neural network that takes several frames of coefficients as input and produces posterior probabilities over HMM states as output. Deep neural networks (DNNs) that have many hidden layers and are trained using new methods have been shown to outperform GMMs on a variety of speech recognition benchmarks, sometimes by a large margin. This article provides an overview of this progress and represents the shared views of four research groups that have had recent successes in using DNNs for acoustic modeling in speech recognition.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Deep Learning has largely alleviated the need for manual feature extraction, achieving state-ofthe-art performance in fields such as computer vision and speech recognition [13,14].”
From EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces (2018) · cites this paper as [13]
In the citing paper
“In particular, neural networks became competitive, solving problems in speech recognition [68], image recognition [69] and language translation [70].”
From The growing ubiquity of algorithms in society: implications, impacts and innovations (2018) · cites this paper as [68]
In the citing paper
“Apart from images, sequential data such as text and audio can also be processed with DNNs to reach state-of-the-art performance for document classification and speech recognition.”
From Deep learning for time series classification: a review (2019) · cites this paper as Hinton et al., 2012
In the citing paper
“The other more direct reason behind the high accuracies of deep CNNs on time series data is its success in other sequential data such as speech recognition (Hinton et al., 2012) and sentence classification (Kim, 2014)”
From Deep learning for time series classification: a review (2019) · cites this paper as Hinton et al., 2012
In the citing paper
“Recent studies have reported that deep learning methods have been successfully applied to many applications areas e.g., image and video classification [11-13], visual tracking [14], speech recognition [15] and natural language processing [16].”
From Medical image retrieval using deep convolutional neural network (2017) · cites this paper as [15]
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Self-citationReducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Self-citationA fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Self-citation(2010) · Cited by 14,134
Training Products of Experts by Minimizing Contrastive Divergence
Hinton, G. E. (2002) · Neural Computation · doi:10.1162/089976602760128018 · Cited by 4,879 · cited 3×
“…learning algorithm for a restricted Boltzmann machine (RBM) which consists of a layer of stochastic binary " visible " units that represent binary input data connected to a layer of stochastic binary hidden units that learn to model significant nonindependencies between the visible units [20].”
InfluentialSelf-citation(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011
Self-citationA Practical Guide to Training Restricted Boltzmann Machines
Hinton, G. E. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_32 · Cited by 2,852 · cited 2×
“Learning the standard deviations of a GRBM is problematic for reasons described in [21], so for pretraining using CD 1 , the data are normalized so that each coefficient has zero mean and unit variance, the standard deviations are set to one when computing ( ) v h p ; , and no noise is added to the…”
Self-citationPerceptual linear predictive (PLP) analysis of speech
Hermansky, H. (1990) · The Journal of the Acoustical Society of America · doi:10.1121/1.399423 · Cited by 2,536
Acoustic Modeling Using Deep Belief Networks
Mohamed, A.-R., Dahl, G. E., & Hinton, G. (2012) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2011.2109382 · Cited by 1,727
Self-citation
Research works printed but not linked: 5
- sainath, 2011, Improvements in using deep belief networks for large vocabulary continuous speech recognition, Speech and Language Algorithm Group IBM Yorktown Heights NY Tech Rep UTML TR 2010-003
- rifai, 0, Contractive autoencoders: Explicit invariance during feature extraction, Proc 28th Int Conf Machine Learning, 833
- yu, 2011, Discriminative pretraining of deep neural networks, U S Patent Filing
- mohamed, 0, Deep belief networks for phone recognition, Proc NIPS Workshop Deep Learning for Speech Recognition and Related Applications
- pearl, 1988, Probabilistic Inference in Intelligent Systems Networks of Plausible Inference
Cited by
Items 401–500 of 1,106
Multichannel Audio Source Separation With Deep Neural Networks
Nugraha, A. A., Liutkus, A., & Vincent, E. (2016) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2016.2580946 · Cited by 300
A survey of regularization strategies for deep models
Moradi, R., Berangi, R., & Minaei, B. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-019-09784-7 · Cited by 297
“In addition to beating records in image recognition (Krizhevsky et al. 2012; Szegedy et al. 2014; He et al. 2016) and speech recognition (Hinton et al. 2012), it has beaten other machine learning techniques at predicting the activity of potential drug molecules (Ma et al. 2015), reconstructing…”
BackgroundMethodInfluentialFP-BNN: Binarized neural network on FPGA
Liang, S., Yin, S., Liu, L., Luk, W., & Wei, S. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.09.046 · Cited by 298
Application of Deep Convolutional Neural Networks for Detecting Extreme Weather in Climate Datasets
Liu, Y., Racah, E., Prabhat, Correa, J., Khosrowshahi, A., Lavers, D. A., Kunkel, K. E., Wehner, M. F., & Collins, W. D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.01156 · Cited by 292
Spoken Language Recognition: From Fundamentals to Practice
Li, H., Ma, B., & Lee, K. A. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2237151 · Cited by 296
An Introduction to Neural Information Retrieval
Mitra, B., & Craswell, N. (2018) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000061 · Cited by 317
“These breakthroughs were largely fuelled by recent advances in neural network models, usually with multiple hidden layers, known as deep architectures (Krizhevsky et al., 2012; LeCun et al., 2015; Hinton et al., 2012; Bahdanau et al., 2014; Deng, Yu, et al., 2014) combined with the availability of large datasets (Wiss…”
A Data-Driven Soft Sensor Modeling Method Based on Deep Learning and its Application
Yan, W., Tang, D., & Lin, Y. (2017) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2016.2622668 · Cited by 294
Deep materials informatics: Applications of deep learning in materials science
Agrawal, A., & Choudhary, A. (2019) · MRS Communications · doi:10.1557/mrc.2019.73 · Cited by 294
Dimensionality-Driven Learning with Noisy Labels
Ma, X., Wang, Y., Houle, M. E., Zhou, S., Erfani, S., Xia, S., Wijewickrema, S. N. R., & Bailey, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.02612 · Cited by 217
Pan, J., Zi, Y., Chen, J., Zhou, Z., & Wang, B. (2018) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2017.2767540 · Cited by 294
Robertson, S., Azizpour, H., Smith, K., & Hartman, J. (2018) · Translational Research · doi:10.1016/j.trsl.2017.10.010 · Cited by 295
A deep learning framework for remote sensing image registration
Wang, S., Quan, D., Liang, X., Ning, M., Guo, Y., & Jiao, L. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2017.12.012 · Cited by 292
Highway long short-term memory RNNS for distant speech recognition
Zhang, Y., Chen, G., Yu, D., Yao, K., Khudanpur, S., & Glass, J. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472780 · Cited by 290
Self-citationA Simple Method for Commonsense Reasoning
Trinh, T. H., & Le, Q. V. (2018) · arXiv · doi:10.48550/arxiv.1806.02847 · Cited by 293
Broadband doa estimation using convolutional neural networks trained with noise signals
Chakrabarty, S., & Habets, E. A. P. (2017) · 2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) · doi:10.1109/waspaa.2017.8170010 · Cited by 286
Machine learning for wireless communications in the Internet of Things: A comprehensive survey
Jagannath, J., Polosky, N., Jagannath, A., Restuccia, F., & Melodia, T. (2019) · Ad Hoc Networks · doi:10.1016/j.adhoc.2019.101913 · Cited by 288
Deep learning for misinformation detection on online social networks: a survey and new perspectives
Islam, M. R., Liu, S., Wang, X., & Xu, G. (2020) · Social Network Analysis and Mining · doi:10.1007/s13278-020-00696-x · Cited by 289
Classification of Diabetic Retinopathy Images by Using Deep Learning Models
Dutta, S., Manideep, B. C., Basha, S. M., Caytiles, R. D., & Iyengar, N. C. S. N. (2018) · International Journal of Grid and Distributed Computing · doi:10.14257/ijgdc.2018.11.1.09 · Cited by 287
Deep learning methods in transportation domain: a review
Nguyen, H., Kieu, L., Wen, T., & Cai, C. (2018) · IET Intelligent Transport Systems · doi:10.1049/iet-its.2018.0064 · Cited by 285
Demystifying Membership Inference Attacks in Machine Learning as a Service
Truex, S., Liu, L., Gursoy, M. E., Yu, L., & Wei, W. (2021) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2019.2897554 · Cited by 282
“nition [36], [37] to natural language processing [38].”
Deep Learning Enabled Semantic Communications With Speech Recognition and Synthesis
Weng, Z., Qin, Z., Tao, X., Pan, C., Liu, G., & Li, G. Y. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3240969 · Cited by 286
“[25], [26], [27], in which DNN replaces the traditional Gaussian mixture model that is utilized to estimate the distribution of hidden Markov model.”
MethodAnalysis of CNN-based speech recognition system using raw speech as input
Palaz, D., Magimai-Doss, M., & Collobert, R. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-3 · Cited by 288
GeePS: scalable deep learning on distributed GPUs with a GPU-specialized parameter server
Cui, H., Zhang, H., Ganger, G. R., Gibbons, P. B., & Xing, E. P. (2016) · Proceedings of the Eleventh European Conference on Computer Systems · doi:10.1145/2901318.2901323 · Cited by 286
Yang, C., Bai, L., Zhang, C., Yuan, Q., & Han, J. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098094 · Cited by 286
Practical Black-Box Attacks against Deep Learning Systems using Adversarial Examples.Preprint
Papernot, N., McDaniel, P. D., Goodfellow, I., Jha, S., Celik, Z. B., & Swami, A. (2016) · arXiv (Cornell University) · Cited by 350
Extracting deep bottleneck features using stacked auto-encoders
Gehring, J., Miao, Y., Metze, F., & Waibel, A. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638284 · Cited by 274
Predictive large-eddy-simulation wall modeling via physics-informed neural networks
Yang, X. I. A., Zafar, S., Wang, J.-X., & Xiao, H. (2019) · Physical Review Fluids · doi:10.1103/physrevfluids.4.034602 · Cited by 286
An enhanced convolutional neural network for bearing fault diagnosis based on time–frequency image
Zhang, Y., Xing, K., Bai, R., Sun, D., & Meng, Z. (2020) · Measurement · doi:10.1016/j.measurement.2020.107667 · Cited by 283
Detection and classification of soybean pests using deep learning with UAV images
Tetila, E. C., Machado, B. B., Astolfi, G., Belete, N. A. D. S., Amorim, W. P., Roel, A. R., & Pistori, H. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2020.105836 · Cited by 283
Yu, X., Wu, X., Luo, C., & Ren, P. (2017) · GIScience & Remote Sensing · doi:10.1080/15481603.2017.1323377 · Cited by 283
Privacy and Security Issues in Deep Learning: A Survey
Liu, X., Xie, L., Wang, Y., Zou, J., Xiong, J., Ying, Z., & Vasilakos, A. V. (2021) · IEEE Access · doi:10.1109/access.2020.3045078 · Cited by 282
Augmenting Image Classifiers Using Data Augmentation Generative Adversarial Networks
Antoniou, A., Storkey, A., & Edwards, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01424-7_58 · Cited by 278
Disease Staging and Prognosis in Smokers Using Deep Learning in Chest Computed Tomography
González, G., Ash, S. Y., Vegas-Sánchez-Ferrero, G., Onieva Onieva, J., Rahaghi, F. N., Ross, J. C., Díaz, A., San José Estépar, R., & Washko, G. R. (2018) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.201705-0860oc · Cited by 281
Solar Irradiance Forecasting Using Deep Neural Networks
Alzahrani, A., Shamsi, P., Dagli, C., & Ferdowsi, M. (2017) · Procedia Computer Science · doi:10.1016/j.procs.2017.09.045 · Cited by 280
“Several studies [22-23] suggest that with more hidden layers, the neural network is capable of representing complex function more efficiently than RNN with less hidden layers.”
BackgroundHe, Z., Rakin, A. S., & Fan, D. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00068 · Cited by 259
The Future of Human-AI Collaboration: A Taxonomy of Design Knowledge for Hybrid Intelligence Systems
Dellermann, D., Calma, A., Lipusch, N., Weber, T., Weigel, S., & Ebel, P. (2019) · Proceedings of the Annual Hawaii International Conference on System Sciences · doi:10.24251/hicss.2019.034 · Cited by 279
“First, recognition defines tasks that recognize for instance objects [17], images [37], or natural language [38].”
BackgroundPerceptual-Sensitive GAN for Generating Adversarial Patches
Liu, A., Liu, X., Fan, J., Ma, Y., Zhang, A., Xie, H., & Tao, D. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33011028 · Cited by 266
Detection of Pathological Voice Using Cepstrum Vectors: A Deep Learning Approach
Fang, S.-H., Tsao, Y., Hsiao, M.-J., Chen, J.-Y., Lai, Y.-H., Lin, F.-C., & Wang, C.-T. (2019) · Journal of Voice · doi:10.1016/j.jvoice.2018.02.003 · Cited by 278
Multilingual acoustic models using distributed deep neural networks
Heigold, G., Vanhoucke, V., Senior, A., Nguyen, P., Ranzato, M., Devin, M., & Dean, J. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639348 · Cited by 273
Self-citationImproving deep neural network acoustic models using generalized maxout networks
Zhang, X., Trmal, J., Povey, D., & Khudanpur, S. (2014) · 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2014.6853589 · Cited by 273
Whittington, J. C. R., & Bogacz, R. (2017) · Neural Computation · doi:10.1162/neco_a_00949 · Cited by 278
“…1989; Chauvin & Rumelhart, 1995; Bogacz, Markowska-Kaczmar, & Kozik, 1999) and have become particularly popular recently, with the newer deep networks having some spectacular results, now able to equal and outperform humans in many tasks (Krizhevsky, Sutskever, & Hinton, 2012; Hinton et al., 2012).”
Elmasry, W., Akbulut, A., & Zaim, A. H. (2020) · Computer Networks · doi:10.1016/j.comnet.2019.107042 · Cited by 277
CANet: An Unsupervised Intrusion Detection System for High Dimensional CAN Bus Data
Hanselmann, M., Strauss, T., Dormann, K., & Ulmer, H. (2020) · IEEE Access · doi:10.1109/access.2020.2982544 · Cited by 268
“With the advances in deep learning in the recent years [4]–[6] new tools are becoming available that have the potential of detecting unknown attacks.”
BackgroundOpportunities and challenges for quantum-assisted machine learning in near-term quantum computers
Perdomo-Ortiz, A., Benedetti, M., Realpe-Gómez, J., & Biswas, R. (2018) · Quantum Science and Technology · doi:10.1088/2058-9565/aab859 · Cited by 274
“Examples of such problems include image and speech recognition [2, 3], autonomous systems [4], medical applications [5], biology [6], artificial intelligence [7], andmany others.”
BackgroundMtNet: A Multi-Task Neural Network for Dynamic Malware Classification
Huang, W., & Stokes, J. W. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-40667-1_20 · Cited by 262
Emerging Wearable Interfaces and Algorithms for Hand Gesture Recognition: A Survey
Jiang, S., Kang, P., Song, X., Lo, B., & Shull, P. (2022) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2021.3078190 · Cited by 270
Peng, D., Liu, Z., Wang, H., Qin, Y., & Jia, L. (2019) · IEEE Access · doi:10.1109/access.2018.2888842 · Cited by 271
Deep learning methods and applications for electrical power systems: A comprehensive review
Ozcanli, A. K., Yaprakdal, F., & Baysal, M. (2020) · International Journal of Energy Research · doi:10.1002/er.5331 · Cited by 270
Automatic handgun detection alarm in videos using deep learning
Olmos, R., Tabik, S., & Herrera, F. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.05.012 · Cited by 270
Detecting Adversarial Image Examples in Deep Neural Networks with Adaptive Noise Reduction
Liang, B., Li, H., Su, M., Li, X., Shi, W., & Wang, X. (2021) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2018.2874243 · Cited by 196
A brief survey of machine learning methods and their sensor and IoT applications
Shanthamallu, U. S., Spanias, A., Tepedelenlioglu, C., & Stanley, M. (2017) · 2017 8th International Conference on Information, Intelligence, Systems & Applications (IISA) · doi:10.1109/iisa.2017.8316459 · Cited by 264
Caffeine: Toward Uniformed Representation and Acceleration for Deep Convolutional Neural Networks
Zhang, C., Sun, G., Fang, Z., Zhou, P., Pan, P., & Cong, J. (2019) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2017.2785257 · Cited by 270
Cyber Security in IoT-Based Cloud Computing: A Comprehensive Survey
Ahmad, W., Rasool, A., Javed, A. R., Baker, T., & Jalil, Z. (2021) · Electronics · doi:10.3390/electronics11010016 · Cited by 268
Polyphonic sound event detection using multi label deep neural networks
Cakir, E., Heittola, T., Huttunen, H., & Virtanen, T. (2015) · 2015 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280624 · Cited by 256
Deep Kernel LearningPreprint
Wilson, A. G., Hu, Z., Salakhutdinov, R., & Xing, E. P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.02222 · Cited by 909
SVM or deep learning? A comparative study on remote sensing image classification
Liu, P., Choo, K.-K. R., Wang, L., & Huang, F. (2017) · Soft Computing · doi:10.1007/s00500-016-2247-2 · Cited by 267
Understanding Physics-Informed Neural Networks: Techniques, Applications, Trends, and Challenges
Farea, A., Yli-Harja, O., & Emmert-Streib, F. (2024) · AI · doi:10.3390/ai5030074 · Cited by 259
Zen, H., & Sak, H. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178816 · Cited by 262
Fundamentals of speech recognition
Li, J., Deng, L., Haeb-Umbach, R., & Gong, Y. (2016) · Robust Automatic Speech Recognition · doi:10.1016/b978-0-12-802398-3.00002-7 · Cited by 266
Self-citationLiu, T., Abd-Elrahman, A., Morton, J., & Wilhelm, V. L. (2018) · GIScience & Remote Sensing · doi:10.1080/15481603.2018.1426091 · Cited by 266
Rathi, N., & Roy, K. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3111897 · Cited by 264
“At the same time in standard deep learning, the analog-valued artificial neural networks (ANNs) became the de facto model for training various computer vision and natural language processing tasks [4], [5].”
BackgroundRobust Sound Event Classification Using Deep Neural Networks
McLoughlin, I., Zhang, H., Xie, Z., Song, Y., & Xiao, W. (2015) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2015.2389618 · Cited by 265
Big data analytics: Computational intelligence techniques and application areas
Iqbal, R., Doctor, F., More, B., Mahmud, S., & Yousuf, U. (2020) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2018.03.024 · Cited by 263
“…effective biologically inspired computational modelling techniques for addressing tasks such as speech perception and object recognition by extracting multiple levels of representation from various sensory inputs and signals (Bekkerman, 2011) (Bengio, 2009) (Hinton,2012) (Le, 2013) (Campo, 2014).”
Cikes, M., Sanchez-Martinez, S., Claggett, B., Duchateau, N., Piella, G., Butakoff, C., Pouleur, A. C., Knappe, D., Biering-Sørensen, T., Kutyifa, V., et al. (2019) · European Journal of Heart Failure · doi:10.1002/ejhf.1333 · Cited by 266
Deep learning for tactile understanding from visual and haptic data
Gao, Y., Hendricks, L. A., Kuchenbecker, K. J., & Darrell, T. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487176 · Cited by 264
“In order to effectively learn from haptic and visual data, we train deep neural networks, which have led to dramatic improvements in disparate learning tasks such as object recognition [23] and automatic speech recognition [19].”
BackgroundSequence to Sequence Weather Forecasting with Long Short-Term Memory Recurrent Neural Networks
Akram, M., & El, C. (2016) · International Journal of Computer Applications · doi:10.5120/ijca2016910497 · Cited by 264
Automated ECG Classification Using Dual Heartbeat Coupling Based on Convolutional Neural Network
Zhai, X., & Tin, C. (2018) · IEEE Access · doi:10.1109/access.2018.2833841 · Cited by 264
Parallel WaveNet: Fast High-Fidelity Speech Synthesis
van den Oord, A., Li, Y., Babuschkin, I., Simonyan, K., Vinyals, O., Kavukcuoglu, K., van den Driessche, G., Lockhart, E., Cobo, L. C., Stimberg, F., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.10433 · Cited by 330
Weed Identification Using Deep Learning and Image Processing in Vegetable Plantation
Jin, X., Che, J., & Chen, Y. (2021) · IEEE Access · doi:10.1109/access.2021.3050296 · Cited by 262
Intelligent Fault Diagnosis Method Based on Full 1-D Convolutional Generative Adversarial Network
Guo, Q., Li, Y., Song, Y., Wang, D., & Chen, W. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2934901 · Cited by 262
Visual place recognition: A survey from deep learning perspective
Zhang, X., Wang, L., & Su, Y. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2020.107760 · Cited by 261
Minerva: Enabling Low-Power, Highly-Accurate Deep Neural Network Accelerators
Reagen, B., Whatmough, P., Adolf, R., Rama, S., Lee, H., Lee, S. K., Hernandez-Lobato, J. M., Wei, G.-Y., & Brooks, D. (2016) · 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2016.32 · Cited by 246
Federated learning: Overview, strategies, applications, tools and future directions
Yurdem, B., Kuzlu, M., Gullu, M. K., Catak, F. O., & Tabassum, M. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e38137 · Cited by 251
A guidance to intelligent metamaterials and metamaterials intelligence
Qian, C., Kaminer, I., & Chen, H. (2025) · Nature Communications · doi:10.1038/s41467-025-56122-3 · Cited by 254
“The building blocks can be composed of, such as, subwavelength-scale metallic, dielectric, and semiconducting resonator.”
A patch-based convolutional neural network for remote sensing image classification
Sharma, A., Liu, X., Yang, X., & Shi, D. (2017) · Neural Networks · doi:10.1016/j.neunet.2017.07.017 · Cited by 260
“[42] Geoffrey Hinton, Li Deng , Dong Yu , George E Dahl , Abdel rahman Mohamed , Navdeep Jaitly , Andrew Senior , Vincent Vanhoucke , Patrick Nguyen , Tara N Sainath et al.”
BackgroundMethodCang, Z., Mu, L., & Wei, G.-W. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005929 · Cited by 257
Peng, P., Wen, Y., Yang, Y., Yuan, Q., Tang, Z., Long, H., & Wang, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.10069 · Cited by 241
Transferable Adversarial Perturbations
Zhou, W., Hou, X., Chen, Y., Tang, M., Huang, X., Gan, X., & Yang, Y. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01264-9_28 · Cited by 230
Recent Advances in Machine Learning for Fiber Optic Sensor Applications
Venketeswaran, A., Lalam, N., Wuenschell, J., Ohodnicki, P. R., Badar, M., Chen, K. P., Lu, P., Duan, Y., Chorpening, B., & Buric, M. (2022) · Advanced Intelligent Systems · doi:10.1002/aisy.202100067 · Cited by 253
Learning small-size DNN with output-distribution-based criteria
Li, J., Zhao, R., Huang, J.-T., & Gong, Y. (2014) · Interspeech 2014 · doi:10.21437/interspeech.2014-432 · Cited by 248
Motor Fault Diagnosis Based on Short-time Fourier Transform and Convolutional Neural Network
Wang, L.-H., Zhao, X.-P., Wu, J.-X., Xie, Y.-Y., & Zhang, Y.-H. (2017) · Chinese Journal of Mechanical Engineering · doi:10.1007/s10033-017-0190-5 · Cited by 251
Li, K., Pan, W., Li, Y., Jiang, Q., & Liu, G. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.03.011 · Cited by 254
Learning with a Strong Adversary
Huang, R., Xu, B. H., Schuurmans, D., & Szepesvári, C. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.03034 · Cited by 240
Survey on Deep Neural Networks in Speech and Vision Systems
Alam, M., Samad, M. D., Vidyaratne, L., Glandon, A., & Iftekharuddin, K. M. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.07.053 · Cited by 252
Fake News Detection Using Machine Learning approaches: A systematic Review
Manzoor, S. I., Singla, J., & Nikita (2019) · 2019 3rd International Conference on Trends in Electronics and Informatics (ICOEI) · doi:10.1109/icoei.2019.8862770 · Cited by 246
Remaining Useful Life Prediction using Deep Learning Approaches: A Review
Wang, Y., Zhao, Y., & Addepalli, S. (2020) · Procedia Manufacturing · doi:10.1016/j.promfg.2020.06.015 · Cited by 246
Convolutional Neural Networks for Distant Speech Recognition
Swietojanski, P., Ghoshal, A., & Renals, S. (2014) · IEEE Signal Processing Letters · doi:10.1109/lsp.2014.2325781 · Cited by 253
Learning thermodynamics with Boltzmann machines
Torlai, G., & Melko, R. G. (2016) · Physical Review B · doi:10.1103/physrevb.94.165134 · Cited by 252
Duan, M., Liu, D., Chen, X., Tan, Y., Ren, J., Qiao, L., & Liang, L. (2019) · 2019 IEEE 37th International Conference on Computer Design (ICCD) · doi:10.1109/iccd46524.2019.00038 · Cited by 250
Biological network analysis with deep learning
Muzio, G., O’Bray, L., & Borgwardt, K. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbaa257 · Cited by 248
“The promise of deep learning,based on its success in other fields [7, 8], is now also being seen across many different areas of biological network analysis.”
Artificial Intelligence in manufacturing: State of the art, perspectives, and future directions
Gao, R. X., Krüger, J., Merklein, M., Möhring, H.-C., & Váncza, J. (2024) · CIRP Annals · doi:10.1016/j.cirp.2024.04.101 · Cited by 237
Duan, M., Liu, D., Chen, X., Tan, Y., Ren, J., Qiao, L., & Liang, L. (2019) · arXiv · doi:10.48550/arxiv.1907.01132 · Cited by 250
Towards Fair and Privacy-Preserving Federated Deep Models
Lyu, L., Yu, J., Nandakumar, K., Li, Y., Ma, X., Jin, J., Yu, H., & Ng, K. S. (2020) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.2996273 · Cited by 250
A survey of intelligent transmission line inspection based on unmanned aerial vehicle
Luo, Y., Yu, X., Yang, D., & Zhou, B. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10189-2 · Cited by 243
“As a research hotspot in recent years, artificial intelligence has made remarkable achievements in many fields, such as image detection (Wang et al. 2005), speech recognition (Hinton et al. 2012), data analysis (Salloum et al. 2019) and so on.”
BackgroundMethodDeep Learning for Plant Species Classification Using Leaf Vein Morphometric
Tan, J. W., Chang, S.-W., Abdul-Kareem, S., Yap, H. J., & Yong, K.-T. (2020) · IEEE/ACM Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2018.2848653 · Cited by 247
Transformer-Based Acoustic Modeling for Hybrid Speech Recognition
Wang, Y., Mohamed, A., Le, D., Liu, C., Xiao, A., Mahadeokar, J., Huang, H., Tjandra, A., Zhang, X., Zhang, F., et al. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9054345 · Cited by 235
Self-citationLearning to Remember Rare Events
Kaiser, Ł., Nachum, O., Roy, A., & Bengio, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.03129 · Cited by 218
Improvements to Deep Convolutional Neural Networks for LVCSR
Sainath, T. N., Kingsbury, B., Mohamed, A.-R., Dahl, G. E., Saon, G., Soltau, H., Beran, T., Aravkin, A. Y., & Ramabhadran, B. (2013) · 2013 IEEE Workshop on Automatic Speech Recognition and Understanding · doi:10.1109/asru.2013.6707749 · Cited by 243
Self-citationFrom machine learning to deep learning: Advances in scoring functions for protein–ligand docking
Shen, C., Ding, J., Wang, Z., Cao, D., Ding, X., & Hou, T. (2020) · WIREs Computational Molecular Science · doi:10.1002/wcms.1429 · Cited by 244
A deep learning framework for modeling structural features of RNA-binding protein targets
Zhang, S., Zhou, J., Hu, H., Gong, H., Chen, L., Cheng, C., & Zeng, J. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkv1025 · Cited by 246
Metadata
- Authors
- Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., & Kingsbury, B.
- Affiliations
- University of Toronto (CA)
- University of Waterloo (CA)
- Microsoft (United States) (US)
- Google (United States) (US)
- IBM (United States) (US)
- Michigan State University (US)
- Venue
- IEEE Signal Processing Magazine
- Published
- 2012-11
- Volume
- 29
- Issue
- 6
- Pages
- 82-97
- ISSN
- 1053-5888 (ISSN-L)
- OpenAlex
- W2160815625
- Cited by
- 10,260
- References
- 71
- Citations by year
- 2026: 253 · 2025: 526 · 2024: 610 · 2023: 696 · 2022: 837 · 2021: 978 · 2020: 1232 · 2019: 1313 · 2018: 1220 · 2017: 967 · 2016: 712 · 2015: 498 · 2014: 276 · 2013: 128 · 2012: 9
- FWCI
- 284.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Signal Processing Magazine (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- deep neural network, acoustic modeling, speech recognition, hidden Markov models, Gaussian mixture model, feedforward neural networks, posterior probability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.