Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups
The DOI matches its Crossref record; 68 of the 71 references it cites were found in a registry or an index.
Abstract
Most current speech recognition systems use hidden Markov models (HMMs) to deal with the temporal variability of speech and Gaussian mixture models (GMMs) to determine how well each state of each HMM fits a frame or a short window of frames of coefficients that represents the acoustic input. An alternative way to evaluate the fit is to use a feed-forward neural network that takes several frames of coefficients as input and produces posterior probabilities over HMM states as output. Deep neural networks (DNNs) that have many hidden layers and are trained using new methods have been shown to outperform GMMs on a variety of speech recognition benchmarks, sometimes by a large margin. This article provides an overview of this progress and represents the shared views of four research groups that have had recent successes in using DNNs for acoustic modeling in speech recognition.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Deep Learning has largely alleviated the need for manual feature extraction, achieving state-ofthe-art performance in fields such as computer vision and speech recognition [13,14].”
From EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces (2018) · cites this paper as [13]
In the citing paper
“In particular, neural networks became competitive, solving problems in speech recognition [68], image recognition [69] and language translation [70].”
From The growing ubiquity of algorithms in society: implications, impacts and innovations (2018) · cites this paper as [68]
In the citing paper
“Apart from images, sequential data such as text and audio can also be processed with DNNs to reach state-of-the-art performance for document classification and speech recognition.”
From Deep learning for time series classification: a review (2019) · cites this paper as Hinton et al., 2012
In the citing paper
“The other more direct reason behind the high accuracies of deep CNNs on time series data is its success in other sequential data such as speech recognition (Hinton et al., 2012) and sentence classification (Kim, 2014)”
From Deep learning for time series classification: a review (2019) · cites this paper as Hinton et al., 2012
In the citing paper
“Recent studies have reported that deep learning methods have been successfully applied to many applications areas e.g., image and video classification [11-13], visual tracking [14], speech recognition [15] and natural language processing [16].”
From Medical image retrieval using deep convolutional neural network (2017) · cites this paper as [15]
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Self-citationReducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Self-citationA fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Self-citation(2010) · Cited by 14,134
Training Products of Experts by Minimizing Contrastive Divergence
Hinton, G. E. (2002) · Neural Computation · doi:10.1162/089976602760128018 · Cited by 4,879 · cited 3×
“…learning algorithm for a restricted Boltzmann machine (RBM) which consists of a layer of stochastic binary " visible " units that represent binary input data connected to a layer of stochastic binary hidden units that learn to model significant nonindependencies between the visible units [20].”
InfluentialSelf-citation(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011
Self-citationA Practical Guide to Training Restricted Boltzmann Machines
Hinton, G. E. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_32 · Cited by 2,852 · cited 2×
“Learning the standard deviations of a GRBM is problematic for reasons described in [21], so for pretraining using CD 1 , the data are normalized so that each coefficient has zero mean and unit variance, the standard deviations are set to one when computing ( ) v h p ; , and no noise is added to the…”
Self-citationPerceptual linear predictive (PLP) analysis of speech
Hermansky, H. (1990) · The Journal of the Acoustical Society of America · doi:10.1121/1.399423 · Cited by 2,536
Acoustic Modeling Using Deep Belief Networks
Mohamed, A.-R., Dahl, G. E., & Hinton, G. (2012) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2011.2109382 · Cited by 1,727
Self-citation
Research works printed but not linked: 5
- sainath, 2011, Improvements in using deep belief networks for large vocabulary continuous speech recognition, Speech and Language Algorithm Group IBM Yorktown Heights NY Tech Rep UTML TR 2010-003
- rifai, 0, Contractive autoencoders: Explicit invariance during feature extraction, Proc 28th Int Conf Machine Learning, 833
- yu, 2011, Discriminative pretraining of deep neural networks, U S Patent Filing
- mohamed, 0, Deep belief networks for phone recognition, Proc NIPS Workshop Deep Learning for Speech Recognition and Related Applications
- pearl, 1988, Probabilistic Inference in Intelligent Systems Networks of Plausible Inference
Cited by
Items 901–1,000 of 1,105
Heuristic design of fuzzy inference systems: A review of three decades of research
Ojha, V., Abraham, A., & Snåšel, V. (2019) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2019.08.010 · Cited by 164
Detecting Adversarial Samples Using Influence Functions and Nearest Neighbors
Cohen, G., Sapiro, G., & Giryes, R. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01446 · Cited by 197
Emerging 2D Ferroelectric Devices for In‐Sensor and In‐Memory Computing
Chen, C., Zhou, Y., Tong, L., Pang, Y., & Xu, J. (2024) · Advanced Materials · doi:10.1002/adma.202400332 · Cited by 157
Yang, W., Jin, L., Tao, D., Xie, Z., & Feng, Z. (2016) · Pattern Recognition · doi:10.1016/j.patcog.2016.04.007 · Cited by 151
Deep CTR Prediction in Display Advertising
Chen, J., Sun, B., Li, H., Lu, H., & Hua, X. (2016) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2964284.2964325 · Cited by 181
Multistep Prediction of Dynamic Systems With Recurrent Neural Networks
Mohajerin, N., & Waslander, S. L. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2891257 · Cited by 150
Predicting tool wear with multi-sensor data using deep belief networks
Chen, Y., Jin, Y., & Galantu, J. (2018) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-018-2571-z · Cited by 138
Chen, H., Hu, N., Cheng, Z., Zhang, L., & Zhang, Y. (2019) · Measurement · doi:10.1016/j.measurement.2019.04.093 · Cited by 141
Subramanian, M., Shanmugavadivel, K., & Nandhini, P. S. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07246-w · Cited by 161
“Image recognition [15], voice recognition [16], and other similarly complex processes that deal with the analysis of large volumes of data have been revolutionized by deep learning architectures, which are now computationally feasible, giving a huge boost in applications that use these processes.”
BackgroundThe Role of Machine Learning in Tribology: A Systematic Review
Paturi, U. M. R., Palakurthy, S. T., & Reddy, N. S. (2022) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-022-09841-5 · Cited by 164
Sensing urban soundscapes from street view imagery
Zhao, T., Liang, X., Tu, W., Huang, Z., & Biljecki, F. (2022) · Computers Environment and Urban Systems · doi:10.1016/j.compenvurbsys.2022.101915 · Cited by 156
Experiments on deep learning for speech denoising
Liu, D., Smaragdis, P., & Kim, M. (2014) · Interspeech (USB) · doi:10.21437/interspeech.2014-574 · Cited by 153
Machine learning of explicit order parameters: From the Ising model to SU(2) lattice gauge theory
Wetzel, S. J., & Scherzer, M. (2017) · Physical review. B./Physical review. B · doi:10.1103/physrevb.96.184410 · Cited by 169
Cross-Lingual Word Embeddings for Low-Resource Language Modeling
Adams, O., Makarucha, A. J., Neubig, G., Bird, S., & Cohn, T. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-1088 · Cited by 135
Yu, Z., Niu, Z., Tang, W., & Wu, Q. (2019) · IEEE Access · doi:10.1109/access.2019.2895604 · Cited by 147
An Improved Analysis of Stochastic Gradient Descent with MomentumPreprint
Liu, Y., Gao, Y., & Yin, W. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.07989 · Cited by 159
Learning filter banks within a deep neural network framework
Sainath, T. N., Kingsbury, B. E. D., Mohamed, A., & Ramabhadran, B. (2013) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2013.6707746 · Cited by 140
Self-citationActivity analysis of construction equipment using audio signals and support vector machines
Cheng, C.-F., Rashidi, A., Davenport, M. A., & Anderson, D. V. (2017) · Automation in Construction · doi:10.1016/j.autcon.2017.06.005 · Cited by 151
Neural information retrieval: at the end of the early years
Onal, K. D., Zhang, Y., Altıngövde, İ. S., Rahman, M. M., Karagöz, P., Braylan, A., Dang, B., Chang, H.-L., Kim, H., McNamara, Q., et al. (2017) · Information Retrieval · doi:10.1007/s10791-017-9321-y · Cited by 166
How Important Is Weight Symmetry in Backpropagation?
Liao, Q., Leibo, J., & Poggio, T. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10279 · Cited by 131
Jin, X., Li, Z., Feng, H., Ren, Z., & Li, S. (2019) · The Crop Journal · doi:10.1016/j.cj.2019.06.005 · Cited by 142
Deep Spiking Neural Networks for Large Vocabulary Automatic Speech Recognition
Wu, J., Yılmaz, E., Zhang, M., Li, H., & Tan, K. C. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00199 · Cited by 177
“More recently, ANN-based approaches have become the standard acoustic models providing state-of-the-art performance across a wide spectrum of ASR tasks (Hinton et al., 2012).”
BackgroundMethodDeng, Y., Zhang, Y., Pan, D., Yang, S. X., & Gharabaghi, B. (2024) · Remote Sensing · doi:10.3390/rs16224196 · Cited by 181
Fortelny, N., & Bock, C. (2020) · Genome Biology · doi:10.1186/s13059-020-02100-5 · Cited by 135
Conversational AI: Dialogue Systems, Conversational Agents, and Chatbots
McTear, M. (2021) · Synthesis Lectures on Human Language Technologies · doi:10.1007/978-3-031-02176-3 · Cited by 155
Improved inception-residual convolutional neural network for object recognition
Alom, M. Z., Hasan, M., Yakopcic, C., Taha, T. M., & Asari, V. K. (2018) · Neural Computing and Applications · doi:10.1007/s00521-018-3627-6 · Cited by 142
Source localization using deep neural networks in a shallow water environment
Huang, Z., Ji, X., Gong, Z., Wang, H., & Yan, Y. (2018) · The Journal of the Acoustical Society of America · doi:10.1121/1.5036725 · Cited by 147
Structural dynamics simulation using a novel physics-guided machine learning method
Yu, Y., Yao, H., & Liu, Y. (2020) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2020.103947 · Cited by 155
Cai, Y., Li, X., & Li, J. (2023) · Sensors · doi:10.3390/s23052455 · Cited by 181
Neuromorphic Computing Based on Emerging Memory Technologies
Rajendran, B., & Alibart, F. (2016) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2016.2533298 · Cited by 148
Ramanishka, V., Das, A., Park, D. H., Venugopalan, S., Hendricks, L. A., Rohrbach, M., & Saenko, K. (2016) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2964284.2984066 · Cited by 132
Underwater acoustic source localization using generalized regression neural network
Wang, Y., & Peng, H. F. (2018) · The Journal of the Acoustical Society of America · doi:10.1121/1.5032311 · Cited by 135
On the Comparison of Popular End-to-End Models for Large Scale Speech Recognition
Li, J., Wu, Y., Gaur, Y., Wang, C., Zhao, R., & Liu, S. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-2846 · Cited by 137
DeepEdgeBench: Benchmarking deep neural networks on edge devices
Baller, S. P., Jindal, A., Chadha, M., & Gerndt, M. (2021) · 2021 IEEE International Conference on Cloud Engineering (IC2E) · doi:10.1109/ic2e52221.2021.00016 · Cited by 134
Learning Hierarchical Cross-Modal Association for Co-Speech Gesture Generation
Liu, X., Wu, Q., Zhou, H., Xu, Y., Qian, R., Lin, X., Zhou, X., Wu, W., Dai, B., & Zhou, B. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01021 · Cited by 214
Deep neural network features and semi-supervised training for low resource speech recognition
Thomas, S., Seltzer, M. L., Church, K., & Heřmanský, H. (2013) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2013.6638959 · Cited by 132
Learning Hidden Unit Contributions for Unsupervised Acoustic Model Adaptation
Swietojanski, P., Li, J., & Renals, S. (2016) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2016.2560534 · Cited by 133
Word embeddings for speech recognition
Samy Bengio, A., & Heigold, G. (2014) · Interspeech (USB) · doi:10.21437/interspeech.2014-273 · Cited by 136
Chou, P.-W., Maturana, D., & Scherer, S. (2017) · International Conference on Machine Learning · Cited by 135
Web Media and Stock Markets : A Survey and Future Directions from a Big Data Perspective
Li, Q., Chen, Y., Wang, J., Chen, Y., & Chen, H. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2763144 · Cited by 150
Deep Learning Applications in Chest Radiography and Computed Tomography: Current State of the Art
Lee, S. M., Seo, J. B., Yun, J., Cho, Y.-H., Vogel‐Claussen, J., Schiebler, M. L., Gefter, W. B., van Beek, E. J. R., Goo, J. M., Lee, K. S., et al. (2019) · Journal of Thoracic Imaging · doi:10.1097/rti.0000000000000387 · Cited by 149
“such as dilated convolutions, convolutions with stride can also be used), and robustly retains the shape and position of detected semantic features within the image, (3) the fully connected layers integrate all feature responses and eventually project onto an output layer which serves to answer the task at hand.”
MethodAbbasi, A. A., Hussain, L., Awan, I. A., Abbasi, I., Majid, A., Nadeem, M. S. A., & Chaudhary, Q.-A. (2020) · Cognitive Neurodynamics · doi:10.1007/s11571-020-09587-5 · Cited by 154
The Gap between Theory and Practice in Function Approximation with Deep Neural Networks
Adcock, B., & Dexter, N. (2021) · SIAM Journal on Mathematics of Data Science · doi:10.1137/20m131309x · Cited by 177
The evolution of object detection methods
Sun, Y., Sun, Z., & Chen, W. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.108458 · Cited by 199
Feature learning and deep architectures: new directions for music informatics
Humphrey, E. J., Bello, J. P., & LeCun, Y. (2013) · Journal of Intelligent Information Systems · doi:10.1007/s10844-013-0248-5 · Cited by 171
Deep learning for video classification and captioning
Wu, Z., Yao, T., Fu, Y., & Jiang, Y.-G. (2017) · doi:10.1145/3122865.3122867 · Cited by 174
Low-Power, Adaptive Neuromorphic Systems: Recent Progress and Future Directions
Basu, A., Acharya, J., Karnik, T., Liu, H., Li, H. H., Seo, J.-S., & Song, C. (2018) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2018.2816339 · Cited by 135
Improving Generalization via Scalable Neighborhood Component Analysis
Wu, Z., Efros, A. A., & Yu, S. X. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01234-2_42 · Cited by 163
Deep Q-Learning With Q-Matrix Transfer Learning for Novel Fire Evacuation Environment
Sharma, J., Andersen, P., Granmo, O.-C., & Goodwin, M. (2020) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2020.2967936 · Cited by 142
Trainable frontend for robust and far-field keyword spotting
Wang, Y., Getreuer, P., Hughes, T. A., Lyon, R. F., & Saurous, R. A. (2017) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2017.7953242 · Cited by 132
Citrus pests classification using an ensemble of deep learning models
Khanramaki, M., Asli‐Ardeh, E. A., & Kozegar, E. (2021) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2021.106192 · Cited by 137
Optimal Control of Pdes Using Physics-Informed Neural Networks
Mowlavi, S., & Nabi, S. (2022) · Journal of Computational Physics · doi:10.1016/j.jcp.2022.111731 · Cited by 163
Jagtap, A. D., & Karniadakis, G. E. (2023) · Journal of Machine Learning for Modeling and Computing · doi:10.1615/jmachlearnmodelcomput.2023047367 · Cited by 182
Large-Vocabulary Continuous Speech Recognition Systems: A Look at Some Recent Advances
Saon, G., & Chien, J. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2197156 · Cited by 151
Creativity: Generating Diverse Questions Using Variational Autoencoders
Jain, U., Zhang, Z., & Schwing, A. G. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.575 · Cited by 156
Joint CTC/attention decoding for end-to-end speech recognition
Hori, T., Watanabe, S., & Hershey, J. R. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1048 · Cited by 177
Improving defect prediction with deep forest
Zhou, T., Sun, X., Xia, X., Li, B., & Chen, X. (2019) · Information and Software Technology · doi:10.1016/j.infsof.2019.07.003 · Cited by 139
Large-Scale Domain Adaptation via Teacher-Student Learning
Li, J., Seltzer, M. L., Wang, X., Zhao, R., & Gong, Y. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-519 · Cited by 143
A Comprehensive Survey on Geometric Deep Learning
Cao, W., Yan, Z., He, Z., & He, Z. (2020) · IEEE Access · doi:10.1109/access.2020.2975067 · Cited by 180
A new attention-based CNN approach for crop mapping using time series Sentinel-2 images
Wang, Y., Zhang, Z., Feng, L., Ma, Y., & Du, Q. (2021) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2021.106090 · Cited by 151
Gao, Y., & Ruan, Y. (2021) · Energy and Buildings · doi:10.1016/j.enbuild.2021.111379 · Cited by 134
Bayesian deep learning based method for probabilistic forecast of day-ahead electricity prices
Brusaferri, A., Matteucci, M., Portolani, P., & Vitali, A. (2019) · Applied Energy · doi:10.1016/j.apenergy.2019.05.068 · Cited by 143
Sun, C., Tian, Y., Gao, L., Niu, Y., Zhang, T., Li, H., Zhang, Y., Yue, Z., Gilon, N., & Yu, J. (2019) · Scientific Reports · doi:10.1038/s41598-019-47751-y · Cited by 133
Data Management Challenges for Deep Learning
Munappy, A. R., Bosch, J., Olsson, H. H., Arpteg, A., & Brinne, B. (2019) · Euromicro Conference on Software Engineering and Advanced Applications (SEAA) · doi:10.1109/seaa.2019.00030 · Cited by 159
Robust Machine Learning Systems: Challenges,Current Trends, Perspectives, and the Road Ahead
Shafique, M., Naseer, M., Theocharides, T., Kyrkou, C., Mutlu, O., Orosa, L., & Choi, J. (2020) · IEEE Design and Test · doi:10.1109/mdat.2020.2971217 · Cited by 156
RayS: A Ray Searching Method for Hard-label Adversarial Attack
Chen, J., & Gu, Q. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3403225 · Cited by 204
Hierarchical Reinforcement Learning: A Survey and Open Research Challenges
Hutsebaut-Buysse, M., Mets, K., & Latré, S. (2022) · Machine Learning and Knowledge Extraction · doi:10.3390/make4010009 · Cited by 129
Deep neural networks for single channel source separation
Grais, E. M., Şen, M. U., & Erdoğan, H. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6854299 · Cited by 129
Movahedi, F., Coyle, J. L., & Sejdić, E. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2727218 · Cited by 146
Xu, Y., Li, S., Zhang, D., Jin, Y., Zhang, F., Li, N., & Li, H. (2017) · Structural Control and Health Monitoring · doi:10.1002/stc.2075 · Cited by 129
de Taillez, T., Kollmeier, B., & Meyer, B. T. (2017) · European Journal of Neuroscience · doi:10.1111/ejn.13790 · Cited by 132
“While in machine learning tasks such as ASR, usually a temporal context is provided for the input (as it is also performed in this study), the extension of providing temporal context during training for the output has not been used before for time series predicted by neural nets.”
MethodORCA-SPOT: An Automatic Killer Whale Sound Detection Toolkit Using Deep Learning
Bergler, C., Schröter, H., Cheng, R. X., Barth, V., Weber, M., Nöth, E., Hofer, H., & Maier, A. (2019) · Scientific Reports · doi:10.1038/s41598-019-47335-w · Cited by 128
Dynamic development of landslide susceptibility based on slope unit and deep neural networks
Hua, Y., Wang, X., Yong-wei, L., Xu, P., & Xia, W. (2020) · Landslides · doi:10.1007/s10346-020-01444-0 · Cited by 139
“…with more than one layer of hidden units between its inputs In the fully connected neural network suggested in this work, the activation function of “ ReLU ” is employed to introduce the nonlinear features into the network, so that the network can approach nonlinear functions (Hinton et al. 2012).”
Bankruptcy Prediction Using Deep Learning Approach Based on Borderline SMOTE
Smiti, S., & Soui, M. (2020) · Information Systems Frontiers · doi:10.1007/s10796-020-10031-6 · Cited by 152
Medical image segmentation and reconstruction of prostate tumor based on 3D AlexNet
Chen, J., Wan, Z., Zhang, J., Li, W., Chen, Y., Li, Y., & Duan, Y. (2020) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2020.105878 · Cited by 129
Mix and Match: A Novel FPGA-Centric Deep Neural Network Quantization Framework
Chang, S.-E., Li, Y., Sun, M., Shi, R., So, H. K., Qian, X., Wang, Y., & Lin, X. (2021) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca51647.2021.00027 · Cited by 151
Engineering safety in machine learning
Varshney, K. R. (2016) · 2016 Information Theory and Applications Workshop (ITA) · doi:10.1109/ita.2016.7888195 · Cited by 118
Sound Source Localization Using Deep Learning Models
Yalta, N., Nakadai, K., & Ogata, T. (2017) · Journal of Robotics and Mechatronics · doi:10.20965/jrm.2017.p0037 · Cited by 159
UNIQ: Uniform Noise Injection for Non-Uniform Quantization of Neural Networks
Baskin, C., Liss, N., Schwartz, E., Zheltonozhskii, E., Giryes, R., Bronstein, A. M., & Mendelson, A. (2019) · ACM Transactions on Computer Systems · doi:10.1145/3444943 · Cited by 107
A new taxonomy of global optimization algorithms
Stork, J., Eiben, A. E., & Bartz–Beielstein, T. (2020) · Natural Computing · doi:10.1007/s11047-020-09820-4 · Cited by 166
Domain Adversarial Training for Accented Speech Recognition
Sun, S., Yeh, C.-F., Hwang, M.-Y., Ostendorf, M., & Xie, L. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8462663 · Cited by 170
Pandey, S. K., Mishra, R. B., & Tripathi, A. K. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.113085 · Cited by 147
Magnetic Domain Wall Based Synaptic and Activation Function Generator for Neuromorphic Accelerators
Siddiqui, S. A., Dutta, S., Tang, A. S., Liu, L., Ross, C. A., & Baldo, M. A. (2019) · Nano Letters · doi:10.1021/acs.nanolett.9b04200 · Cited by 144
Wen, C., Yang, L., Xiang, L., Peng, L., & Chi, T. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.02.004 · Cited by 137
“…great success in various real-world applications, including image classification, speech recognition, time series prediction, natural language processing and so on (LeCun et al., 2015; Chan et al., 2015; Hinton et al., 2012; Wen et al., 2019; Collobert and Weston, 2008; Li et al., 2016, 2018).”
Langland‐Hassan, P. (2020) · doi:10.1093/oso/9780198815068.001.0001 · Cited by 134
Learning Physical Intuition of Block Towers by Example
Lerer, A. K., Gross, S., & Fergus, R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.01312 · Cited by 72
Sequence discriminative distributed training of long short-term memory recurrent neural networks
Sak, H., Vinyals, O., Heigold, G., Senior, A., McDermott, E., Monga, R., & Mao, M. (2014) · Interspeech (USB) · doi:10.21437/interspeech.2014-305 · Cited by 129
Self-citationUnanue, I. J., Borzeshi, E. Z., & Piccardi, M. (2017) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.11.007 · Cited by 150
A systematic review on deep learning architectures and applications
Khamparia, A., & Singh, K. M. (2019) · Expert Systems · doi:10.1111/exsy.12400 · Cited by 127
“A deep neural network – HMM model for acoustic speech recognition works much better than the traditional Gaussian mixture model – HMM (Hinton et al., 2012).”
LCANet: End-to-End Lipreading with Cascaded Attention-CTC
Xu, K., Li, D., Cassimatis, N., & Wang, X. (2018) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2018.00088 · Cited by 157
Machine learning for fast and reliable solution of time-dependent differential equations
Regazzoni, F., Dede’, L., & Quarteroni, A. M. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2019.07.050 · Cited by 170
“RNNs are widely used for machine learning tasks involving sequential inputs, such as handwriting recognition, speech recognition and natural language processing, and also for time series prediction (Connor, Martin, and Atlas 1994; Graves 2013; Hinton et al. 2012).”
MethodSpeech emotion recognition based on DNN-decision tree SVM model
Sun, L., Zou, B., Fu, S., Chen, J., & Wang, F. (2019) · Speech Communication · doi:10.1016/j.specom.2019.10.004 · Cited by 130
Yan, X., Dou, D., & Yang, J. (2020) · Measurement · doi:10.1016/j.measurement.2020.107571 · Cited by 136
Sadeghzadeh, A. M., Shiravi, S., & Jalili, R. (2021) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2021.3052888 · Cited by 144
“In recent years, Deep Neural Networks (DNNs), also called Deep Learning (DL), have shown great success in solving complex problems such as image classification [3], and speech recognition [4].”
BackgroundDeep Learning-Based Imbalanced Data Classification for Drug Discovery
Korkmaz, S. (2020) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.9b01162 · Cited by 127
Zhang, Y., Yu, K., Lei, Z., Ge, J., Xu, Y., Li, Z., Ren, Z., & Feng, K. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120854 · Cited by 129
Learning Memory Access PatternsPreprint
Hashemi, M., Swersky, K., Smith, J., Ayers, G., Litz, H., Chang, J., Kozyrakis, C., & Ranganathan, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.02329 · Cited by 240
Colonoscopy polyp detection and classification: Dataset creation and comparative evaluations
Li, K., Fathan, M. I., Patel, K., Zhang, T., Zhong, C., Bansal, A. K., Rastogi, A. N., Wang, J. S., & Wang, G. (2021) · PLoS ONE · doi:10.1371/journal.pone.0255809 · Cited by 157
Photo-real talking head with deep bidirectional LSTM
Fan, B., Wang, L., Soong, F. K., & Xie, L. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178899 · Cited by 122
Recurrent deep neural networks for robust speech recognition
Weng, C., Yu, D., Watanabe, S., & Juang, B.-H. F. (2014) · 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2014.6854661 · Cited by 124
Self-citation
Metadata
- Authors
- Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., & Kingsbury, B.
- Affiliations
- University of Toronto (CA)
- University of Waterloo (CA)
- Microsoft (United States) (US)
- Google (United States) (US)
- IBM (United States) (US)
- Michigan State University (US)
- Venue
- IEEE Signal Processing Magazine
- Published
- 2012-11
- Volume
- 29
- Issue
- 6
- Pages
- 82-97
- ISSN
- 1053-5888 (ISSN-L)
- OpenAlex
- W2160815625
- Cited by
- 10,260
- References
- 71
- Citations by year
- 2026: 253 · 2025: 526 · 2024: 610 · 2023: 696 · 2022: 837 · 2021: 978 · 2020: 1232 · 2019: 1313 · 2018: 1220 · 2017: 967 · 2016: 712 · 2015: 498 · 2014: 276 · 2013: 128 · 2012: 9
- FWCI
- 284.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Signal Processing Magazine (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- deep neural network, acoustic modeling, speech recognition, hidden Markov models, Gaussian mixture model, feedforward neural networks, posterior probability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.