Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups
The DOI matches its Crossref record; 68 of the 71 references it cites were found in a registry or an index.
Abstract
Most current speech recognition systems use hidden Markov models (HMMs) to deal with the temporal variability of speech and Gaussian mixture models (GMMs) to determine how well each state of each HMM fits a frame or a short window of frames of coefficients that represents the acoustic input. An alternative way to evaluate the fit is to use a feed-forward neural network that takes several frames of coefficients as input and produces posterior probabilities over HMM states as output. Deep neural networks (DNNs) that have many hidden layers and are trained using new methods have been shown to outperform GMMs on a variety of speech recognition benchmarks, sometimes by a large margin. This article provides an overview of this progress and represents the shared views of four research groups that have had recent successes in using DNNs for acoustic modeling in speech recognition.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Deep Learning has largely alleviated the need for manual feature extraction, achieving state-ofthe-art performance in fields such as computer vision and speech recognition [13,14].”
From EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces (2018) · cites this paper as [13]
In the citing paper
“In particular, neural networks became competitive, solving problems in speech recognition [68], image recognition [69] and language translation [70].”
From The growing ubiquity of algorithms in society: implications, impacts and innovations (2018) · cites this paper as [68]
In the citing paper
“Apart from images, sequential data such as text and audio can also be processed with DNNs to reach state-of-the-art performance for document classification and speech recognition.”
From Deep learning for time series classification: a review (2019) · cites this paper as Hinton et al., 2012
In the citing paper
“The other more direct reason behind the high accuracies of deep CNNs on time series data is its success in other sequential data such as speech recognition (Hinton et al., 2012) and sentence classification (Kim, 2014)”
From Deep learning for time series classification: a review (2019) · cites this paper as Hinton et al., 2012
In the citing paper
“Recent studies have reported that deep learning methods have been successfully applied to many applications areas e.g., image and video classification [11-13], visual tracking [14], speech recognition [15] and natural language processing [16].”
From Medical image retrieval using deep convolutional neural network (2017) · cites this paper as [15]
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Self-citationReducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Self-citationA fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Self-citation(2010) · Cited by 14,134
Training Products of Experts by Minimizing Contrastive Divergence
Hinton, G. E. (2002) · Neural Computation · doi:10.1162/089976602760128018 · Cited by 4,879 · cited 3×
“…learning algorithm for a restricted Boltzmann machine (RBM) which consists of a layer of stochastic binary " visible " units that represent binary input data connected to a layer of stochastic binary hidden units that learn to model significant nonindependencies between the visible units [20].”
InfluentialSelf-citation(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011
Self-citationA Practical Guide to Training Restricted Boltzmann Machines
Hinton, G. E. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_32 · Cited by 2,852 · cited 2×
“Learning the standard deviations of a GRBM is problematic for reasons described in [21], so for pretraining using CD 1 , the data are normalized so that each coefficient has zero mean and unit variance, the standard deviations are set to one when computing ( ) v h p ; , and no noise is added to the…”
Self-citationPerceptual linear predictive (PLP) analysis of speech
Hermansky, H. (1990) · The Journal of the Acoustical Society of America · doi:10.1121/1.399423 · Cited by 2,536
Acoustic Modeling Using Deep Belief Networks
Mohamed, A.-R., Dahl, G. E., & Hinton, G. (2012) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2011.2109382 · Cited by 1,727
Self-citation
Research works printed but not linked: 5
- sainath, 2011, Improvements in using deep belief networks for large vocabulary continuous speech recognition, Speech and Language Algorithm Group IBM Yorktown Heights NY Tech Rep UTML TR 2010-003
- rifai, 0, Contractive autoencoders: Explicit invariance during feature extraction, Proc 28th Int Conf Machine Learning, 833
- yu, 2011, Discriminative pretraining of deep neural networks, U S Patent Filing
- mohamed, 0, Deep belief networks for phone recognition, Proc NIPS Workshop Deep Learning for Speech Recognition and Related Applications
- pearl, 1988, Probabilistic Inference in Intelligent Systems Networks of Plausible Inference
Cited by
Items 701–800 of 1,106
Multiresolution Recurrent Neural Networks: An Application to Dialogue Response Generation
Serban, I., Klinger, T., Tesauro, G., Talamadupula, K., Zhou, B., Bengio, Y., & Courville, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10984 · Cited by 177
Child Speech Recognition in Human-Robot Interaction: Evaluations and Recommendations
Kennedy, J., Lemaignan, S., Montassier, C., Lavalade, P., Irfan, B., Papadopoulos, F., Senft, E., & Belpaeme, T. (2017) · Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/2909824.3020229 · Cited by 176
Deep generative models: Survey
Oussidi, A., & Elhassouny, A. (2018) · 2018 International Conference on Intelligent Systems and Computer Vision (ISCV) · doi:10.1109/isacv.2018.8354080 · Cited by 161
Zhang, H., & Pan, J. (2019) · Sociological Methodology · doi:10.1177/0081175019860244 · Cited by 177
Floating Offshore Wind Turbines: Current Status and Future Prospects
Barooni, M., Ashuri, T., Velioglu Sogut, D., Wood, S., & Ghaderpour Taleghani, S. (2022) · Energies · doi:10.3390/en16010002 · Cited by 175
A Novel Intrusion Detection Method Using Deep Neural Network for In-Vehicle Network Security
Kang, M.-J., & Kang, J.-W. (2016) · 2016 IEEE 83rd Vehicular Technology Conference (VTC Spring) · doi:10.1109/vtcspring.2016.7504089 · Cited by 170
Speech analysis for health: Current state-of-the-art and the increasing impact of deep learning
Cummins, N., Baird, A., & Schuller, B. W. (2018) · Methods · doi:10.1016/j.ymeth.2018.07.007 · Cited by 175
Automatic mass detection in mammograms using deep convolutional neural networks
Agarwal, R., Diaz, O., Lladó, X., Yap, M. H., & Martí, R. (2019) · Journal of Medical Imaging · doi:10.1117/1.jmi.6.3.031409 · Cited by 177
“Deep learning strategies have gained a lot of interest in various fields, including object detection, 3 – 7 image recognition, 5 – 11 natural language processing, 12,13 speech recognition, 14,15 etc.”
An Overview of Machine Learning within Embedded and Mobile Devices–Optimizations and Applications
Ajani, T. S., Imoize, A. L., & Atayero, A. A. (2021) · Sensors · doi:10.3390/s21134412 · Cited by 176
Stochastic Gradient Descent Optimizes Over-parameterized Deep ReLU Networks
Zou, D., Cao, Y. J., Zhou, D., & Gu, Q. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.08888 · Cited by 175
“Deep neural networks have achieved great success in many applications like image processing (Krizhevsky et al., 2012), speech recognition (Hinton et al., 2012) and Go games (Silver et al., 2016).”
BackgroundGeospatial data to images: a deep-learning framework for traffic forecasting
Jiang, W., & Zhang, L. (2019) · Tsinghua Science and Technology · doi:10.26599/tst.2018.9010033 · Cited by 176
“Deep-learning methods have been used to solve various problems, such as object recognition [4] , handwriting recognition [5] , speech recognition [6] , image classification [7] , and machine translation [8] , and have resulted in a significant improvement over traditional methods.”
MethodAn empirical study of learning rates in deep neural networks for speech recognition
Senior, A., Heigold, G., Ranzato, M., & Yang, K. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638963 · Cited by 169
Self-citationConvolutional-Recurrent Neural Networks for Speech Enhancement
Zhao, H., Zarar, S., Tashev, I., & Lee, C.-H. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8462155 · Cited by 159
Guirado, E., Tabik, S., Alcaraz-Segura, D., Cabello, J., & Herrera, F. (2017) · Remote Sensing · doi:10.3390/rs9121220 · Cited by 176
From smart to deep: Robust activity recognition on smartwatches using deep learning
Bhattacharya, S., & Lane, N. D. (2016) · 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops) · doi:10.1109/percomw.2016.7457169 · Cited by 174
Li, W., Fu, H., Yu, L., Gong, P., Feng, D., Li, C., & Clinton, N. (2016) · International Journal of Remote Sensing · doi:10.1080/01431161.2016.1246775 · Cited by 174
Domain Adaptation Network for Cross-Scene Classification
Othman, E., Bazi, Y., Melgani, F., Alhichri, H., Alajlan, N., & Zuair, M. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2692281 · Cited by 175
Mitigating Evasion Attacks to Deep Neural Networks via Region-based Classification
Cao, X., & Gong, N. Z. (2017) · Proceedings of the 33rd Annual Computer Security Applications Conference · doi:10.1145/3134600.3134606 · Cited by 168
Mandal, K., Saha, S., & Mandal, S. (2021) · Geoscience Frontiers · doi:10.1016/j.gsf.2021.101203 · Cited by 174
Deep learning: Evolution and expansion
Wason, R. (2018) · Cognitive Systems Research · doi:10.1016/j.cogsys.2018.08.023 · Cited by 174
Rethinking Feature Distribution for Loss Functions in Image Classification
Wan, W., Zhong, Y., Li, T., & Chen, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00950 · Cited by 166
Zhou, Z., He, G., Wang, S., & Jin, G. (2019) · Computers & Fluids · doi:10.1016/j.compfluid.2019.104319 · Cited by 174
Application of LSTM approach for modelling stress–strain behaviour of soil
Zhang, N., Shen, S.-L., Zhou, A., & Jin, Y.-F. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106959 · Cited by 174
Li, Q., Wang, Z., Shangguan, W., Li, L., Yao, Y., & Yu, F. (2021) · Journal of Hydrology · doi:10.1016/j.jhydrol.2021.126698 · Cited by 172
Li, W., & Becker, D. M. (2021) · Energy · doi:10.1016/j.energy.2021.121543 · Cited by 174
“In particular, deep neural networks (DNNs) have gradually become the most avant-garde CI approach in other disciplines [18, 19, 20] and entered the scientific research field related to EPF.”
BackgroundPizza, S., Brown, B., McMillan, D., & Lampinen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858522 · Cited by 173
Learning Multi-View Representation With LSTM for 3-D Shape Recognition and Retrieval
Ma, C., Guo, Y., Yang, J., & An, W. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2875512 · Cited by 173
An improved deep learning model for predicting stock market price time series
Liu, H., & Long, Z. (2020) · Digital Signal Processing · doi:10.1016/j.dsp.2020.102741 · Cited by 172
Globally Optimal Gradient Descent for a ConvNet with Gaussian InputsPreprint
Brutzkus, A., & Globerson, A. (2017) · International Conference on Machine Learning · doi:10.48550/arxiv.1702.07966 · Cited by 320
Learning acoustic frame labeling for speech recognition with recurrent neural networks
Sak, H., Senior, A., Rao, K., Irsoy, O., Graves, A., Beaufays, F., & Schalkwyk, J. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178778 · Cited by 171
Self-citationDesign of power-efficient approximate multipliers for approximate artificial neural networks
Mrazek, V., Sarwar, S. S., Sekanina, L., Vasicek, Z., & Roy, K. (2016) · Proceedings of the 35th International Conference on Computer-Aided Design · doi:10.1145/2966986.2967021 · Cited by 170
Neural offset min-sum decoding
Lugosch, L., & Gross, W. J. (2017) · 2017 IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.2017.8006751 · Cited by 167
An improved deep learning approach for detection of thyroid papillary cancer in ultrasound images
Li, H., Weng, J., Shi, Y., Gu, W., Mao, Y., Wang, Y., Liu, W., & Zhang, J. (2018) · Scientific Reports · doi:10.1038/s41598-018-25005-7 · Cited by 171
Grekousis, G. (2019) · Computers, Environment and Urban Systems · doi:10.1016/j.compenvurbsys.2018.10.008 · Cited by 171
Recent progresses in deep learning based acoustic models
Yu, D., & Li, J. (2017) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2017.7510508 · Cited by 171
Self-citationFew-Shot Charge Prediction with Discriminative Legal Attributes
Hu, Z., Li, X., Tu, C., Liu, Z., & Sun, M. (2018) · International Conference on Computational Linguistics · Cited by 295
Fast multi-language LSTM-based online handwriting recognition
Carbune, V., Gonnet, P., Deselaers, T., Rowley, H. A., Daryin, A., Calvo, M., Wang, L.-L., Keysers, D., Feuz, S., & Gervais, P. (2020) · International Journal on Document Analysis and Recognition (IJDAR) · doi:10.1007/s10032-020-00350-4 · Cited by 171
Semi-supervised learning of the electronic health record for phenotype stratification
Beaulieu-Jones, B. K., & Greene, C. S. (2016) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2016.10.007 · Cited by 171
Deep Multi-Scale Convolutional LSTM Network for Travel Demand and Origin-Destination Predictions
Chu, K.-F., Lam, A. Y. S., & Li, V. O. K. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2924971 · Cited by 169
Munawar, H. S., Qayyum, S., Ullah, F., & Sepasgozar, S. (2020) · Big Data and Cognitive Computing · doi:10.3390/bdcc4020004 · Cited by 171
Prediction, Bayesian inference and feedback in speech recognition
Norris, D., McQueen, J. M., & Cutler, A. (2016) · Language, Cognition and Neuroscience · doi:10.1080/23273798.2015.1081703 · Cited by 170
AENet: Learning Deep Audio Features for Video Analysis
Takahashi, N., Gygli, M., & Van Gool, L. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2017.2751969 · Cited by 170
Zhang, T., Wang, J., Liu, Q., Zhou, J., Dai, J., Han, X., Zhou, Y., & Xu, K. (2019) · Photonics Research · doi:10.1364/prj.7.000368 · Cited by 169
Automatic Speech Recognition: Systematic Literature Review
Alharbi, S., Alrazgan, M., Alrashed, A., Alnomasi, T., Almojel, R., Alharbi, R., Alharbi, S., Alturki, S., Alshehri, F., & Almojil, M. (2021) · IEEE Access · doi:10.1109/access.2021.3112535 · Cited by 168
AutoImpute: Autoencoder based imputation of single-cell RNA-seq data
Talwar, D., Mongia, A., Sengupta, D., & Majumdar, A. (2018) · Scientific Reports · doi:10.1038/s41598-018-34688-x · Cited by 168
Deep-learning source localization using multi-frequency magnitude-only data
Niu, H., Gong, Z., Ozanich, E., Gerstoft, P., Wang, H., & Li, Z. (2019) · The Journal of the Acoustical Society of America · doi:10.1121/1.5116016 · Cited by 167
DeepStellar: model-based quantitative analysis of stateful deep learning systems
Du, X., Xie, X., Li, Y., Ma, L., Liu, Y., & Zhao, J. (2019) · Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3338906.3338954 · Cited by 163
“Deep Learning (DL) has experienced significant progress over the past decade in many real-world applications such as image processing [12], speech recognition [20], natural language processing [43], and autonomous driving [25].”
A Survey of Available Corpora for Building Data-Driven Dialogue Systems
Serban, I. V., Lowe, R., Henderson, P. B., Charlin, L., & Pineau, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.05742 · Cited by 168
Palaz, D., Magimai-Doss, M., & Collobert, R. (2019) · Speech Communication · doi:10.1016/j.specom.2019.01.004 · Cited by 168
“…is a good success record of such approaches in the computer vision [5, 6, 7] or text processing fields [8], deep learning approaches for speech recognition has largely focused on the classifier step, where a neural network with many hidden layers is typically trained to classify subword units [9].”
BackgroundA New Golden Age in Computer Architecture: Empowering the Machine-Learning Revolution
Dean, J., Patterson, D., & Young, C. (2018) · IEEE Micro · doi:10.1109/mm.2018.112130030 · Cited by 168
Zhang, D., Zou, L., Zhou, X., & He, F. (2018) · IEEE Access · doi:10.1109/access.2018.2837654 · Cited by 167
Deep Reinforcement Learning with a Natural Language Action Space
He, J., Chen, J., He, X., Gao, J., Li, L., Deng, L., & Ostendorf, M. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1153 · Cited by 164
Self-citationGeneralization Bounds of Stochastic Gradient Descent for Wide and Deep Neural Networks
Cao, Y. J., & Gu, Q. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.13210 · Cited by 151
Zhang, Y., You, D., Gao, X., Zhang, N., & Gao, P. P. (2019) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2019.02.004 · Cited by 164
A Survey on an Emerging Area: Deep Learning for Smart City Data
Chen, Q., Wang, W., Wu, F., De, S., Wang, R., Zhang, B., & Huang, X. (2019) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2019.2907718 · Cited by 167
Dual Mixup Regularized Learning for Adversarial Domain Adaptation
Wu, Y., Inkpen, D. Z., & El-Roby, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58526-6_32 · Cited by 216
Norman, B., Pedoia, V., Noworolski, A., Link, T. M., & Majumdar, S. (2019) · Journal of Digital Imaging · doi:10.1007/s10278-018-0098-3 · Cited by 166
Kim, M., & Smaragdis, P. (2016) · arXiv · doi:10.48550/arxiv.1601.06071 · Cited by 166
“…DNNs are extending the state of the art results for various tasks, such as image classification (Goodfel-low et al., 2013), speech recognition (Hinton et al., 2012), speech enhancement (Xu et al., 2014), etc, it is also the case that the relatively bigger networks with more parameters than…”
BackgroundAutomated plankton image analysis using convolutional neural networks
Luo, J. Y., Irisson, J., Graham, B., Guigand, C., Sarafraz, A., Mader, C., & Cowen, R. K. (2018) · Limnology and Oceanography: Methods · doi:10.1002/lom3.10285 · Cited by 165
DEEPred: Automated Protein Function Prediction with Multi-task Feed-forward Deep Neural Networks
Sureyya Rifaioglu, A., Doğan, T., Jesus Martin, M., Cetin-Atalay, R., & Atalay, V. (2019) · Scientific Reports · doi:10.1038/s41598-019-43708-3 · Cited by 156
Deep learning in the automotive industry: Applications and tools
Luckow, A., Cook, M., Ashcraft, N., Weill, E., Djerekarov, E., & Vorster, B. (2016) · 2016 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata.2016.7841045 · Cited by 164
A parallel MR imaging method using multilayer perceptron
Kwon, K., Kim, D., & Park, H. (2017) · Medical Physics · doi:10.1002/mp.12600 · Cited by 164
Large-Scale Visual Speech Recognition
Shillingford, B., Assael, Y., Hoffman, M. W., Paine, T., Hughes, C., Prabhu, U., Liao, H., Sak, H., Rao, K., Bennett, L., et al. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-1669 · Cited by 154
Self-citationHybrid Deep Neural Network--Hidden Markov Model (DNN-HMM) Based Speech Emotion Recognition
Li, L., Zhao, Y., Jiang, D., Zhang, Y., Wang, F., Gonzalez, I., Valentin, E., & Sahli, H. (2013) · 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction · doi:10.1109/acii.2013.58 · Cited by 163
Message Passing Neural Networks
Gilmer, J., Schoenholz, S. S., Riley, P. F., Vinyals, O., & Dahl, G. E. (2020) · Lecture notes in physics · doi:10.1007/978-3-030-40245-7_10 · Cited by 253
Self-citationTraining Deep Convolutional Neural Networks with Resistive Cross-Point Devices
Gokmen, T., Onen, M., & Haensch, W. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00538 · Cited by 162
Classifying Radio Galaxies with the Convolutional Neural Network
Aniyan, A. K., & Thorat, K. (2017) · The Astrophysical Journal Supplement Series · doi:10.3847/1538-4365/aa7333 · Cited by 162
Financial Time Series Prediction Based on Deep Learning
Yan, H., & Ouyang, H. (2018) · Wireless Personal Communications · doi:10.1007/s11277-017-5086-2 · Cited by 162
Strategies and Principles of Distributed Machine Learning on Big Data
Xing, E. P., Ho, Q., Xie, P., & Wei, D. (2016) · Engineering · doi:10.1016/j.eng.2016.02.008 · Cited by 162
Machine learning for intelligent optical networks: A comprehensive survey
Gu, R., Yang, Z., & Ji, Y. (2020) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2020.102576 · Cited by 160
Loss of plasticity in deep continual learning
Dohare, S., Hernandez-Garcia, J. F., Lan, Q., Rahman, P., Mahmood, A. R., & Sutton, R. S. (2024) · Nature · doi:10.1038/s41586-024-07711-7 · Cited by 172
“Such train-once settings were used in all the early successes of deep learning in speech recognition [1] and image classification [2].”
Grid Path Planning with Deep Reinforcement Learning: Preliminary Results
Panov, A. I., Yakovlev, K. S., & Suvorov, R. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.01.054 · Cited by 162
Kulkarni, S. R., & Rajendran, B. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.03.019 · Cited by 161
Estimation of daily global solar radiation using deep learning model
Kaba, K., Sarıgül, M., Avcı, M., & Kandırmaz, H. M. (2018) · Energy · doi:10.1016/j.energy.2018.07.202 · Cited by 161
Shallow-Deep Networks: Understanding and Mitigating Network OverthinkingPreprint
Kaya, Y., Hong, S., & Dumitraş, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.07052 · Cited by 413
Predicting hospital readmission for lupus patients: An RNN-LSTM-based deep-learning methodology
Reddy, B. K., & Delen, D. (2018) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2018.08.029 · Cited by 160
A reduced order model for turbulent flows in the urban environment using machine learning
Xiao, D., Heaney, C. E., Mottet, L., Fang, F., Lin, W., Navon, I. M., Guo, Y., Matar, O. K., Robins, A. G., & Pain, C. C. (2019) · Building and Environment · doi:10.1016/j.buildenv.2018.10.035 · Cited by 160
“62 Machine learning is gaining more and more attention, and has been applied successfully to a 63 number of research fields, such as image recognition [53, 54], driver-less cars [55], assessing the 64 visual environment of cities [56], personal comfort model [57], speech recognition [58], language 65 processing [59] a…”
Scaling description of generalization with number of parameters in deep learning
Geiger, M., Jacot, A., Spigler, S., Gabriel, F., Sagun, L., d’Ascoli, S., Biroli, G., Hongler, C., & Wyart, M. (2020) · Journal of Statistical Mechanics: Theory and Experiment · doi:10.1088/1742-5468/ab633c · Cited by 155
DeepDSC: A Deep Learning Method to Predict Drug Sensitivity of Cancer Cell Lines
Li, M., Wang, Y., Zheng, R., Shi, X., Li, Y., Wu, F.-X., & Wang, J. (2021) · IEEE/ACM Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2019.2919581 · Cited by 160
“Particularly, deep learning has achieved remarkable success in computer vision [25], [26], speech recognition [27], [28], natural language processing [29], [30] and bioinformatics [31], [32], [33] in recent years.”
Chiba, Z., Abghour, N., Moussaid, K., El omri, A., & Rida, M. (2019) · Computers & Security · doi:10.1016/j.cose.2019.06.013 · Cited by 160
Multiagent Bidirectionally-Coordinated Nets for Learning to Play StarCraft Combat Games.Preprint
Peng, P., Yuan, Q., Wen, Y., Yang, Y., Tang, Z., Long, H., & Wang, Y.-X. (2017) · arXiv (Cornell University) · Cited by 162
Deep Belief Networks for Quantitative Analysis of a Gold Immunochromatographic Strip
Zeng, N., Wang, Z., Zhang, H., Liu, W., & Alsaadi, F. E. (2016) · Cognitive Computation · doi:10.1007/s12559-016-9404-x · Cited by 159
Takeda, R., & Komatani, K. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7471706 · Cited by 158
Kautz, T., Groh, B. H., Hannink, J., Jensen, U., Strubberg, H., & Eskofier, B. M. (2017) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-017-0495-0 · Cited by 159
DropoutNet: Addressing Cold Start in Recommender Systems
Volkovs, M., Yu, G. W., & Poutanen, T. (2017) · neural information processing systems · Cited by 463
Fast Transient Stability Batch Assessment Using Cascaded Convolutional Neural Networks
Yan, R., Geng, G., Jiang, Q., & Li, Y. (2019) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2019.2895592 · Cited by 158
Bubba, T. A., Kutyniok, G., Lassas, M., März, M., Samek, W., Siltanen, S., & Srinivasan, V. (2019) · Inverse Problems · doi:10.1088/1361-6420/ab10ca · Cited by 127
Artificial Intelligence: Foundations of Computational Agents
Poole, D. L., & Mackworth, A. K. (2017) · Cambridge University Press eBooks · doi:10.1017/9781108164085 · Cited by 158
Artificial Intelligence and Early Detection of Pancreatic Cancer: 2020 Summative Review
Kenner, B., Chari, S. T., Kelsen, D., Klimstra, D. S., Pandol, S. J., Rosenthal, M., Rustgi, A. K., Taylor, J. A., Yala, A., Abul-Husn, N., et al. (2021) · Pancreas · doi:10.1097/mpa.0000000000001762 · Cited by 158
Recent Advances and Applications of Machine Learning in Experimental Solid Mechanics: A Review
Jin, H., Zhang, E., & Espinosa, H. D. (2023) · Applied Mechanics Reviews · doi:10.1115/1.4062966 · Cited by 199
“ML has played a significant role in computer science applications and technologies like computer vision [30], natural language processing [31], and self-driving cars [32].”
BackgroundMachine learning for genetic prediction of psychiatric disorders: a systematic review
Bracher-Smith, M., Crawford, K., & Escott-Price, V. (2021) · Molecular Psychiatry · doi:10.1038/s41380-020-0825-2 · Cited by 157
Hagos, D. H., Battle, R., & Rawat, D. B. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3444742 · Cited by 303
“Older speech recognition systems often relied on RNNs or hybrid models combining Hidden Markov Models (HMMs) with Deep Neural Networks (DNNs) [121], [122].”
MethodSuryanarayana, G., Lago, J., Geysen, D., Aleksiejuk, P., & Johansson, C. (2018) · Energy · doi:10.1016/j.energy.2018.05.111 · Cited by 155
Zhou, F., Zhou, H., Yang, Z., & Yang, L. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.07.065 · Cited by 158
Windows into human health through wearables data analytics
Witt, D. R., Kellogg, R. A., Snyder, M. P., & Dunn, J. (2019) · Current Opinion in Biomedical Engineering · doi:10.1016/j.cobme.2019.01.001 · Cited by 157
Artificial Intelligence to Power the Future of Materials Science and Engineering
Sha, W., Guo, Y., Yuan, Q. M., Tang, S., Zhang, X., Lu, S., Guo, X., Cao, Y., & Cheng, S. (2020) · Advanced Intelligent Systems · doi:10.1002/aisy.201900143 · Cited by 171
Coding Programmable Metasurfaces Based on Deep Learning Techniques
Shan, T., Pan, X., Li, M., Xu, S., & Yang, F. (2020) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2020.2972764 · Cited by 165
Bayesian neural networks: An introduction and survey
Goan, E., & Fookes, C. (2020) · QUT ePrints (Queensland University of Technology) · Cited by 182
Convolutional Neural Networks Analyzed via Convolutional Sparse CodingPreprint
PapyanVardan, RomanoYaniv, & EladMichael (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.08194 · Cited by 258
Threat of Adversarial Attacks on Deep Learning in Computer Vision: A SurveyPreprint
Akhtar, N., & Mian, A. S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.00553 · Cited by 156
Metadata
- Authors
- Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., & Kingsbury, B.
- Affiliations
- University of Toronto (CA)
- University of Waterloo (CA)
- Microsoft (United States) (US)
- Google (United States) (US)
- IBM (United States) (US)
- Michigan State University (US)
- Venue
- IEEE Signal Processing Magazine
- Published
- 2012-11
- Volume
- 29
- Issue
- 6
- Pages
- 82-97
- ISSN
- 1053-5888 (ISSN-L)
- OpenAlex
- W2160815625
- Cited by
- 10,260
- References
- 71
- Citations by year
- 2026: 253 · 2025: 526 · 2024: 610 · 2023: 696 · 2022: 837 · 2021: 978 · 2020: 1232 · 2019: 1313 · 2018: 1220 · 2017: 967 · 2016: 712 · 2015: 498 · 2014: 276 · 2013: 128 · 2012: 9
- FWCI
- 284.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Signal Processing Magazine (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- deep neural network, acoustic modeling, speech recognition, hidden Markov models, Gaussian mixture model, feedforward neural networks, posterior probability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.