Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups
The DOI matches its Crossref record; 68 of the 71 references it cites were found in a registry or an index.
Abstract
Most current speech recognition systems use hidden Markov models (HMMs) to deal with the temporal variability of speech and Gaussian mixture models (GMMs) to determine how well each state of each HMM fits a frame or a short window of frames of coefficients that represents the acoustic input. An alternative way to evaluate the fit is to use a feed-forward neural network that takes several frames of coefficients as input and produces posterior probabilities over HMM states as output. Deep neural networks (DNNs) that have many hidden layers and are trained using new methods have been shown to outperform GMMs on a variety of speech recognition benchmarks, sometimes by a large margin. This article provides an overview of this progress and represents the shared views of four research groups that have had recent successes in using DNNs for acoustic modeling in speech recognition.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Deep Learning has largely alleviated the need for manual feature extraction, achieving state-ofthe-art performance in fields such as computer vision and speech recognition [13,14].”
From EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces (2018) · cites this paper as [13]
In the citing paper
“In particular, neural networks became competitive, solving problems in speech recognition [68], image recognition [69] and language translation [70].”
From The growing ubiquity of algorithms in society: implications, impacts and innovations (2018) · cites this paper as [68]
In the citing paper
“Apart from images, sequential data such as text and audio can also be processed with DNNs to reach state-of-the-art performance for document classification and speech recognition.”
From Deep learning for time series classification: a review (2019) · cites this paper as Hinton et al., 2012
In the citing paper
“The other more direct reason behind the high accuracies of deep CNNs on time series data is its success in other sequential data such as speech recognition (Hinton et al., 2012) and sentence classification (Kim, 2014)”
From Deep learning for time series classification: a review (2019) · cites this paper as Hinton et al., 2012
In the citing paper
“Recent studies have reported that deep learning methods have been successfully applied to many applications areas e.g., image and video classification [11-13], visual tracking [14], speech recognition [15] and natural language processing [16].”
From Medical image retrieval using deep convolutional neural network (2017) · cites this paper as [15]
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Self-citationReducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Self-citationA fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Self-citation(2010) · Cited by 14,134
Training Products of Experts by Minimizing Contrastive Divergence
Hinton, G. E. (2002) · Neural Computation · doi:10.1162/089976602760128018 · Cited by 4,879 · cited 3×
“…learning algorithm for a restricted Boltzmann machine (RBM) which consists of a layer of stochastic binary " visible " units that represent binary input data connected to a layer of stochastic binary hidden units that learn to model significant nonindependencies between the visible units [20].”
InfluentialSelf-citation(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011
Self-citationA Practical Guide to Training Restricted Boltzmann Machines
Hinton, G. E. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_32 · Cited by 2,852 · cited 2×
“Learning the standard deviations of a GRBM is problematic for reasons described in [21], so for pretraining using CD 1 , the data are normalized so that each coefficient has zero mean and unit variance, the standard deviations are set to one when computing ( ) v h p ; , and no noise is added to the…”
Self-citationPerceptual linear predictive (PLP) analysis of speech
Hermansky, H. (1990) · The Journal of the Acoustical Society of America · doi:10.1121/1.399423 · Cited by 2,536
Acoustic Modeling Using Deep Belief Networks
Mohamed, A.-R., Dahl, G. E., & Hinton, G. (2012) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2011.2109382 · Cited by 1,727
Self-citation
Research works printed but not linked: 5
- sainath, 2011, Improvements in using deep belief networks for large vocabulary continuous speech recognition, Speech and Language Algorithm Group IBM Yorktown Heights NY Tech Rep UTML TR 2010-003
- rifai, 0, Contractive autoencoders: Explicit invariance during feature extraction, Proc 28th Int Conf Machine Learning, 833
- yu, 2011, Discriminative pretraining of deep neural networks, U S Patent Filing
- mohamed, 0, Deep belief networks for phone recognition, Proc NIPS Workshop Deep Learning for Speech Recognition and Related Applications
- pearl, 1988, Probabilistic Inference in Intelligent Systems Networks of Plausible Inference
Cited by
Items 601–700 of 1,106
Neural Approaches to Conversational AI
Gao, J., Galley, M., & Li, L. (2019) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000074 · Cited by 209
Kumar, P., Chauhan, S., & Awasthi, L. K. (2024) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-023-09986-x · Cited by 206
Character-level neural network for biomedical named entity recognition
Gridach, M. (2017) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.05.002 · Cited by 208
Comparison of Long Short Term Memory Networks and the Hydrological Model in Runoff Simulation
Fan, H., Jiang, M., Xu, L., Zhu, H., Cheng, J., & Jiang, J. (2020) · Water · doi:10.3390/w12010175 · Cited by 208
Aziz, L., Haji Salam, M. S. B., Sheikh, U. U., & Ayub, S. (2020) · IEEE Access · doi:10.1109/access.2020.3021508 · Cited by 204
Deep Neural Network Approximation Theory
Elbrachter, D., Perekrestenko, D., Grohs, P., & Bolcskei, H. (2021) · IEEE Transactions on Information Theory · doi:10.1109/tit.2021.3062161 · Cited by 206
Factors affecting intention to use e-banking in Jordan
Anouze, A. L. M., & Alamro, A. S. (2019) · International Journal of Bank Marketing · doi:10.1108/ijbm-10-2018-0271 · Cited by 203
DeepBurning: automatic generation of FPGA-based learning accelerators for the neural network family
Wang, Y., Xu, J., Han, Y., Li, H., & Li, X. (2016) · Proceedings of the 53rd Annual Design Automation Conference · doi:10.1145/2897937.2898003 · Cited by 205
Siamese neural network based gait recognition for human identification
Zhang, C., Liu, W., Ma, H., & Fu, H. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472194 · Cited by 200
A Review: Generative Adversarial Networks
Gonog, L., & Zhou, Y. (2019) · 2019 14th IEEE Conference on Industrial Electronics and Applications (ICIEA) · doi:10.1109/iciea.2019.8833686 · Cited by 178
“Similar to the training of Sigmod functionbased classifiers, training the discriminator involves minimizing the cross entropy[10].”
Jang, B. C., Kim, S., Yang, S. Y., Park, J., Cha, J.-H., Oh, J., Choi, J., Im, S. G., Dravid, V. P., & Choi, S.-Y. (2019) · Nano Letters · doi:10.1021/acs.nanolett.8b04023 · Cited by 203
Deep beamforming networks for multi-channel speech recognition
Xiao, X., Watanabe, S., Erdogan, H., Lu, L., Hershey, J., Seltzer, M. L., Chen, G., Zhang, Y., Mandel, M., & Yu, D. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472778 · Cited by 199
Self-citationBozkurt, B., Germanakis, I., & Stylianou, Y. (2018) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2018.06.026 · Cited by 201
DeepPicker: A deep learning approach for fully automated particle picking in cryo-EM
Wang, F., Gong, H., Liu, G., Li, M., Yan, C., Xia, T., Li, X., & Zeng, J. (2016) · Journal of Structural Biology · doi:10.1016/j.jsb.2016.07.006 · Cited by 203
An Effective Optimization Method for Machine Learning Based on ADAM
Yi, D., Ahn, J., & Ji, S. (2020) · Applied Sciences · doi:10.3390/app10031073 · Cited by 202
S1 and S2 Heart Sound Recognition Using Deep Neural Networks
(2017) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2559800 · Cited by 202
Vandal, T., Kodra, E., & Ganguly, A. R. (2019) · Theoretical and Applied Climatology · doi:10.1007/s00704-018-2613-3 · Cited by 201
Essentially No Barriers in Neural Network Energy Landscape
Draxler, F., Veschgini, K., Manfred Salmhofer, B., & Hamprecht, F. A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.00885 · Cited by 171
Hu, W., Qian, Y., Soong, F. K., & Wang, Y. (2015) · Speech Communication · doi:10.1016/j.specom.2014.12.008 · Cited by 201
Deep convolutional learning for Content Based Image Retrieval
Tzelepi, M., & Tefas, A. (2018) · Neurocomputing · doi:10.1016/j.neucom.2017.11.022 · Cited by 201
Learning atoms for materials discovery
Zhou, Q., Tang, P., Liu, S., Pan, J., Yan, Q., & Zhang, S.-C. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1801181115 · Cited by 200
CN-Celeb: A Challenging Chinese Speaker Recognition Dataset
Fan, Y., Kang, J. W., Li, L. T., Li, K. C., Chen, H. L., Cheng, S. T., Zhang, P. Y., Zhou, Z. Y., Cai, Y. Q., & Wang, D. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9054017 · Cited by 186
A Survey on Methods and Theories of Quantized Neural Networks
Guo, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.04752 · Cited by 188
Ablation Studies in Artificial Neural Networks
Meyes, R., Lu, M., de Puiseau, C. W., & Meisen, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.08644 · Cited by 168
“…segmentation in the field of computer vision (CV) [1–5], speech recognition and speech separation in the field of natural language processing (NLP) [6–10] or self-learning agents based on deep reinforcement learning (DRL) for video games [11–14], classic board games [15–17] as well as locomotion…”
A survey of swarm and evolutionary computing approaches for deep learning
Darwish, A., Hassanien, A. E., & Das, S. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-019-09719-2 · Cited by 200
“…such problems DL currently provide the best solutions to many problems in image recognition, speech recognition, and natural language processing (Hinton et al. 2012a, b) The human experience cannot be explored in many fields where DL can be used e.g. health applications (Lu et al. 2017) DL…”
Large-Scale Multi-label Text Classification - Revisiting Neural NetworksPreprint
Nam, J., Kim, J., Mencía, E. L., Gurevych, I., & Fürnkranz, J. (2013) · Cited by 200
Trends in biomedical signal feature extraction
Krishnan, S., & Athavale, Y. (2018) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2018.02.008 · Cited by 197
Hyperspectral Unmixing via Deep Convolutional Neural Networks
Zhang, X., Sun, Y., Zhang, J., Wu, P., & Jiao, L. (2018) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2018.2857804 · Cited by 198
A Deep Latent Factor Model for High-Dimensional and Sparse Matrices in Recommender Systems
Wu, D., Luo, X., Shang, M., He, Y., Wang, G., & Zhou, M. (2021) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2019.2931393 · Cited by 199
Driver stress detection via multimodal fusion using attention-based CNN-LSTM
Mou, L., Zhou, C., Zhao, P., Nakisa, B., Rastgoo, M. N., Jain, R., & Gao, W. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.114693 · Cited by 198
Explainable and Interpretable Models in Computer Vision and Machine Learning
(2018) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-319-98131-4 · Cited by 199
Chiarelli, A. M., Croce, P., Merla, A., & Zappasodi, F. (2018) · Journal of Neural Engineering · doi:10.1088/1741-2552/aaaf82 · Cited by 197
Residual LSTM: Design of a Deep Recurrent Architecture for Distant Speech Recognition
Kim, J., El-Khamy, M., & Lee, J. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-477 · Cited by 196
An improved SPEI drought forecasting approach using the long short-term memory neural network
Dikshit, A., Pradhan, B., & Huete, A. (2021) · Journal of Environmental Management · doi:10.1016/j.jenvman.2021.111979 · Cited by 196
Sarikaya, R. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2016.2617341 · Cited by 198
UCNN: Exploiting Computational Reuse in Deep Neural Networks via Weight Repetition
Hegde, K., Yu, J., Agrawal, R., Yan, M., Pellauer, M., & Fletcher, C. (2018) · 2018 ACM/IEEE 45th Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2018.00062 · Cited by 191
Berner, J., Grohs, P., & Jentzen, A. (2020) · SIAM Journal on Mathematics of Data Science · doi:10.1137/19m125649x · Cited by 254
A Bayesian Data Augmentation Approach for Learning Deep Models
Tran, T. B., Pham, T. T., Carneiro, G., Palmer, L. J., & Reid, I. D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.10564 · Cited by 180
Neural Decoder for Topological Codes
Torlai, G., & Melko, R. G. (2017) · Physical Review Letters · doi:10.1103/physrevlett.119.030501 · Cited by 194
Error bounds for approximations with deep ReLU neural networks in Ws,p norms
Gühring, I., Kutyniok, G., & Petersen, P. (2020) · Analysis and Applications · doi:10.1142/s0219530519410021 · Cited by 195
Ma, X., Guo, F.-M., Niu, W., Lin, X., Tang, J., Ma, K., Ren, B., & Wang, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5954 · Cited by 193
DP-CGAN: Differentially Private Synthetic Data and Label Generation
Torkzadehmahani, R., Kairouz, P., & Paten, B. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00018 · Cited by 193
“Recent studies have shown that deep neural networks (DNNs) can achieve state-of-the-art performance in various applications such as image recognition [25, 30], natural language processing [9], speech recognition [26, 20] and complex video games [41, 34].”
Adaptive Ultrasound Beamforming Using Deep Learning
Luijten, B., Cohen, R., de Bruijn, F. J., Schmeitz, H. A. W., Mischi, M., Eldar, Y. C., & van Sloun, R. J. G. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.3008537 · Cited by 194
“DNNs have proven to be very successful in tasks such as image classification [10], image segmentation [11] and speech recognition [12].”
MethodPrecision medicine in stroke: towards personalized outcome predictions using artificial intelligence
Bonkhoff, A. K., & Grefkes, C. (2022) · Brain · doi:10.1093/brain/awab439 · Cited by 193
Deep mixture density networks for acoustic modeling in statistical parametric speech synthesis
Zen, H., & Senior, A. (2014) · 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2014.6854321 · Cited by 187
Self-citationAdaptation of context-dependent deep neural networks for automatic speech recognition
Yao, K., Yu, D., Seide, F., Su, H., Deng, L., & Gong, Y. (2012) · 2012 IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2012.6424251 · Cited by 194
Self-citationHuman Activity Recognition Using Recurrent Neural Networks
Singh, D., Merdivan, E., Psychoula, I., Kropf, J., Hanke, S., Geist, M., & Holzinger, A. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66808-6_18 · Cited by 186
Li, J., Zhu, X., Li, Y., Tong, Y. W., Ok, Y. S., & Wang, X. (2021) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2020.123928 · Cited by 191
An Improved Bearing Fault Diagnosis Method using One-Dimensional CNN and LSTM
(2018) · Strojniški vestnik - Journal of Mechanical Engineering · doi:10.5545/sv-jme.2018.5249 · Cited by 190
NO Need to Worry about Adversarial Examples in Object Detection in Autonomous Vehicles
Lu, J., Sibai, H., Fabry, E., & Forsyth, D. A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.03501 · Cited by 186
Wu, Y., & Wang, G. (2018) · International Journal of Molecular Sciences · doi:10.3390/ijms19082358 · Cited by 193
Dynamic energy-accuracy trade-off using stochastic computing in deep neural networks
Kim, K., Kim, J., Yu, J., Seo, J., Lee, J., & Choi, K. (2016) · Proceedings of the 53rd Annual Design Automation Conference · doi:10.1145/2897937.2898011 · Cited by 188
MFAS: Multimodal Fusion Architecture Search
Perez-Rua, J.-M., Vielzeuf, V., Pateux, S., Baccouche, M., & Jurie, F. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00713 · Cited by 193
“Deep neural networks have demonstrated to be effective models for solving a large variety of problems in several domains, including image [22] and video [5] classification, speech recognition [15], and machine translation [44], to name a few.”
BackgroundImproving DNN speaker independence with I-vector inputs
Senior, A., & Lopez-Moreno, I. (2014) · 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2014.6853591 · Cited by 192
Self-citationImproved Mixed-Example Data Augmentation
Summers, C., & Dinneen, M. J. (2019) · 2019 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2019.00139 · Cited by 177
Multi-Robot Path Planning Method Using Reinforcement Learning
Bae, H., Kim, G., Kim, J., Qian, D., & Lee, S. (2019) · Applied Sciences · doi:10.3390/app9153057 · Cited by 190
Scalable Deep Learning on Distributed Infrastructures: Challenges, Techniques, and Tools
Mayer, R., & Jacobsen, H.-A. (2021) · ACM Computing Surveys · doi:10.1145/3363554 · Cited by 192
“Version of Record will be published in ACM Computing Surveys. 1 INTRODUCTION Deep Learning (DL) has recently gained a lot of attention due to its superior performance in tasks like speech recognition [65,69], optical character recognition [20], and object detection [95]. The application of DL poses a tremendous potent…”
Lai, Y.-H., Chen, W.-N., Hsu, T.-C., Lin, C., Tsao, Y., & Wu, S. (2020) · Scientific Reports · doi:10.1038/s41598-020-61588-w · Cited by 191
Convolutional Neural Networks-based continuous speech recognition using raw speech signal
Palaz, D., Magimai.-Doss, M., & Collobert, R. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178781 · Cited by 184
Provable approximation properties for deep neural networks
Shaham, U., Cloninger, A., & Coifman, R. R. (2018) · Applied and Computational Harmonic Analysis · doi:10.1016/j.acha.2016.04.003 · Cited by 190
Why Deep Learning Works: A Manifold Disentanglement Perspective
Brahma, P. P., Wu, D., & She, Y. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2496947 · Cited by 190
1.1 Deep Learning Hardware: Past, Present, and Future
LeCun, Y. (2019) · 2019 IEEE International Solid- State Circuits Conference - (ISSCC) · doi:10.1109/isscc.2019.8662396 · Cited by 182
Pathways and challenges of the application of artificial intelligence to geohazards modelling
Dikshit, A., Pradhan, B., & Alamri, A. M. (2021) · Gondwana Research · doi:10.1016/j.gr.2020.08.007 · Cited by 188
Watermarking Neural Networks With Watermarked Images
Wu, H., Liu, G., Yao, Y., & Zhang, X. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3030671 · Cited by 190
Video Tracking Using Learned Hierarchical Features
Wang, L., Liu, T., Wang, G., Chan, K. L., & Yang, Q. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2403231 · Cited by 190
Multimodal integration learning of robot behavior using deep neural networks
Noda, K., Arie, H., Suga, Y., & Ogata, T. (2014) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2014.03.003 · Cited by 189
Ensemble machine learning models for aviation incident risk prediction
Zhang, X., & Mahadevan, S. (2019) · Decision Support Systems · doi:10.1016/j.dss.2018.10.009 · Cited by 190
Random-Drop Data Augmentation of Deep Convolutional Neural Network for Mineral Prospectivity Mapping
Li, T., Zuo, R., Xiong, Y., & Peng, Y. (2021) · Natural Resources Research · doi:10.1007/s11053-020-09742-z · Cited by 189
Deep Learning Techniques for Future Intelligent Cross-Media Retrieval
Rehman, S. U., Waqas, M. M., Tu, S., Koubâa, A., Rehman, O. U., Ahmad, J. E., Hanif, M. I., & Han, Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.01191 · Cited by 190
“Similarly, Mel-frequency cepstral coefficients (MFCC) have been overcome by deep neural networks in the audio domain for speech recognition [107].”
BackgroundAutomatic driver stress level classification using multimodal deep learning
Rastgoo, M. N., Nakisa, B., Maire, F., Rakotonirainy, A., & Chandran, V. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.07.010 · Cited by 188
Modeling Human Motion with Quaternion-Based Neural Networks
Pavllo, D., Feichtenhofer, C., Auli, M., & Grangier, D. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01245-6 · Cited by 152
Improving the Reliability of Deep Neural Networks in NLP: A Review
Alshemali, B., & Kalita, J. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.105210 · Cited by 188
“DNNs are also the most popular option for challenging applications in speech recognition [7], voice synthesis [8], language translation and natural language processing (NLP) [9].”
Deep Learning Intervention for Health Care Challenges: Some Biomedical Domain Considerations
Tobore, I., Li, J., Yuhang, L., Al-Handarish, Y., Kandwal, A., Nie, Z., & Wang, L. (2019) · JMIR mHealth and uHealth · doi:10.2196/11966 · Cited by 180
“DNN has been applied to solve many traditional problems where available large data need to be analyzed and many impressive results have been reported in different areas such as medical image processing [18], speech analysis [19], and electronic health record (EHR) translation [20,21].”
BackgroundA Comprehensive Review of Deep Learning-Based Crack Detection Approaches
Hamishebahar, Y., Guan, H., So, S., & Jo, J. (2022) · Applied Sciences · doi:10.3390/app12031374 · Cited by 188
“Deep learning models have been utilised in different areas such as speech and audio processing [17], language processing [18], information retrieval [19], and computer vision [20].”
MethodDeng, L., Abdel-Hamid, O., & Yu, D. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638952 · Cited by 186
Self-citationImproved feature processing for deep neural networks
Rath, S. P., Povey, D., Veselý, K., & Černocký, J. (2013) · Interspeech 2013 · doi:10.21437/interspeech.2013-48 · Cited by 187
ScaleDeep: A Scalable Compute Architecture for Learning and Evaluating Deep Networks
Venkataramani, S., Ranjan, A., Banerjee, S., Das, D., Avancha, S., Jagannathan, A., Durg, A., Nagaraj, D., Kaul, B., Dubey, P., et al. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080244 · Cited by 188
Deep neural network‐based computer‐assisted detection of cerebral aneurysms in MR angiography
Nakao, T., Hanaoka, S., Nomura, Y., Sato, I., Nemoto, M., Miki, S., Maeda, E., Yoshikawa, T., Hayashi, N., & Abe, O. (2018) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.25842 · Cited by 188
Applying Neural Networks in Optical Communication Systems: Possible Pitfalls
Eriksson, T. A., Bulow, H., & Leven, A. (2017) · IEEE Photonics Technology Letters · doi:10.1109/lpt.2017.2755663 · Cited by 187
Cang, R., Xu, Y., Chen, S., Liu, Y., Jiao, Y., & Yi Ren, M. (2017) · Journal of Mechanical Design · doi:10.1115/1.4036649 · Cited by 188
Robust Physical-World Attacks on Machine Learning Models.Preprint
Evtimov, I., Eykholt, K., Fernandes, E., Kohno, T., Li, B., Prakash, A., Rahmati, A., & Song, D. X. (2017) · arXiv (Cornell University) · Cited by 195
Bejnordi, B. E., Zuidhof, G., Balkenhol, M., Hermsen, M., Bult, P., van Ginneken, B., Karssemeijer, N., Litjens, G., & van der Laak, J. (2017) · Journal of Medical Imaging · doi:10.1117/1.jmi.4.4.044504 · Cited by 185
Deep learning for in vitro prediction of pharmaceutical formulations
Yang, Y., Ye, Z., Su, Y., Zhao, Q., Li, X., & Ouyang, D. (2019) · Acta Pharmaceutica Sinica B · doi:10.1016/j.apsb.2018.09.010 · Cited by 178
Machine intelligence and the data-driven future of marine science
Malde, K., Handegard, N. O., Eikvil, L., & Salberg, A.-B. (2020) · ICES Journal of Marine Science · doi:10.1093/icesjms/fsz057 · Cited by 187
Diffractive Deep Neural Networks at Visible Wavelengths
Chen, H., Feng, J., Jiang, M., Wang, Y., Lin, J., Tan, J., & Jin, P. (2021) · Engineering · doi:10.1016/j.eng.2020.07.032 · Cited by 182
Machine‐Learning Designs of Anisotropic Digital Coding Metasurfaces
Zhang, Q., Liu, C., Wan, X., Zhang, L., Liu, S., Yang, Y., & Cui, T. J. (2019) · Advanced Theory and Simulations · doi:10.1002/adts.201800132 · Cited by 186
Deep learning helicopter dynamics models
Punjani, A., & Abbeel, P. (2015) · 2015 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2015.7139643 · Cited by 181
Audio-visual deep learning for noise robust speech recognition
Huang, J., & Kingsbury, B. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639140 · Cited by 179
Self-citationDuplex Generative Adversarial Network for Unsupervised Domain Adaptation
Hu, L., Kan, M., Shan, S., & Chen, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00162 · Cited by 182
Deep Neural Networks for Ultrasound Beamforming
Luchies, A. C., & Byram, B. C. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2809641 · Cited by 182
Jones, D. T., & Kandathil, S. M. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty341 · Cited by 184
Unsupervised Speech Recognition
Baevski, A., Hsu, W.-N., Conneau, A., & Auli, M. (2021) · arXiv · doi:10.48550/arxiv.2105.11084
Deep Head Pose: Gaze-Direction Estimation in Multimodal Video
Mukherjee, S. S., & Robertson, N. M. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2482819 · Cited by 182
Plant Disease Detection with Deep Learning and Feature Extraction Using Plant Village
Mohameth, F., Bingcai, C., & Sada, K. A. (2020) · Journal of Computer and Communications · doi:10.4236/jcc.2020.86002 · Cited by 183
Self-Supervised Convolutional Subspace Clustering Network
Zhang, J., Li, C.-G., You, C., Qi, X., Zhang, H., Guo, J., & Lin, Z. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00562 · Cited by 166
“Deep learning has gained a lot of research interests due to its powerful ability to learn hierarchical features in an end-to-end trainable way [10, 15].”
Deep learning predictions of survival based on MRI in amyotrophic lateral sclerosis
van der Burgh, H. K., Schmidt, R., Westeneng, H.-J., de Reus, M. A., van den Berg, L. H., & van den Heuvel, M. P. (2017) · NeuroImage: Clinical · doi:10.1016/j.nicl.2016.10.008 · Cited by 180
Scene Classification Based on Multiscale Convolutional Neural Network
Liu, Y., Zhong, Y., & Qin, Q. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2848473 · Cited by 181
Eskofier, B. M., Lee, S. I., Daneault, J.-F., Golabchi, F. N., Ferreira-Carvalho, G., Vergara-Diaz, G., Sapienza, S., Costante, G., Klucken, J., Kautz, T., et al. (2016) · 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2016.7590787 · Cited by 180
Soudry, D., Hubara, I., & Meir, R. (2014) · Cited by 240
Predicting glass transition temperatures using neural networks
Cassar, D. R., de Carvalho, A. C. P. L. F., & Zanotto, E. D. (2018) · Acta Materialia · doi:10.1016/j.actamat.2018.08.022 · Cited by 179
Metadata
- Authors
- Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., & Kingsbury, B.
- Affiliations
- University of Toronto (CA)
- University of Waterloo (CA)
- Microsoft (United States) (US)
- Google (United States) (US)
- IBM (United States) (US)
- Michigan State University (US)
- Venue
- IEEE Signal Processing Magazine
- Published
- 2012-11
- Volume
- 29
- Issue
- 6
- Pages
- 82-97
- ISSN
- 1053-5888 (ISSN-L)
- OpenAlex
- W2160815625
- Cited by
- 10,260
- References
- 71
- Citations by year
- 2026: 253 · 2025: 526 · 2024: 610 · 2023: 696 · 2022: 837 · 2021: 978 · 2020: 1232 · 2019: 1313 · 2018: 1220 · 2017: 967 · 2016: 712 · 2015: 498 · 2014: 276 · 2013: 128 · 2012: 9
- FWCI
- 284.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Signal Processing Magazine (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- deep neural network, acoustic modeling, speech recognition, hidden Markov models, Gaussian mixture model, feedforward neural networks, posterior probability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.