Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups
The DOI matches its Crossref record; 68 of the 71 references it cites were found in a registry or an index.
Abstract
Most current speech recognition systems use hidden Markov models (HMMs) to deal with the temporal variability of speech and Gaussian mixture models (GMMs) to determine how well each state of each HMM fits a frame or a short window of frames of coefficients that represents the acoustic input. An alternative way to evaluate the fit is to use a feed-forward neural network that takes several frames of coefficients as input and produces posterior probabilities over HMM states as output. Deep neural networks (DNNs) that have many hidden layers and are trained using new methods have been shown to outperform GMMs on a variety of speech recognition benchmarks, sometimes by a large margin. This article provides an overview of this progress and represents the shared views of four research groups that have had recent successes in using DNNs for acoustic modeling in speech recognition.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Deep Learning has largely alleviated the need for manual feature extraction, achieving state-ofthe-art performance in fields such as computer vision and speech recognition [13,14].”
From EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces (2018) · cites this paper as [13]
In the citing paper
“In particular, neural networks became competitive, solving problems in speech recognition [68], image recognition [69] and language translation [70].”
From The growing ubiquity of algorithms in society: implications, impacts and innovations (2018) · cites this paper as [68]
In the citing paper
“Apart from images, sequential data such as text and audio can also be processed with DNNs to reach state-of-the-art performance for document classification and speech recognition.”
From Deep learning for time series classification: a review (2019) · cites this paper as Hinton et al., 2012
In the citing paper
“The other more direct reason behind the high accuracies of deep CNNs on time series data is its success in other sequential data such as speech recognition (Hinton et al., 2012) and sentence classification (Kim, 2014)”
From Deep learning for time series classification: a review (2019) · cites this paper as Hinton et al., 2012
In the citing paper
“Recent studies have reported that deep learning methods have been successfully applied to many applications areas e.g., image and video classification [11-13], visual tracking [14], speech recognition [15] and natural language processing [16].”
From Medical image retrieval using deep convolutional neural network (2017) · cites this paper as [15]
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Self-citationReducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Self-citationA fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Self-citation(2010) · Cited by 14,134
Training Products of Experts by Minimizing Contrastive Divergence
Hinton, G. E. (2002) · Neural Computation · doi:10.1162/089976602760128018 · Cited by 4,879 · cited 3×
“…learning algorithm for a restricted Boltzmann machine (RBM) which consists of a layer of stochastic binary " visible " units that represent binary input data connected to a layer of stochastic binary hidden units that learn to model significant nonindependencies between the visible units [20].”
InfluentialSelf-citation(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011
Self-citationA Practical Guide to Training Restricted Boltzmann Machines
Hinton, G. E. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_32 · Cited by 2,852 · cited 2×
“Learning the standard deviations of a GRBM is problematic for reasons described in [21], so for pretraining using CD 1 , the data are normalized so that each coefficient has zero mean and unit variance, the standard deviations are set to one when computing ( ) v h p ; , and no noise is added to the…”
Self-citationPerceptual linear predictive (PLP) analysis of speech
Hermansky, H. (1990) · The Journal of the Acoustical Society of America · doi:10.1121/1.399423 · Cited by 2,536
Acoustic Modeling Using Deep Belief Networks
Mohamed, A.-R., Dahl, G. E., & Hinton, G. (2012) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2011.2109382 · Cited by 1,727
Self-citation
Research works printed but not linked: 5
- sainath, 2011, Improvements in using deep belief networks for large vocabulary continuous speech recognition, Speech and Language Algorithm Group IBM Yorktown Heights NY Tech Rep UTML TR 2010-003
- rifai, 0, Contractive autoencoders: Explicit invariance during feature extraction, Proc 28th Int Conf Machine Learning, 833
- yu, 2011, Discriminative pretraining of deep neural networks, U S Patent Filing
- mohamed, 0, Deep belief networks for phone recognition, Proc NIPS Workshop Deep Learning for Speech Recognition and Related Applications
- pearl, 1988, Probabilistic Inference in Intelligent Systems Networks of Plausible Inference
Cited by
Items 301–400 of 1,106
Holzinger, A., Carrington, A., & Müller, H. (2020) · KI - Künstliche Intelligenz · doi:10.1007/s13218-020-00636-z · Cited by 406
Deep Neural Network Approaches to Speaker and Language Recognition
Richardson, F., Reynolds, D., & Dehak, N. (2015) · IEEE Signal Processing Letters · doi:10.1109/lsp.2015.2420092 · Cited by 404
Low-bit Quantization of Neural Networks for Efficient Inference
Choukroun, Y., Kravchik, E., Yang, F., & Kisilev, P. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00363 · Cited by 404
“Neural networks (NNs) proved to be extremely effective in solving a broad variety of problems in computer vision, speech recognition and natural language processing [22, 14, 36].”
BackgroundData augmentation for deep-learning-based electroencephalography
Lashgari, E., Liang, D., & Maoz, U. (2020) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2020.108885 · Cited by 398
Deep learning in bioinformatics: Introduction, application, and perspective in the big data era
Li, Y., Huang, C., Ding, L., Li, Z., Pan, Y., & Gao, X. (2019) · Methods · doi:10.1016/j.ymeth.2019.04.008 · Cited by 401
Early Detection of Parkinson’s Disease Using Deep Learning and Machine Learning
Wang, W., Lee, J., Harrou, F., & Sun, Y. (2020) · IEEE Access · doi:10.1109/access.2020.3016062 · Cited by 397
Deep Learning for EMG-based Human-Machine Interaction: A Review
Xiong, D., Zhang, D., Zhao, X., & Zhao, Y. (2021) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2021.1003865 · Cited by 395
“It has achieved many benchmark achievements in computer vision [13], speech recognition [14], machine translation [15], and so on.”
Big Data: Deep Learning for financial sentiment analysis
Sohangir, S., Wang, D., Pomeranets, A., & Khoshgoftaar, T. M. (2018) · Journal of Big Data · doi:10.1186/s40537-017-0111-6 · Cited by 390
Recent Advances in End-to-End Automatic Speech Recognition
Li, J. (2022) · APSIPA Transactions on Signal and Information Processing · doi:10.1561/116.00000050 · Cited by 395
Liu, Y., Norton, J. J. S., Qazi, R., Zou, Z., Ammann, K. R., Liu, H., Yan, L., Tran, P. L., Jang, K.-I., Lee, J. W., et al. (2016) · Science Advances · doi:10.1126/sciadv.1601185 · Cited by 397
Deep Crossing: Web-Scale Modeling without Manually Crafted Combinatorial Features
Shan, Y., Hoens, T. R., Jiao, J., Wang, H., Yu, D., & Mao, J. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939704 · Cited by 396
Self-citationDeep multiple instance learning for image classification and auto-annotation
Wu, J., Yu, Y., Huang, C., & Yu, K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298968 · Cited by 386
Remaining useful life prediction using multi-scale deep convolutional neural network
Li, H., Zhao, W., Zhang, Y., & Zio, E. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106113 · Cited by 390
Exploring convolutional neural network structures and optimization techniques for speech recognition
Abdel-Hamid, O., Deng, L., & Yu, D. (2013) · Interspeech 2013 · doi:10.21437/interspeech.2013-744 · Cited by 384
Self-citationAnalyses of internal structures and defects in materials using physics-informed neural networks
Zhang, E., Dao, M., Karniadakis, G. E., & Suresh, S. (2022) · Science Advances · doi:10.1126/sciadv.abk0644 · Cited by 393
Combining modality specific deep neural networks for emotion recognition in video
Kahou, S. E., Pal, C., Bouthillier, X., Froumenty, P., Gülçehre, Ç., Memisevic, R., Vincent, P., Courville, A., Bengio, Y., Ferrari, R. C., et al. (2013) · Proceedings of the 15th ACM on International conference on multimodal interaction · doi:10.1145/2522848.2531745 · Cited by 391
Neural networks: An overview of early research, current frameworks and new challenges
Prieto, A., Prieto, B., Ortigosa, E. M., Ros, E., Pelayo, F., Ortega, J., & Rojas, I. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.06.014 · Cited by 391
A review of deep learning techniques for speech processing
Mehrish, A., Majumder, N., Bharadwaj, R., Mihalcea, R., & Poria, S. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101869 · Cited by 389
Jagtap, A. D., Kawaguchi, K., & Em Karniadakis, G. (2020) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2020.0334 · Cited by 259
Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervision
Liang, C., Berant, J., Le, Q., Forbus, K. D., & Lao, N. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1003 · Cited by 381
Deep Learning for Drug-Induced Liver Injury
Xu, Y., Dai, Z., Chen, F., Gao, S., Pei, J., & Lai, L. (2015) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5b00238 · Cited by 382
Deep learning methods in network intrusion detection: A survey and an objective comparison
Gamage, S., & Samarabandu, J. (2020) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2020.102767 · Cited by 382
Electricity Theft Detection in Smart Grid Systems: A CNN-LSTM Based Approach
Hasan, M. N., Toma, R. N., Nahid, A.-A., Islam, M. M. M., & Kim, J.-M. (2019) · Energies · doi:10.3390/en12173310 · Cited by 379
Hand Gesture Recognition Using Micro-Doppler Signatures With Convolutional Neural Network
Kim, Y., & Toomajian, B. (2016) · IEEE Access · doi:10.1109/access.2016.2617282 · Cited by 378
A Deep Learning Approach to Human Activity Recognition Based on Single Accelerometer
Chen, Y., & Xue, Y. (2015) · 2015 IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2015.263 · Cited by 378
“In recent years, deep architectures show its strong learning capacity and make a great breakthrough in the fields of image recognition [7], speech recognition [22].”
BackgroundGeometric deep learning on molecular representations
Atz, K., Grisoni, F., & Schneider, G. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00418-8 · Cited by 373
“, in computer vision [25, 26], natural language processing [9, 102], and speech recognition [10, 11].”
BackgroundMethodEnd-to-end learning for music audio
Dieleman, S., & Schrauwen, B. (2014) · 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2014.6854950 · Cited by 364
Data Augmentation for Deep Neural Network Acoustic Modeling
Cui, X., Goel, V., & Kingsbury, B. (2015) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2015.2438544 · Cited by 376
Self-citationSequence-based prediction of protein protein interaction using a deep-learning algorithm
Sun, T., Zhou, B., Lai, L., & Pei, J. (2017) · BMC Bioinformatics · doi:10.1186/s12859-017-1700-2 · Cited by 375
End-to-end Continuous Speech Recognition using Attention-based Recurrent NN: First Results
Chorowski, J., Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.1602 · Cited by 362
Self-supervised speech representation learning: A review
Mohamed, A., Lee, H.-Y., Borgholt, L., Havtorn, J. D., Edin, J., Igel, C., Kirchhoff, K., Li, S.-W., Livescu, K., Maaløe, L., et al. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3207050 · Cited by 372
“of this transformation, offering impressive gains for scenarios rich in labeled data [1], [2], [3].”
BackgroundSelf-citationUnderstanding Deep Neural Networks with Rectified Linear UnitsPreprint
Arora, R., Basu, A., Mianjy, P., & Mukherjee, A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01491 · Cited by 630
Hoeser, T., & Kuenzer, C. (2020) · Remote Sensing · doi:10.3390/rs12101667 · Cited by 366
Mapping global lake dynamics reveals the emerging roles of small lakes
Pi, X., Luo, Q., Feng, L., Xu, Y., Tang, J., Liang, X., Ma, E., Cheng, R., Fensholt, R., Brandt, M., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-33239-3 · Cited by 358
Sparse Autoencoder-Based Feature Transfer Learning for Speech Emotion Recognition
Deng, J., Zhang, Z., Marchi, E., & Schuller, B. (2013) · 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction · doi:10.1109/acii.2013.90 · Cited by 366
A Proof of Local Convergence for the Adam Optimizer
Bock, S., & Weis, M. (2019) · 2019 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852239 · Cited by 332
A review of deep learning used in the hyperspectral image analysis for agriculture
Wang, C., Liu, B., Liu, L., Zhu, Y., Hou, J., Liu, P., & Li, X. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-021-10018-y · Cited by 362
SAR Automatic Target Recognition Based on Multiview Deep Learning Framework
Pei, J., Huang, Y., Huo, W., Zhang, Y., Yang, J., & Yeo, T.-S. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2776357 · Cited by 358
Jeyaraj, P. R., & Samuel Nadar, E. R. (2019) · Journal of Cancer Research and Clinical Oncology · doi:10.1007/s00432-018-02834-7 · Cited by 360
Neural Network Detection of Data Sequences in Communication Systems
Farsad, N., & Goldsmith, A. (2018) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2018.2868322 · Cited by 358
Applying deep learning to answer selection: A study and an open task
Feng, M., Xiang, B., Glass, M. R., Wang, L., & Zhou, B. (2015) · 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2015.7404872 · Cited by 357
Towards Better Decoding and Language Model Integration in Sequence to Sequence Models
Chorowski, J., & Jaitly, N. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-343 · Cited by 358
Self-citationZhai, X., Jelfs, B., Chan, R. H. M., & Tin, C. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00379 · Cited by 357
Towards End-to-End Speech Recognition with Deep Convolutional Neural Networks
Zhang, Y., Pezeshki, M., Brakel, P., Zhang, S., Laurent, C., Bengio, Y., & Courville, A. (2016) · Interspeech 2016 · doi:10.21437/interspeech.2016-1446 · Cited by 352
Machine learning applications in epilepsy
Abbasi, B., & Goldenholz, D. M. (2019) · Epilepsia · doi:10.1111/epi.16333 · Cited by 354
Kadurin, A., Aliper, A., Kazennov, A., Mamoshina, P., Vanhaelen, Q., Khrabrov, K., & Zhavoronkov, A. (2017) · Oncotarget · doi:10.18632/oncotarget.14073 · Cited by 350
A Deep Look into neural ranking models for information retrieval
Guo, J., Fan, Y., Pang, L., Yang, L., Ai, Q., Zamani, H., Wu, C., Croft, W. B., & Cheng, X. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2019.102067 · Cited by 349
Peng, D., Wang, H., Liu, Z., Zhang, W., Zuo, M. J., & Chen, J. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.2967557 · Cited by 350
Rough Deep Neural Architecture for Short-Term Wind Speed Forecasting
Khodayar, M., Kaynak, O., & Khodayar, M. E. (2017) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2730846 · Cited by 348
Combining Residual Networks with LSTMs for Lipreading
Stafylakis, T., & Tzimiropoulos, G. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-85 · Cited by 348
Li, X., & Wu, X. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178826 · Cited by 336
Huang, W., Cheng, J., Yang, Y., & Guo, G. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.05.052 · Cited by 339
Compute Trends Across Three Eras of Machine Learning
Sevilla, J., Heim, L., Ho, A., Besiroglu, T., Hobbhahn, M., & Villalobos, P. (2022) · 2022 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9891914 · Cited by 363
“In particular, Deng, Yu, and Hinton suggest that “deep architectures with efficient learning algorithms” would be needed to overcome challenges [33], and [34] suggests that leading Speech Recognition researchers held a shared vision of Deep Learning driving major advances in their field”
BackgroundMnemonic Descent Method: A Recurrent Process Applied for End-to-End Face Alignment
Trigeorgis, G., Snape, P., Nicolaou, M. A., Antonakos, E., & Zafeiriou, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.453 · Cited by 337
Very Deep Convolutional Neural Networks for Noise Robust Speech Recognition
Qian, Y., Bi, M., Tan, T., & Yu, K. (2016) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2016.2602884 · Cited by 343
ComDefend: An Efficient Image Compression Model to Defend Adversarial Examples
Jia, X., Wei, X., Cao, X., & Foroosh, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00624 · Cited by 318
SURVEY ON EVOLVING DEEP LEARNING NEURAL NETWORK ARCHITECTURES
Bashar, D. A. (2019) · Journal of Artificial Intelligence and Capsule Networks · doi:10.36548/jaicn.2019.2.003 · Cited by 342
Distributed deep learning networks among institutions for medical imaging
Chang, K., Balachandar, N., Lam, C., Yi, D., Brown, J., Beers, A., Rosen, B., Rubin, D. L., & Kalpathy-Cramer, J. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy017 · Cited by 340
Flexible Piezoelectric Acoustic Sensors and Machine Learning for Speech Processing
Jung, Y. H., Hong, S. K., Wang, H. S., Han, J. H., Pham, T. X., Park, H., Kim, J., Kang, S., Yoo, C. D., & Lee, K. J. (2020) · Advanced Materials · doi:10.1002/adma.201904020 · Cited by 338
Deep Learning for Fall Detection: Three-Dimensional CNN Combined With LSTM on Video Kinematic Data
Lu, N., Wu, Y., Feng, L., & Song, J. (2019) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2018.2808281 · Cited by 339
Device Placement Optimization with Reinforcement Learning
Mirhoseini, A., Pham, H., Le, Q. V., Steiner, B., Larsen, R., Zhou, Y., Kumar, N., Norouzi, M., Bengio, S., & Dean, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.04972 · Cited by 299
An Introduction to Computational Networks and the Computational Network Toolkit
Yu, D., Eversole, A., Seltzer, M., Yao, K., Kuchaiev, O., Zhang, Y., Seide, F. T. B., Huang, Z., Guenter, B. K., Wang, H., et al. (2014) · Cited by 365
Self-citationIdentifying drug–target interactions based on graph convolutional network and deep neural network
Zhao, T., Hu, Y., Valsdottir, L. R., Zang, T., & Peng, J. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbaa044 · Cited by 332
Grotjahn, R., Black, R., Leung, R., Wehner, M. F., Barlow, M., Bosilovich, M., Gershunov, A., Gutowski, W. J., Gyakum, J. R., Katz, R. W., et al. (2016) · Climate Dynamics · doi:10.1007/s00382-015-2638-6 · Cited by 331
Training and Inference with Integers in Deep Neural Networks
Wu, S., Li, G., Chen, F., & Shi, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.04680 · Cited by 306
Cang, Z., & Wei, G.-W. (2017) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005690 · Cited by 330
Learning to Generate Reviews and Discovering Sentiment
Radford, A., Jozefowicz, R., & Sutskever, I. (2017) · arXiv · doi:10.48550/arxiv.1704.01444 · Cited by 330
Capturing Car-Following Behaviors by Deep Learning
Wang, X., Jiang, R., Li, L., Lin, Y., Zheng, X., & Wang, F.-Y. (2018) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2017.2706963 · Cited by 325
Deep Learning for Environmentally Robust Speech Recognition: An Overview of Recent Developments
Zhang, Z., Geiger, J., Pohjalainen, J., Mousa, A. E.-D., Jin, W., & Schuller, B. (2018) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3178115 · Cited by 313
Multi-Speaker DOA Estimation Using Deep Convolutional Networks Trained With Noise Signals
Chakrabarty, S., & Habets, E. A. P. (2019) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2019.2901664 · Cited by 326
Deep Learning-Based Intelligent Fault Diagnosis Methods Toward Rotating Machinery
Tang, S., Yuan, S., & Zhu, Y. (2020) · IEEE Access · doi:10.1109/access.2019.2963092 · Cited by 323
Madurai Elavarasan, R., & Pugazhendhi, R. (2020) · Science of The Total Environment · doi:10.1016/j.scitotenv.2020.138858 · Cited by 326
“Also, deep-learning techniques have a significant impact on the state-of-art speech recognition (Hinton et al., 2012) and visual recognition techniques (Krizhevsky et al., 2017) which has a potentially bigger role in future.”
LipNet: End-to-End Sentence-level Lipreading
Assael, Y., Shillingford, B., Whiteson, S., & de Freitas, N. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01599 · Cited by 172
A novel application of deep learning for single-lead ECG classification
Mathews, S. M., Kambhamettu, C., & Barner, K. E. (2018) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2018.05.013 · Cited by 322
Liu, Z., Wu, C. T., & Koishi, M. (2019) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2018.09.020 · Cited by 319
Intelligent nanophotonics: merging photonics and artificial intelligence at the nanoscale
Yao, K., Unni, R., & Zheng, Y. (2019) · Nanophotonics · doi:10.1515/nanoph-2018-0183 · Cited by 302
Enhancing transportation systems via deep learning: A survey
Wang, Y., Zhang, D., Liu, Y., Dai, B., & Lee, L. H. (2019) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2018.12.004 · Cited by 312
Deep Belief Networks Based Voice Activity Detection
Zhang, X.-L., & Wu, J. (2013) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2012.2229986 · Cited by 313
Deep learning detecting fraud in credit card transactions
Roy, A., Sun, J., Mahoney, R., Alonzi, L., Adams, S., & Beling, P. (2018) · 2018 Systems and Information Engineering Design Symposium (SIEDS) · doi:10.1109/sieds.2018.8374722 · Cited by 300
Recurrent neural networks for real-time prediction of TBM operating parameters
Gao, X., Shi, M., Song, X., Zhang, C., & Zhang, H. (2019) · Automation in Construction · doi:10.1016/j.autcon.2018.11.013 · Cited by 309
Wang, Y., Song, W., Fortino, G., Qi, L.-Z., Zhang, W., & Liotta, A. (2019) · IEEE Access · doi:10.1109/access.2019.2932130 · Cited by 311
Invisible Backdoor Attacks on Deep Neural Networks via Steganography and Regularization
Li, S., Xue, M., Zhao, B., Zhu, H., & Zhang, X. (2020) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2020.3021407 · Cited by 310
“Deep neural networks have been proven to outperform traditional machine learning techniques and outperform humans’ cognitive capacity in many domains, such as image processing [5], speech recognition [6], and board games [7, 8].”
BackgroundSplit Computing and Early Exiting for Deep Learning Applications: Survey and Research Challenges
Matsubara, Y., Levorato, M., & Restuccia, F. (2023) · ACM Computing Surveys · doi:10.1145/3527155 · Cited by 304
“As DL-based classifiers improve their predictive accuracy, mobile applications such as speech recognition in smartphones [20, 45], real-time unmanned navigation [105], and drone-based surveillance [129, 170] are increasingly using DNNs to perform complex inference tasks.”
BackgroundMachine learning-based imaging system for surface defect inspection
Park, J.-K., Kwon, B.-K., Park, J.-H., & Kang, D.-J. (2016) · International Journal of Precision Engineering and Manufacturing-Green Technology · doi:10.1007/s40684-016-0039-x · Cited by 311
Beck, C., E, W., & Jentzen, A. (2019) · Journal of Nonlinear Science · doi:10.1007/s00332-018-9525-3 · Cited by 308
DeepEar: robust smartphone audio sensing in unconstrained acoustic environments using deep learning
Lane, N. D., Georgiev, P., & Qendro, L. (2015) · Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2750858.2804262 · Cited by 310
Faes, L., Wagner, S. K., Fu, D. J., Liu, X., Korot, E., Ledsam, J. R., Back, T., Chopra, R., Pontikos, N., Kern, C., et al. (2019) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30108-6 · Cited by 308
A Transformer-Based Method of Multienergy Load Forecasting in Integrated Energy System
Wang, C., Wang, Y., Ding, Z., Zheng, T., Hu, J., & Zhang, K. (2022) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2022.3166600 · Cited by 305
Entity Embeddings of Categorical Variables
Guo, C., & Berkhahn, F. (2016) · arXiv · doi:10.48550/arxiv.1604.06737 · Cited by 308
“Neural networks revolutionized computer vision[2–6], speech recognition[7, 8] and natural language processing[9–12] and have replaced or are replacing the long dominating methods in each field.”
BackgroundDeep learning for biological image classification
Affonso, C., Rossi, A. L. D., Vieira, F. H. A., & de Carvalho, A. C. P. D. L. F. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.05.039 · Cited by 305
DyNet: The Dynamic Neural Network Toolkit
Neubig, G., Dyer, C., Goldberg, Y., Matthews, A., Ammar, W., Anastasopoulos, A., Ballesteros, M., Chiang, D., Clothiaux, D., Cohn, T., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.03980 · Cited by 302
Formal Security Analysis of Neural Networks using Symbolic Intervals
Wang, S., Pei, K., Whitehouse, J., Yang, J., & Jana, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.10829 · Cited by 265
Deep Coupling Autoencoder for Fault Diagnosis With Multimodal Sensory Data
Ma, M., Sun, C., & Chen, X. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2793246 · Cited by 304
Text-based crude oil price forecasting: A deep learning approach
Li, X., Shang, W., & Wang, S. (2019) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2018.07.006 · Cited by 304
Neural Encoding and Decoding with Deep Learning for Dynamic Natural Vision
Wen, H., Shi, J., Zhang, Y., Lu, K.-H., Cao, J., & Liu, Z. (2018) · Cerebral Cortex · doi:10.1093/cercor/bhx268 · Cited by 303
Quantum Machine Learning: What Quantum Computing Means to Data Mining
Wittek, P. (2014) · Cited by 481
Ali, L., Rahman, A., Khan, A., Zhou, M., Javeed, A., & Khan, J. A. (2019) · IEEE Access · doi:10.1109/access.2019.2904800 · Cited by 301
Akcay, S., Kundegorski, M. E., Devereux, M., & Breckon, T. P. (2016) · 2016 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2016.7532519 · Cited by 299
Joint Representation Learning for Top-N Recommendation with Heterogeneous Information Sources
Zhang, Y., Ai, Q., Chen, X., & Croft, W. B. (2017) · Proceedings of the 2017 ACM on Conference on Information and Knowledge Management · doi:10.1145/3132847.3132892 · Cited by 296
A Pervasive Approach to EEG‐Based Depression Detection
Cai, H., Han, J., Chen, Y., Sha, X., Wang, Z., Hu, B., Yang, J., Feng, L., Ding, Z., Chen, Y., et al. (2018) · Complexity · doi:10.1155/2018/5238028 · Cited by 288
Metadata
- Authors
- Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., & Kingsbury, B.
- Affiliations
- University of Toronto (CA)
- University of Waterloo (CA)
- Microsoft (United States) (US)
- Google (United States) (US)
- IBM (United States) (US)
- Michigan State University (US)
- Venue
- IEEE Signal Processing Magazine
- Published
- 2012-11
- Volume
- 29
- Issue
- 6
- Pages
- 82-97
- ISSN
- 1053-5888 (ISSN-L)
- OpenAlex
- W2160815625
- Cited by
- 10,260
- References
- 71
- Citations by year
- 2026: 253 · 2025: 526 · 2024: 610 · 2023: 696 · 2022: 837 · 2021: 978 · 2020: 1232 · 2019: 1313 · 2018: 1220 · 2017: 967 · 2016: 712 · 2015: 498 · 2014: 276 · 2013: 128 · 2012: 9
- FWCI
- 284.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Signal Processing Magazine (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- deep neural network, acoustic modeling, speech recognition, hidden Markov models, Gaussian mixture model, feedforward neural networks, posterior probability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.