Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups
The DOI matches its Crossref record; 68 of the 71 references it cites were found in a registry or an index.
Abstract
Most current speech recognition systems use hidden Markov models (HMMs) to deal with the temporal variability of speech and Gaussian mixture models (GMMs) to determine how well each state of each HMM fits a frame or a short window of frames of coefficients that represents the acoustic input. An alternative way to evaluate the fit is to use a feed-forward neural network that takes several frames of coefficients as input and produces posterior probabilities over HMM states as output. Deep neural networks (DNNs) that have many hidden layers and are trained using new methods have been shown to outperform GMMs on a variety of speech recognition benchmarks, sometimes by a large margin. This article provides an overview of this progress and represents the shared views of four research groups that have had recent successes in using DNNs for acoustic modeling in speech recognition.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Deep Learning has largely alleviated the need for manual feature extraction, achieving state-ofthe-art performance in fields such as computer vision and speech recognition [13,14].”
From EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces (2018) · cites this paper as [13]
In the citing paper
“In particular, neural networks became competitive, solving problems in speech recognition [68], image recognition [69] and language translation [70].”
From The growing ubiquity of algorithms in society: implications, impacts and innovations (2018) · cites this paper as [68]
In the citing paper
“Apart from images, sequential data such as text and audio can also be processed with DNNs to reach state-of-the-art performance for document classification and speech recognition.”
From Deep learning for time series classification: a review (2019) · cites this paper as Hinton et al., 2012
In the citing paper
“The other more direct reason behind the high accuracies of deep CNNs on time series data is its success in other sequential data such as speech recognition (Hinton et al., 2012) and sentence classification (Kim, 2014)”
From Deep learning for time series classification: a review (2019) · cites this paper as Hinton et al., 2012
In the citing paper
“Recent studies have reported that deep learning methods have been successfully applied to many applications areas e.g., image and video classification [11-13], visual tracking [14], speech recognition [15] and natural language processing [16].”
From Medical image retrieval using deep convolutional neural network (2017) · cites this paper as [15]
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Self-citationReducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Self-citationA fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Self-citation(2010) · Cited by 14,134
Training Products of Experts by Minimizing Contrastive Divergence
Hinton, G. E. (2002) · Neural Computation · doi:10.1162/089976602760128018 · Cited by 4,879 · cited 3×
“…learning algorithm for a restricted Boltzmann machine (RBM) which consists of a layer of stochastic binary " visible " units that represent binary input data connected to a layer of stochastic binary hidden units that learn to model significant nonindependencies between the visible units [20].”
InfluentialSelf-citation(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011
Self-citationA Practical Guide to Training Restricted Boltzmann Machines
Hinton, G. E. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_32 · Cited by 2,852 · cited 2×
“Learning the standard deviations of a GRBM is problematic for reasons described in [21], so for pretraining using CD 1 , the data are normalized so that each coefficient has zero mean and unit variance, the standard deviations are set to one when computing ( ) v h p ; , and no noise is added to the…”
Self-citationPerceptual linear predictive (PLP) analysis of speech
Hermansky, H. (1990) · The Journal of the Acoustical Society of America · doi:10.1121/1.399423 · Cited by 2,536
Acoustic Modeling Using Deep Belief Networks
Mohamed, A.-R., Dahl, G. E., & Hinton, G. (2012) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2011.2109382 · Cited by 1,727
Self-citation
Research works printed but not linked: 5
- sainath, 2011, Improvements in using deep belief networks for large vocabulary continuous speech recognition, Speech and Language Algorithm Group IBM Yorktown Heights NY Tech Rep UTML TR 2010-003
- rifai, 0, Contractive autoencoders: Explicit invariance during feature extraction, Proc 28th Int Conf Machine Learning, 833
- yu, 2011, Discriminative pretraining of deep neural networks, U S Patent Filing
- mohamed, 0, Deep belief networks for phone recognition, Proc NIPS Workshop Deep Learning for Speech Recognition and Related Applications
- pearl, 1988, Probabilistic Inference in Intelligent Systems Networks of Plausible Inference
Cited by
Items 501–600 of 1,106
Zhou, Y., Liu, Y., Wang, D., Liu, X., & Wang, Y. (2021) · Energy Conversion and Management · doi:10.1016/j.enconman.2021.113960 · Cited by 245
CommanderSong: A Systematic Approach for Practical Adversarial Voice RecognitionPreprint
Yuan, X., Chen, Y., Zhao, Y., Long, Y., Liu, X., Chen, K., Zhang, S., Huang, H., Wang, X., & Gunter, C. A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.08535 · Cited by 377
In situ optical backpropagation training of diffractive optical neural networks
Zhou, T., Fang, L., Yan, T., Wu, J., Li, Y., Fan, J., Wu, H., Lin, X., & Dai, Q. (2020) · Photonics Research · doi:10.1364/prj.389553 · Cited by 241
Bayesian Neural Networks: An Introduction and Survey
Goan, E., & Fookes, C. (2020) · Lecture Notes in Mathematics · doi:10.1007/978-3-030-42553-1_3 · Cited by 209
“rovided state-of-the-art results for numerous machine learning and Articial intelligence (AI) applications, such as image classication [6, 7, 8], object detection [9, 10, 11] and speech recognition [12, 13, 14, 15]. Other networks such as the AlphaGo model developed by DeepMind [16] have emphasised the potential of NN…”
Short-term load forecasting of industrial customers based on SVMD and XGBoost
Wang, Y., Sun, S., Chen, X., Zeng, X., Kong, Y., Chen, J., Guo, Y., & Wang, T. (2021) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2021.106830 · Cited by 245
Robust Large Margin Deep Neural Networks
Sokolic, J., Giryes, R., Sapiro, G., & Rodrigues, M. R. D. (2017) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2017.2708039 · Cited by 242
Liu, H., Zhou, J., Xu, Y., Zheng, Y., Peng, X., & Jiang, W. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.07.034 · Cited by 243
Artificial Intelligence in Physical Sciences: Symbolic Regression Trends and Perspectives
Angelis, D., Sofos, F., & Karakasidis, T. E. (2023) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-023-09922-z · Cited by 241
“DL models embed mathematical concepts (linear algebra, probability theory) and programming techniques in hidden layers that span over a number of thousands or more [12, 21], making them perfectly fit in applications ranging from processing videos and images [67, 68, 69, 70], speech recognition [71], and bio-informatic…”
BackgroundSource localization in an ocean waveguide using supervised machine learning
Niu, H., Reeves, E., & Gerstoft, P. (2017) · The Journal of the Acoustical Society of America · doi:10.1121/1.5000165 · Cited by 231
A Novel Deep Learning-Based Collaborative Filtering Model for Recommendation System
Fu, M., Qu, H., Yi, Z., Lu, L., & Liu, Y. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2795041 · Cited by 243
(2018) · Optimization Techniques and Applications with Examples · doi:10.1002/9781119490616.ch9 · Cited by 243
Wu, Z., Valentini-Botinhao, C., Watts, O., & King, S. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178814 · Cited by 238
Rifaioglu, A. S., Nalbat, E., Atalay, V., Martin, M. J., Cetin-Atalay, R., & Doğan, T. (2020) · Chemical Science · doi:10.1039/c9sc03414e · Cited by 240
Machine Learning for Clinical Outcome Prediction
Shamout, F., Zhu, T., & Clifton, D. A. (2021) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2020.3007816 · Cited by 239
Ling, Z.-H., Kang, S.-Y., Zen, H., Senior, A., Schuster, M., Qian, X.-J., Meng, H. M., & Deng, L. (2015) · IEEE Signal Processing Magazine · doi:10.1109/msp.2014.2359987 · Cited by 241
Self-citationPuDianNao: A Polyvalent Machine Learning Accelerator
Liu, D., Chen, T., Liu, S., Zhou, J., Zhou, S., Teman, O., Feng, X., Zhou, X., & Chen, Y. (2015) · Proceedings of the Twentieth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/2694344.2694358 · Cited by 240
Intelligent constellation diagram analyzer using convolutional neural network-based deep learning
Wang, D., Zhang, M., Li, J., Li, Z., Li, J., Song, C., & Chen, X. (2017) · Optics Express · doi:10.1364/oe.25.017150 · Cited by 237
Demystifying Multitask Deep Neural Networks for Quantitative Structure–Activity Relationships
Xu, Y., Ma, J., Liaw, A., Sheridan, R. P., & Svetnik, V. (2017) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.7b00087 · Cited by 238
A Deep Learning-Based Remaining Useful Life Prediction Approach for Bearings
Cheng, C., Ma, G., Zhang, Y., Sun, M., Teng, F., Ding, H., & Yuan, Y. (2020) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2020.2971503 · Cited by 238
Temporal Attention-Augmented Bilinear Network for Financial Time-Series Data Analysis
Tran, D. T., Iosifidis, A., Kanniainen, J., & Gabbouj, M. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2869225 · Cited by 238
FLChain: A Blockchain for Auditable Federated Learning with Trust and Incentive
Bao, X., Su, C., Xiong, Y., Huang, W., & Hu, Y. (2019) · 2019 5th International Conference on Big Data Computing and Communications (BIGCOM) · doi:10.1109/bigcom.2019.00030 · Cited by 225
Robustness of classifiers: from adversarial to random noise
Fawzi, A., Moosavi-Dezfooli, S.-M., & Pascal Frossard, B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.08967 · Cited by 204
The Challenge of Non-Technical Loss Detection Using Artificial Intelligence: A Survey
Glauner, P., Meira, J. A., Valtchev, P., State, R., & Bettinger, F. (2017) · International Journal of Computational Intelligence Systems · doi:10.2991/ijcis.2017.10.1.51 · Cited by 234
A Survey on Compiler Autotuning using Machine Learning
Ashouri, A. H., Killian, W., Cavazos, J., Palermo, G., & Silvano, C. (2019) · ACM Computing Surveys · doi:10.1145/3197978 · Cited by 233
Bhattacharya, S., & Lane, N. D. (2016) · Proceedings of the 14th ACM Conference on Embedded Networked Sensor Systems CD-ROM · doi:10.1145/2994551.2994564 · Cited by 236
Learning Deep Representation from Big and Heterogeneous Data for Traffic Accident Inference
Chen, Q., Song, X., Yamada, H., & Shibasaki, R. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10011 · Cited by 225
Zhang, K., Cheng, H. D., & Zhang, B. (2018) · Journal of Computing in Civil Engineering · doi:10.1061/(asce)cp.1943-5487.0000736 · Cited by 237
A Comprehensive Survey on Model Quantization for Deep Neural Networks in Image Classification
Rokh, B., Azarpeyvand, A., & Khanteymoori, A. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3623402 · Cited by 232
“First, in the 2012 ImageNet challenge, AlexNet [1], a Deep Convolutional Neural Network (DCNN), achieved the highest accuracy among all the models.”
MethodA Twin-8T SRAM Computation-in-Memory Unit-Macro for Multibit CNN-Based AI Edge Processors
Si, X., Chen, J.-J., Tu, Y.-N., Huang, W.-H., Wang, J.-H., Chiu, Y.-C., Wei, W.-C., Wu, S.-Y., Sun, X., Liu, R., et al. (2020) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2019.2952773 · Cited by 231
Yin, L., Cheng, Q., Wang, Z., & Shao, Z. (2015) · Applied Geography · doi:10.1016/j.apgeog.2015.07.010 · Cited by 233
Deep learning for image-based weed detection in turfgrass
Yu, J., Sharpe, S. M., Schumann, A. W., & Boyd, N. S. (2019) · European Journal of Agronomy · doi:10.1016/j.eja.2019.01.004 · Cited by 232
Enhancing Social Media Analysis with Visual Data Analytics: A Deep Learning Approach
Shin, D., He, S., Lee, G. M., Whinston, A. B., Cetintas, S., & Lee, K.-C. (2020) · MIS Quarterly · doi:10.25300/misq/2020/14870 · Cited by 230
Multiple Kernel Learning for Hyperspectral Image Classification: A Review
Gu, Y., Chanussot, J., Jia, X., & Benediktsson, J. A. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2729882 · Cited by 233
Speech acoustic modeling from raw multichannel waveforms
Hoshen, Y., Weiss, R. J., & Wilson, K. W. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178847 · Cited by 226
A Deep Learning Method for Bearing Fault Diagnosis Based on Time-Frequency Image
Wang, J., Mo, Z., Zhang, H., & Miao, Q. (2019) · IEEE Access · doi:10.1109/access.2019.2907131 · Cited by 231
A Graph Neural Network Framework for Social Recommendations
Fan, W., Ma, Y., Li, Q., Wang, J., Cai, G., Tang, J., & Yin, D. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3008732 · Cited by 229
Integrative data analysis of multi-platform cancer data with a multimodal deep learning approach
Liang, M., Li, Z., Chen, T., & Zeng, J. (2015) · IEEE/ACM Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2014.2377729 · Cited by 231
Ma, T., Wang, F., Cheng, J., Yu, Y., & Chen, X. (2016) · Sensors · doi:10.3390/s16101701 · Cited by 230
Exploring neural transducers for end-to-end speech recognition
Battenberg, E., Chen, J., Child, R., Coates, A., Li, Y. G. Y., Liu, H., Satheesh, S., Sriram, A., & Zhu, Z. (2017) · 2017 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU) · doi:10.1109/asru.2017.8268937 · Cited by 227
Wav2Letter: an End-to-End ConvNet-based Speech Recognition System
Collobert, R., Puhrsch, C., & Synnaeve, G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.03193 · Cited by 230
Gradient descent optimizes over-parameterized deep ReLU networks
Zou, D., Cao, Y., Zhou, D., & Gu, Q. (2020) · Machine Learning · doi:10.1007/s10994-019-05839-6 · Cited by 227
Deep Convolutional Neural Networks for mental load classification based on EEG data
Jiao, Z., Gao, X., Wang, Y., Li, J., & Xu, H. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.12.002 · Cited by 227
Holzinger, A., Plass, M., Kickmeier-Rust, M., Holzinger, K., Crişan, G. C., Pintea, C.-M., & Palade, V. (2019) · Applied Intelligence · doi:10.1007/s10489-018-1361-5 · Cited by 228
Methods for Pruning Deep Neural Networks
Vadera, S., & Ameen, S. (2022) · IEEE Access · doi:10.1109/access.2022.3182659 · Cited by 223
Gong, M., Yang, H., & Zhang, P. (2017) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2017.05.001 · Cited by 226
Convolutional Neural Networks for Energy Time Series Forecasting
Koprinska, I., Wu, D., & Wang, Z. (2018) · 2018 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489399 · Cited by 204
Tool wear classification using time series imaging and deep learning
Martínez-Arellano, G., Terrazas, G., & Ratchev, S. (2019) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-019-04090-6 · Cited by 225
Papadimitroulas, P., Brocki, L., Christopher Chung, N., Marchadour, W., Vermet, F., Gaubert, L., Eleftheriadis, V., Plachouris, D., Visvikis, D., Kagadis, G. C., et al. (2021) · Physica Medica · doi:10.1016/j.ejmp.2021.03.009 · Cited by 226
“They have also been used in other fields such as speech recognition [49] and natural language processing [50].”
MethodPrivacy-first health research with federated learning
Sadilek, A., Liu, L., Nguyen, D., Kamruzzaman, M., Serghiou, S., Rader, B., Ingerman, A., Mellem, S., Kairouz, P., Nsoesie, E. O., et al. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00489-2 · Cited by 226
Speech synthesis from ECoG using densely connected 3D convolutional neural networks
Angrick, M., Herff, C., Mugler, E., Tate, M. C., Slutzky, M. W., Krusienski, D. J., & Schultz, T. (2019) · Journal of Neural Engineering · doi:10.1088/1741-2552/ab0c59 · Cited by 225
Lee, D.-H., Zhang, S., Fischer, A., & Bengio, Y. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-23528-8_31 · Cited by 216
Automatic language identification using deep neural networks
Lopez-Moreno, I., Gonzalez-Dominguez, J., Plchot, O., Martinez, D., Gonzalez-Rodriguez, J., & Moreno, P. (2014) · 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2014.6854622 · Cited by 224
Recent progress in analog memory-based accelerators for deep learning
Tsai, H., Ambrogio, S., Narayanan, P., Shelby, R. M., & Burr, G. W. (2018) · Journal of Physics D: Applied Physics · doi:10.1088/1361-6463/aac8a5 · Cited by 225
Real-time decoding of question-and-answer speech dialogue using human cortical activity
Moses, D. A., Leonard, M. K., Makin, J. G., & Chang, E. F. (2019) · Nature Communications · doi:10.1038/s41467-019-10994-4 · Cited by 224
On the training aspects of Deep Neural Network (DNN) for parametric TTS synthesis
Qian, Y., Fan, Y., Hu, W., & Soong, F. K. (2014) · 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2014.6854318 · Cited by 216
Trainable ISTA for Sparse Signal Recovery
Ito, D., Takabe, S., & Wadayama, T. (2019) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2019.2912879 · Cited by 223
Fault detection and classification using artificial neural networks
Heo, S., & Lee, J. H. (2018) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2018.09.380 · Cited by 222
Composing graphical models with neural networks for structured representations and fast inference
Johnson, M. J., Duvenaud, D., Wiltschko, A. B., Datta, S. R., & Adams, R. P. (2016) · arXiv · doi:10.48550/arxiv.1603.06277
Meng, M., Chua, Y. J., Wouterson, E., & Ong, C. P. K. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.11.066 · Cited by 221
Automated Latent Fingerprint Recognition
Cao, K., & Jain, A. K. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2818162 · Cited by 211
Learning Temporal and Spatial Correlations Jointly: A Unified Framework for Wind Speed Prediction
Zhu, Q., Chen, J., Shi, D., Zhu, L., Bai, X., Duan, X., & Liu, Y. (2020) · IEEE Transactions on Sustainable Energy · doi:10.1109/tste.2019.2897136 · Cited by 220
Lipreading with long short-term memory
Wand, M., Koutnik, J., & Schmidhuber, J. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472852 · Cited by 208
Towards reconstructing intelligible speech from the human auditory cortex
Akbari, H., Khalighinejad, B., Herrero, J. L., Mehta, A. D., & Mesgarani, N. (2019) · Scientific Reports · doi:10.1038/s41598-018-37359-z · Cited by 221
Software Engineering Challenges of Deep Learning
Arpteg, A., Brinne, B., Crnkovic-Friis, L., & Bosch, J. (2018) · 2018 44th Euromicro Conference on Software Engineering and Advanced Applications (SEAA) · doi:10.1109/seaa.2018.00018 · Cited by 201
Machine-learning-based diagnostics of EEG pathology
Gemein, L. A. W., Schirrmeister, R. T., Chrabąszcz, P., Wilson, D., Boedecker, J., Schulze-Bonhage, A., Hutter, F., & Ball, T. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117021 · Cited by 218
Deep Convolutional Neural Networks for Predominant Instrument Recognition in Polyphonic Music
Han, Y., Kim, J., & Lee, K. (2017) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2016.2632307 · Cited by 179
Transfer learning for speech and language processing
Wang, D., & Zheng, T. F. (2015) · 2015 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA) · doi:10.1109/apsipa.2015.7415532 · Cited by 213
Kaplan, A., Cao, H., FitzGerald, J. M., Iannotti, N., Yang, E., Kocks, J. W. H., Kostikas, K., Price, D., Reddel, H. K., Tsiligianni, I., et al. (2021) · The Journal of Allergy and Clinical Immunology: In Practice · doi:10.1016/j.jaip.2021.02.014 · Cited by 219
Swietojanski, P., & Renals, S. (2014) · 2014 IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2014.7078569 · Cited by 218
A Survey of Stochastic Computing Neural Networks for Machine Learning Applications
Liu, Y., Liu, S., Wang, Y., Lombardi, F., & Han, J. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3009047 · Cited by 212
“By using a fast greedy learning algorithm [10], a DBN can perform unsupervised learning and solve problems such as object recognition [11], speech recognition [12] and the recognition of handwritten characters.”
Wang, L., Scott, K. A., Xu, L., & Clausi, D. A. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2543660 · Cited by 217
Learning Human Motion Models for Long-Term Predictions
Ghosh, P., Song, J., Aksan, E., & Hilliges, O. (2017) · 2017 International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2017.00059 · Cited by 207
Optimal Approximation with Sparsely Connected Deep Neural Networks
Bölcskei, H., Grohs, P., Kutyniok, G., & Petersen, P. (2019) · SIAM Journal on Mathematics of Data Science · doi:10.1137/18m118709x · Cited by 216
Monitoring of Coral Reefs Using Artificial Intelligence: A Feasible and Cost-Effective Approach
González-Rivero, M., Beijbom, O., Rodriguez-Ramirez, A., Bryant, D. E. P., Ganase, A., Gonzalez-Marrero, Y., Herrera-Reveles, A., Kennedy, E. V., Kim, C. J. S., Lopez-Marcano, S., et al. (2020) · Remote Sensing · doi:10.3390/rs12030489 · Cited by 216
VFChain: Enabling Verifiable and Auditable Federated Learning via Blockchain Systems
Peng, Z., Xu, J., Chu, X., Gao, S., Yao, Y., Gu, R., & Tang, Y. (2022) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2021.3050781 · Cited by 217
Multi-task Neural Networks for QSAR Predictions
Dahl, G. E., Jaitly, N., & Salakhutdinov, R. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.1231 · Cited by 141
Self-citationSpectral Norm Regularization for Improving the Generalizability of Deep Learning
Yoshida, Y., & Miyato, T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.10941 · Cited by 205
Bat detective—Deep learning tools for bat acoustic signal detection
Mac Aodha, O., Gibb, R., Barlow, K. E., Browning, E., Firman, M., Freeman, R., Harder, B., Kinsey, L., Mead, G. R., Newson, S. E., et al. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005995 · Cited by 216
ExploreKit: Automatic Feature Generation and Selection
Katz, G., Shin, E. C. R., & Song, D. (2016) · 2016 IEEE 16th International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2016.0123 · Cited by 202
Review of the State of the Art of Deep Learning for Plant Diseases: A Broad Analysis and Discussion
Hasan, R. I., Yusuf, S. M., & Alzubaidi, L. (2020) · Plants · doi:10.3390/plants9101302 · Cited by 213
In-process Tool Wear Prediction System Based on Machine Learning Techniques and Force Analysis
Gouarir, A., Martínez-Arellano, G., Terrazas, G., Benardos, P., & Ratchev, S. (2018) · Procedia CIRP · doi:10.1016/j.procir.2018.08.253 · Cited by 211
Deep Over-sampling Framework for Classifying Imbalanced Data
Ando, S., & Huang, C. Y. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-71249-9_46 · Cited by 190
Streaming Automatic Speech Recognition with the Transformer Model
Moritz, N., Hori, T., & Le, J. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9054476 · Cited by 204
EEG-based prediction of driver's cognitive performance by deep convolutional neural network
Hajinoroozi, M., Mao, Z., Jung, T.-P., Lin, C.-T., & Huang, Y. (2016) · Signal Processing: Image Communication · doi:10.1016/j.image.2016.05.018 · Cited by 210
Radar HRRP target recognition with deep networks
Feng, B., Chen, B., & Liu, H. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.08.012 · Cited by 208
A Deep Learning Model for Estimating Story Points
Choetkiertikul, M., Dam, H. K., Tran, T., Pham, T., Ghose, A., & Menzies, T. (2019) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2792473 · Cited by 211
A deep-network solution towards model-less obstacle avoidance
Tai, L., Li, S., & Liu, M. (2016) · 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759428 · Cited by 207
Gong, M., Zhan, T., Zhang, P., & Miao, Q. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2650198 · Cited by 212
Li, J., Yao, X., Wang, X., Yu, Q., & Zhang, Y. (2020) · Measurement · doi:10.1016/j.measurement.2019.107419 · Cited by 211
Software defect prediction using stacked denoising autoencoders and two-stage ensemble learning
Tong, H., Liu, B., & Wang, S. (2018) · Information and Software Technology · doi:10.1016/j.infsof.2017.11.008 · Cited by 211
Recurrent Neural Network for Predicting Transcription Factor Binding Sites
Shen, Z., Bao, W., & Huang, D.-S. (2018) · Scientific Reports · doi:10.1038/s41598-018-33321-1 · Cited by 211
BottleNet: A Deep Learning Architecture for Intelligent Mobile Cloud Computing Services
Eshratifar, A. E., Esmaili, A., & Pedram, M. (2019) · 2019 IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED) · doi:10.1109/islped.2019.8824955 · Cited by 196
“1 INTRODUCTION Mobile and Internet of Things (IoT) devices are increasingly relying on deep neural networks (DNNs) to provide state-of-the-art performance in various intelligent applications [1–5].”
BackgroundHusein, M., & Chung, I.-Y. (2019) · Energies · doi:10.3390/en12101856 · Cited by 208
“It has outperformed other machine learning techniques in image recognition [49,50], speech recognition [51,52], natural language understanding [53], language translation [54,55], particle accelerator data analysis [56], potential drug molecule activity prediction [57], and brain circuit reconstruction [58].”
BackgroundNeural networks and deep learning
Yang, X.-S. (2019) · Introduction to Algorithms for Data Mining and Machine Learning · doi:10.1016/b978-0-12-817216-2.00015-6 · Cited by 208
Addressing Failure Prediction by Learning Model Confidence
Corbière, C., Thome, N., Bar-Hen, A., Cord, M., & Pérez, P. (2019) · arXiv · doi:10.48550/arxiv.1910.04851 · Cited by 211
Dupoux, E. (2018) · Cognition · doi:10.1016/j.cognition.2017.11.008 · Cited by 208
Deep Neural Networks for High Dimension, Low Sample Size Data
Liu, B., Wei, Y., Zhang, Y., & Yang, Q. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/318 · Cited by 197
A survey of quaternion neural networks
Parcollet, T., Morchid, M., & Linarès, G. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-019-09752-1 · Cited by 209
Privacy-Preserving Collaborative Deep Learning With Unreliable Participants
Zhao, L., Wang, Q., Zou, Q., Zhang, Y., & Chen, Y. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2939713 · Cited by 209
Deep Learning on Multi Sensor Data for Counter UAV Applications—A Systematic Review
Samaras, S., Diamantidou, E., Ataloglou, D., Sakellariou, N., Vafeiadis, A., Magoulianitis, V., Lalas, A., Dimou, A., Zarpalas, D., Votis, K., et al. (2019) · Sensors · doi:10.3390/s19224837 · Cited by 206
Metadata
- Authors
- Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., & Kingsbury, B.
- Affiliations
- University of Toronto (CA)
- University of Waterloo (CA)
- Microsoft (United States) (US)
- Google (United States) (US)
- IBM (United States) (US)
- Michigan State University (US)
- Venue
- IEEE Signal Processing Magazine
- Published
- 2012-11
- Volume
- 29
- Issue
- 6
- Pages
- 82-97
- ISSN
- 1053-5888 (ISSN-L)
- OpenAlex
- W2160815625
- Cited by
- 10,260
- References
- 71
- Citations by year
- 2026: 253 · 2025: 526 · 2024: 610 · 2023: 696 · 2022: 837 · 2021: 978 · 2020: 1232 · 2019: 1313 · 2018: 1220 · 2017: 967 · 2016: 712 · 2015: 498 · 2014: 276 · 2013: 128 · 2012: 9
- FWCI
- 284.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Signal Processing Magazine (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- deep neural network, acoustic modeling, speech recognition, hidden Markov models, Gaussian mixture model, feedforward neural networks, posterior probability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.