Deep Learning: Methods and Applications
Open accessThe DOI matches its Crossref record; 28 of the 168 references it cites were found in a registry or an index, and 140 are not checked yet.
Abstract
This monograph provides an overview of general deep learning methodology and its applications to a variety of signal and information processing tasks. The application areas are chosen with the following three criteria in mind: (1) expertise or knowledge of the authors; (2) the application areas that have already been transformed by the successful use of deep learning technology, such as speech recognition and computer vision; and (3) the application areas that have the potential to be impacted significantly by deep learning and that have been experiencing research growth, including natural language and text processing, information retrieval, and multimodal information processing empowered by multi-task deep learning.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Deep learning is successfully used as a tool for machine learning, where a neural network is capable of automatically learning features.”
From Medical image analysis using convolutional neural networks: a review (2018) · cites this paper as [47]
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Self-citationLearning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239 · cited 6×
“Since 2006, deep structured learning, or more commonly called deep learning or hierarchical learning, has emerged as a new area of machine learning research [20, 163].”
BackgroundMethodInfluentialLearning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542 · cited 1×
“, speech or text), but until recently they had not been widely used partly because they are difficult to train to capture long-term dependencies, giving rise to gradient vanishing or gradient explosion problems which were known in early 1990s [29, 167].”
BackgroundWolpert, D. H. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80023-1 · Cited by 7,951
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878 · cited 1×
“[347] developed the recursive neural tensor network, where each layer is constructed similarly to that of the neural tensor network described in [340] with an illustration shown in Figure 8.”
MethodCaruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636 · cited 1×
“The several architectures discussed so far in this chapter for multimodal processing and learning can be regarded as special cases of more general multi-task learning and transfer learning [22, 47].”
Background
Research works printed but not linked: 276
- Abdel-Hamid, 2013, Proceedings of Interspeech,
- Abdel-Hamid, 2013, Proceedings of Interspeech.
- Abdel-Hamid, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Acero, 2000, Proceedings of Interspeech
- Alain, 2013, Proceedings of International Conference on Learning Representations (ICLR).
- Arisoy, 2012, Proceedings of the Joint Human Language Technology Conference and the North American Chapter of the Association of Computational Linguistics (HLT-NAACL) Workshop.
- Aslan, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Ba, 2013, Proceedings of Neural Information Processing Systems (NIPS
- Baldi, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- E. Battenberg , E.Schmidt, and J.Bello. Deep learning for music, special session at International Conference on Acoustics Speech and Signal Processing (ICASSP) (http://www.icassp2014.org/ special_sections.html#ss8), 2014.
- Batternberg, 2012, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Bell, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Bengio, 2008, Scholarpedia,
- Bengio, 2012, Deep learning of representations for unsupervised and transfer learning, Journal of Machine Learning Research Workshop and Conference Proceedings, 27, 17
- Bengio, 2013, Statistical Language and Speech Processing,, 1
- Bengio, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Bengio, 2000, Proceedings of Neural Information Processing Systems (NIPS
- Bengio, 2003, A neural probabilistic language model, Journal of Machine Learning Research,, 3, 1137
- Bengio, 2006, Proceedings of Neural Information Processing Systems (NIPS
- Bengio, 2013, Proceedings of International Conference on Machine Learning (ICML), 2014.
- Bengio, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Bergstra, 2012, Random search for hyper-parameter optimization, Journal on Machine Learning Research,, 3, 281
- Bilmes, 2010, Dynamic graphical models, IEEE Signal Processing Magazine,, 33, 29
- Bordes, 2013, Machine Learning,
- Bordes, 2011, Proceedings of Association for the Advancement of Artificial Intelligence (AAAI).
- Bottou, 2013, From machine learning to machine reasoning: An essay, Journal of Machine Learning Research,, 14, 3207
- Bottou, 2004, Proceedings of Neural Information Processing Systems (NIPS
- Boulanger-Lewandowski, 2012, Proceedings of International Conference on Machine Learning (ICML).
- Boulanger-Lewandowski, 2013, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Bourlard, 1993, Connectionist Speech Recognition: A Hybrid Approach.
- Breiman, 1996, Stacked regression, Machine Learning,, 24, 49, 10.1023/a:1018046112532 · doi:10.1023/a:1018046112532 · Paper page
- Cardinal, 2013, Large vocabulary speech recognition on parallel architectures, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 2290, 10.1109/tasl.2013.2271591 · doi:10.1109/tasl.2013.2271591
- Chen, 2014, Proceedings of International Conference on Learning Representations.
- Chen, 2012, Proceedings of Interspeech.
- Chengalvarayan, 1997, IEEE Transactions on Speech and Audio Processing, 243
- Chengalvarayan, 1997, IEEE Transactions on Speech and Audio Processing,, 232
- Chengalvarayan, 1998, Speech trajectory discrimination using the minimum classification error learning, IEEE Transactions on Speech and Audio Processing,, 6, 505, 10.1109/89.725317 · doi:10.1109/89.725317
- Cho, 2009, Proceedings of Neural Information Processing Systems (NIPS, 342
- Ciresan, 2012, Proceedings of Neural Information Processing Systems (NIPS
- Ciresan, 2010, Neural Computation
- Ciresan, 2011, Proceedings of International Joint Conference on Neural Networks (IJCNN).
- Ciresan, 2012, Proceedings of Computer Vision and Pattern Recognition (CVPR).
- Ciresan, 2012, Proceedings of International Joint Conference on Neural Networks (IJCNN).
- Coates, 2013, Proceedings of International Conference on Machine Learning (ICML).
- Cohen, 2005, Proceedings of International Joint Conference on Artificial Intelligence (IJCAI),, 671
- Collobert, 2011, Proceedings of Artificial Intelligence and Statistics (AISTATS
- Collobert, 2008, Proceedings of International Conference on Machine Learning (ICML).
- Collobert, 2011, Natural language processing (almost) from scratch, Journal on Machine Learning Research,, 12, 2493
- Dahl, 2010, Phone recognition with the mean-covariance restricted boltzmann machine, Proceedings of Neural Information Processing Systems (NIPS, 23, 469
- Dahl, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dahl, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dahl, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dean, 2012, Proceedings of Neural Information Processing Systems (NIPS
- Demuynck, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Deng, 1993, IEEE Transactions on Speech and Audio Processing, 471
- Deng, 2003, Mathematical Foundations of Speech and Language Processing,, 115
- Deng, 2011, Proceedings of Asian-Pacific Signal & Information Processing Annual Summit and Conference (APSIPA-ASC).
- Deng, 2012, The MNIST database of handwritten digit images for machine learning research, IEEE Signal Processing Magazine,, 29
- Deng, 2013, Neural Information Processing Systems (NIPS) Workshop on Learning Output Representations.
- Deng, 2013, Asian-Pacific Signal & Information Processing Association Transactions on Signal and Information Processing.
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2001, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2014, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 1992, Structural design of a hidden Markov model based speech recognizer using multi-valued phonetic features: Comparison with segmental speech units, Journal of the Acoustical Society of America,, 92, 3058, 10.1121/1.404202 · doi:10.1121/1.404202
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2004, Challenges in adopting speech recognition, Communications of the Association for Computing Machinery (ACM),, 47, 11
- Deng, 2012, Proceedings of Interspeech.
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2003, Speech Processing — A Dynamic and Optimization-Oriented Approach
- Deng, 1996, Transitional speech units and their representation by regressive Markov states: Applications to speech recognition, IEEE Transactions on speech and audio processing,, 4, 301, 10.1109/89.506934 · doi:10.1109/89.506934
- Deng, 2010, Proceedings of Interspeech.
- Deng, 2012, Proceedings of IEEE Workshop on Spoken Language Technologies
- Deng, 2002, Distributed speech processing in mipad’s multimodal user interface, IEEE Transactions on Speech and Audio Processing,, 10, 605, 10.1109/tsa.2002.804538 · doi:10.1109/tsa.2002.804538
- Deng, 2005, Dynamic compensation of HMM variances using the feature enhancement uncertainty computed from a parametric model of speech distortion, IEEE Transactions on Speech and Audio Processing,, 13, 412, 10.1109/tsa.2005.845814 · doi:10.1109/tsa.2005.845814
- Deng, 2007, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2011, Proceedings of Interspeech.
- Deng, 2009, Neural Information Processing Systems (NIPS) Workshop
- Deng, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deselaers, 2009, Proceedings of 4th Workshop on Statistical Machine Translation,, 233
- Dognin, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Erhan, Journal on Machine Learning Research,, 201
- Fernandez, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 6885
- Fine, 1998, Machine Learning, 41
- Frome, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Fu, 2007, Proceedings of Interspeech
- Gales, 2011, Robust Speech Recognition of Uncertain or Missing Data: Theory and Application, 101, 10.1007/978-3-642-21317-5_5 · doi:10.1007/978-3-642-21317-5_5
- Gao, 2010, Proceedings of Conference on Information and Knowledge Management (CIKM).
- Gao, 2013, Proceedings of Neural Information Processing Systems (NIPS) Workshop on Deep Learning
- Gao, 2014, Proceedings of Association for Computational Linguistics (ACL).
- Gao, 2011, Proceedings of Special Interest Group on Information Retrieval (SIGIR).
- Gens, 2012, Neural Information Processing Systems (NIPS),
- Gibson, 2010, Error approximation and minimum phone error acoustic model estimation, IEEE Transactions on Audio, Speech, and Language Processing,, 18, 1269, 10.1109/tasl.2009.2032607 · DOI
- Glorot, 2010, Proceedings of Artificial Intelligence and Statistics (AISTATS).
- Glorot, 2011, Proceedings of Artificial Intelligence and Statistics (AIS-TATS
- Goodfellow, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Graves, 2012, Representation Learning Workshop, International Conference on Machine Learning (ICML),
- Graves, 2006, Proceedings of International Conference on Machine Learning (ICML).
- Graves, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Graves, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Grezl, 2008, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Gutmann, 2012, Noise-contrastive estimation of unnormalized statistical models, with applications to natural image statistics, Journal of Machine Learning Research,, 13, 307
- Hain, 2012, IEEE Transactions on Audio, Speech, and Language Processing,, 486
- Hamel, 2010, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Hawkins, 2004, On Intelligence: How a New Understanding of the Brain will lead to the Creation of Truly Intelligent Machines
- He, 2011, IEEE Signal Processing Magazine,
- He, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- He, 2013, Proceedings of the IEEE.
- Heigold, 2013, Investigations on an EM-style optimization algorithm for discriminative training of HMMs, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 2616, 10.1109/tasl.2013.2280234 · doi:10.1109/tasl.2013.2280234
- Heigold, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Heintz, 2009, Discriminative input stream combination for conditional random field phone recognition, IEEE Transactions on Audio, Speech, and Language Processing,, 17, 1533, 10.1109/tasl.2009.2022204 · doi:10.1109/tasl.2009.2022204
- Henderson, 2013, Proceedings of Special Interest Group on Disclosure and Dialogue (SIGDIAL).
- Hermans, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Hermansky, 2000, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Hinton, 1990, Artificial Intelligence,, 1
- Hinton, 2003, Canadian Psychology,, 10
- Hinton, 2011, A better way to learn features, Communications of the Association for Computing Machinery (ACM),, 54
- Hinton, 2006, Neural Computation,, 1527
- Hinton, 2010, Topics in Cognitive Science,, 1
- Huang, 2012, Proceedings of Association for Computational Linguistics (ACL).
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Association for Computing Machinery (ACM) International Conference Information and Knowledge Management (CIKM),
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2001, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Proceedings of Interspeech,, 2360
- Humphrey, 2012, Proceedings of International Conference on Machine Learning and Application (ICMLA).
- Humphrey, 2012, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Humphrey, 2013, Journal of Intelligent Information Systems,
- Hutchinson, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Hutchinson, 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence,, 1944
- Imseng, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Jaitly, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Jaitly, 2012, Proceedings of Interspeech.
- Jarrett, 2009, Proceedings of International Conference on Computer Vision,, 2146
- Kahou, 2013, Proceedings of International Conference on Multimodal Interaction (ICMI).
- Kang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 8012
- Kashiwagi, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Kavukcuoglu, 2010, Proceedings of Neural Information Processing Systems (NIPS
- Ketabdar, 2010, IEEE Transactions on Audio, Speech, and Language Processing,, 1094
- Kingsbury, 2009, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Kingsbury, 2012, Proceedings of Interspeech.
- Kiros, 2013, Proceedings of Neural Information Processing Systems (NIPS) Deep Learning Workshop.
- Ko, 2013, IEEE Transactions on Audio, Speech, and Language Processing, 1285
- Krizhevsky, 2012, Proceedings of Neural Information Processing Systems (NIPS).
- Kubo, 2012, Proceedings of Interspeech.
- Kurzweil, 2012, How to Create a Mind.
- Lal, 2013, IEEE Transactions on Audio, Speech, and Language Processing,, 2506
- Larochelle, 2008, Proceedings of International Conference on Machine Learning (ICML).
- Le, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Le, 2010, Proceedings of Empirical Methods in Natural Language Processing (EMNLP, 778
- Le, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Le, 2013, IEEE Transactions on Audio, Speech, and Language Processing, 197
- Le, 2011, Proceedings of International Conference on Machine Learning (ICML).
- Le, 2012, Proceedings of International Conference on Machine Learning (ICML).
- LeCun, 2012, Proceedings of European Conference on Computer Vision (ECCV).
- LeCun, 1995, The Handbook of Brain Theory and Neural Networks,, 255
- LeCun, 1998, Proceedings of the IEEE,, 2278
- LeCun, 2007, Proceedings of International Conference on Document Analysis and Recognition (ICDAR).
- Lee, 2004, Proceedings of International Conference on Spoken Language Processing (ICSLP),, 109
- Lee, 2009, Proceedings of International Conference on Machine Learning (ICML).
- Lee, 2011, Communications of the Association for Computing Machinery (ACM),, 95
- Lee, 2010, Proceedings of Neural Information Processing Systems (NIPS
- Lena, 2012, Proceedings of Neural Information Processing Systems (NIPS).
- Li, 2014, IEEE/Association for Computing Machinery (ACM) Transactions on Audio, Speech, and Language Processing, 1
- Li, 2012, Proceedings of IEEE Spoken Language Technology (SLT
- Li, 2013, Proceedings Conference on Affective Computing and Intelligent Interaction (ACII),, 312
- Liao, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Liao, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Lin, 2009, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Lin, 2011, Proceedings of Computer Vision and Pattern Recognition (CVPR
- Ling, 2013, Modeling spectral envelopes using restricted boltzmann machines for statistical parametric speech synthesis, International Conference on Acoustics Speech and Signal Processing (ICASSP),, 7825
- Ling, 2013, Articulatory control of HMM-based parametric speech synthesis using feature-space-switched multiple regression
- Lu, 2013, Joint uncertainty decoding for noise robust subspace gaussian mixture models, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 1791, 10.1109/tasl.2013.2248718 · doi:10.1109/tasl.2013.2248718
- Ma, 2000, Computer, Speech and Language
- Maas, 2013, Rectifier nonlinearities improve neural network acoustic models
- Manning, 2009, Introduction to Information Retrieval.
- J.Markoff, 2012, Scientists see promise in deep-learning programs
- Martens, 2010, Deep learning with hessian-free optimization
- Martens, 2011, Learning recurrent neural networks with hessian-free optimization
- McGraw, 2013, Learning lexicons from speech using a pronunciation mixture model, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 357, 10.1109/tasl.2012.2226158 · DOI
- Mikolov, 2013, Efficient estimation of word representations in vector space
- Mikolov, 2010, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 1045
- Mikolov, 2013, Distributed representations of words and phrases and their compositionality
- Minami, 2002, A recognition method with parametric trajectory synthesized using direct relations between static and dynamic feature vector time series, 957
- Mnih, 2008, A scalable hierarchical distributed language model, 1081
- Mnih, 2013, Learning word embeddings efficiently with noise-contrastive estimation
- Mnih, 2013, laying arari with deep reinforcement learning
- Mohamed, 2009, Deep belief networks for phone recognition
- Morin, 2005, Hierarchical probabilistic neural network language models
- Murphy, 2012, Machine Learning
- Nair, 2009, 3-d object recognition with deep belief nets
- Ngiam, 2011, Learning deep energy models
- Ngiam, 2011, Multimodal deep learning
- Olshausen, 2012, Can ‘deep learning’ offer deep insights about visual representation?
- Ostendorf, 1999, Moving beyond the ‘beads-on-a-string’ model of speech
- Oudre, 2011, Probabilistic template-based chord recognition, IEEE Transactions on Audio, Speech, and Language Processing, 19, 2249, 10.1109/tasl.2010.2098870 · doi:10.1109/tasl.2010.2098870
- Palangi, 2013, Learning input and recurrent weight matrices in echo state networks
- Palangi, 2013, Using deep stacking network to improve structured compressive sensing with multiple measurement vectors
- Pascanu, 2014, How to construct deep recurrent neural networks
200 of 276 shown
Cited by
Items 901–1,000 of 1,005
Yim, D., Malefyt, T. D. W., & Khuntia, J. (2021) · Electronic Markets · doi:10.1007/s12525-021-00472-5 · Cited by 38
Boosting Compiler Testing via Compiler Optimization Exploration
Chen, J., & Suo, C. (2022) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3508362 · Cited by 40
“Deep learning is recognized as an effective method that can automatically identify relevant features, even more complex features, in many domains [30, 37, 46].”
MethodJiao, M., Wan, G., Guo, Y., Wang, D., Liu, H., Xiang, J., & Liu, F. (2022) · Frontiers in Neuroscience · doi:10.3389/fnins.2022.867466 · Cited by 39
“…has achieved great success in the fields of computer vision (Voulodimos et al., 2018), natural language processing (Young et al., 2018), bioinformatics (Min et al., 2017), etc., by employing its end-to-end feature extraction and representation capability (Deng and Yu, 2014; LeCun et al., 2015).”
BackgroundA social hybrid recommendation system using LSTM and CNN
Daneshvar, H., & Ravanmehr, R. (2022) · Concurrency and Computation Practice and Experience · doi:10.1002/cpe.7015 · Cited by 41
Li, Y., Xue, J., Wang, K., Zhang, M., & Li, Z. (2022) · Foods · doi:10.3390/foods11182915 · Cited by 41
Chu, X., Chang, W., Pandey, S., Luo, J., Weigand, B., & Laurien, E. (2018) · International Journal of Heat and Mass Transfer · doi:10.1016/j.ijheatmasstransfer.2018.02.115 · Cited by 37
Dynamic behavior analysis of android applications for malware detection
Singh, L., & Hofmann, M. (2017) · International Conference on Intelligent Communication and Computational Techniques (ICCT) · doi:10.1109/intelcct.2017.8324010 · Cited by 42
“(Deng & Yu, 2014).”
Learning Control for Air Conditioning Systems via Human Expressions
Wei, Q., Li, T., & Liu, D. (2020) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2020.3001849 · Cited by 37
“DL is a class of machine learning techniques for supervised or unsupervised feature extraction and for pattern analysis and classification [20].”
MethodFor Better or Worse? Revenue Forecasting with Machine Learning Approaches
Chung, I. H., Williams, D. W., & Rok, M. (2022) · Public Performance & Management Review · doi:10.1080/15309576.2022.2073551 · Cited by 47
“ML methods are emerging as alternatives in time-series forecasting (Hamzac¸ebi et al., 2009; Deng & Yu, 2014; G. Zhang et al., 1998).”
Wearable Sensors for Physiological Condition and Activity Monitoring
Srikrishnarka, P., Haapasalo, J. A., Hinestroza, J. P., Sun, Z., & Nonappa, N. (2024) · Small Science · doi:10.1002/smsc.202300358 · Cited by 38
Aydın, Y., Çakıroğlu, C., Bekdaş, G., & Geem, Z. W. (2024) · Biomimetics · doi:10.3390/biomimetics9090544 · Cited by 36
“Deep-learning methods include feed-forward neural networks or multilayer perceptrons with many hidden layers [33].”
MethodBetter software analytics via “DUO”: Data mining algorithms using/used-by optimizers
Agrawal, A., Menzies, T., Minku, L. L., Wagner, M., & Yu, Z. (2020) · Empirical Software Engineering · doi:10.1007/s10664-020-09808-9 · Cited by 40
Junior, W. L. R., Borges, F. A. S., Rabêlo, R. A. L., de Lima, B. V. A., & de Alencar, J. E. A. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852287 · Cited by 36
“Recently, the study of Deep Learning applications has impacted a wide field range of computational intelligence issues related to the information, image, and signal processing field [11].”
BackgroundMachine Learning for the Semantic Web: Lessons learnt and next research directions
d’Amato, C. (2020) · Semantic Web · doi:10.3233/sw-200388 · Cited by 46
Artificial intelligence and computer simulation models in critical illness
Lal, A., Pinevich, Y., Gajic, O., Herasevich, V., & Pickering, B. (2020) · World Journal of Critical Care Medicine · doi:10.5492/wjccm.v9.i2.13 · Cited by 35
IoT-Based Diseases Prediction and Diagnosis System for Healthcare
Vanani, I. R., & Amirhosseini, M. (2020) · Studies in big data · doi:10.1007/978-981-15-4112-4_2 · Cited by 41
Chung, J., Lee, Y., Jang, W., Lee, S., & Kim, S. (2020) · Remote Sensing · doi:10.3390/rs12193231 · Cited by 36
“Among them, deep learning is a special part of machine learning algorithms based on a multilayer neural network (MLP-NN) with multiple layers of nonlinear information [19], and it has strengths in dealing with noise, missing data, and outliers [20].”
BackgroundNie, P., Qu, F., Lin, L., He, Y., Feng, X., Yang, L., Gao, H., Zhao, L., & Huang, L. (2021) · International Journal of Molecular Sciences · doi:10.3390/ijms22073425 · Cited by 36
“The advantages of deep learning have motivated us to use this approach to classify and identify multiple pesticide residues on leaves [21].”
BackgroundShip Target Detection Algorithm Based on Improved YOLOv3 for Maritime Image
Chen, D., Sun, S., Lei, Z., Shao, H., & Wang, Y. (2021) · Journal of Advanced Transportation · doi:10.1155/2021/9440212 · Cited by 36
“In recent years, with the rapid development of computer vision, deep learning algorithms have achieved good results in the field of target detection and image processing [11].”
BackgroundRetractedAl-wajih, E., & Ghazali, R. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.110079 · Cited by 37
Utilizing Deep Learning Models and Transfer Learning for COVID-19 Detection from X-Ray Images
Agrawal, S., Honnakasturi, V. B., Nara, M., & Patil, N. (2023) · SN Computer Science · doi:10.1007/s42979-022-01655-3 · Cited by 36
“It models complex relationships to learn multiple levels of representations among data [13].”
BackgroundYuan, Y., Shi, Y. Y., Su, X., Zou, X., Luo, Q., Feng, D. D., Cai, W., & Han, Z. (2018) · BMC Genomics · doi:10.1186/s12864-018-4919-z · Cited by 37
Stochastic Gradient Made Stable: A Manifold Propagation Approach for Large-Scale Optimization
Mu, Y., Liu, W., Liu, X., & Fan, W. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2016.2604302 · Cited by 36
“since it is out of the main scope. However, we will explore the distributed variants of the proposed S3GD like [19] in the future. Moreover, extension to non-convex formulations such as deep networks [7] is also a meaningful future direction. 0.0474 0.0518 0.0591 0.0768 m=20 m=50 m=100 m=200 MED11 0.0115 0.0116 0.012…”
BackgroundInfluentialAron, C., Sgarbossa, F., Ballot, É., & Ivanov, D. (2023) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-023-02262-6 · Cited by 42
Abbas, S., Asif, M. W., Rehman, A., Alharbi, M., Khan, M. A., & Elmitwally, N. S. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e36743 · Cited by 40
RetractedThe Potential of the Intel (R) Xeon Phi for Supervised Deep Learning
Viebke, A., & Pllana, S. (2015) · IEEE International Conference on High Performance Computing and Communications; IEEE International Conference on Smart City; IEEE International Conference on Data Science and Systems (HPCC/SmartCity/DSS) · doi:10.1109/hpcc-css-icess.2015.45 · Cited by 41
“Training of CNNs is supervised, using large datasets of labelled data [5].”
BackgroundMethodInfluentialLearning Sparse Representation for Objective Image Retargeting Quality Assessment
Jiang, Q., Shao, F., Lin, W., & Jiang, G. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2690452 · Cited by 35
“Deep learning [53], known as a powerful hierarchical feature representation tool for image classification and object recognition, may provide a new insight for the LGS and GCI representation.”
BackgroundBaltatzis, V., Bintsi, K.-M., Apostolidis, G. K., & Hadjileontiadis, L. J. (2017) · Scientific Reports · doi:10.1038/s41598-017-17562-0 · Cited by 32
Deep Learning for Epileptic Spike Detection
Xuyen, L. T., Thanh, L. T., Viet, D. V., Long, T. Q., Trung, N. L., & Thuận, N. Đ. (2018) · VNU Journal of Science Computer Science and Communication Engineering · doi:10.25073/2588-1086/vnucsce.156 · Cited by 41
“At the same time, deep learning could be categorized into different classes based on kinds of factors such as architectures, purposes and learning types [9].”
BackgroundOverview of currency recognition using deep learning
Zhang, Q., Yan, W. Q., & Kankanhalli, M. (2019) · Journal of Banking and Financial Technology · doi:10.1007/s42786-018-00007-1 · Cited by 42
“In artificial neural networks (ANN), supervised learning (SL) and unsupervised learning (UL) are associated closely with each other [12].”
BackgroundDeep Top-$k$ Ranking for Image–Sentence Matching
Zhang, L., Luo, M., Liu, J., Chang, X., Yang, Y., & Hauptmann, A. G. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2931352 · Cited by 35
“In this paper, our embedding functions are designed with deep networks, where the 16-layers VGG convolutional network (VGG16) [38] and multi-layer perceptrons (MLP) [39] are utilized as image and text networks respectively.”
MethodRoll Motion Prediction of Unmanned Surface Vehicle Based on Coupled CNN and LSTM
Zhang, W., Wu, P., Peng, Y., & Liu, D. (2019) · Future Internet · doi:10.3390/fi11110243 · Cited by 39
“Neural networks are a simulation of the biological nervous system [21].”
BackgroundNikiforos, S., Tzanavaris, S., & Kermanidis, K. L. (2020) · Journal of Computers in Education · doi:10.1007/s40692-020-00166-5 · Cited by 35
Conceptualisation of Cyberattack prediction with deep learning
Ibor, A. E., Oladeji, F. A., Okunoye, O. B., & Ekabua, O. O. (2020) · Cybersecurity · doi:10.1186/s42400-020-00053-7 · Cited by 38
Su, T., László, I., Li, Z., Wei, J., & Kalluri, S. N. V. (2020) · Remote Sensing of Environment · doi:10.1016/j.rse.2020.112093 · Cited by 36
“The multi-layer artificial neural network, a primitive deep learning technique, has been widely employed (Cireşan et al., 2012; Liu et al., 2017; Seide et al., 2011; Haykin, 2009) for a variety of environmental and geographical studies (e.g., Deng and Yu, 2014; Ma et al., 2020; Tong et al., 2019).”
MethodArtificial Intelligence (AI) and Retinal Optical Coherence Tomography (OCT)
Dahrouj, M., & Miller, J. B. (2021) · Seminars in Ophthalmology · doi:10.1080/08820538.2021.1901123 · Cited by 41
“DL uses many levels of non-linear information processing and abstraction for feature learning and representation, classification and pattern recognition.(10) Examples of deep learning tasks include image analysis, language proces-”
BackgroundData‐driven polyline simplification using a stacked autoencoder‐based deep neural network
Yu, W., & Chen, Y.-J. (2022) · Transactions in GIS · doi:10.1111/tgis.12965 · Cited by 37
“The proposed model is based on the stacked autoencoder structure (SAE), which is the accumulation of the general autoencoder (AE) (Deng & Yu, 2014; Goodfellow et al., 2016 ).”
MethodScientometric Analysis of Artificial Intelligence (AI) for Geohazard Research
Jiang, S., Ma, J., Liu, Z., & Guo, H. (2022) · Sensors · doi:10.3390/s22207814 · Cited by 37
“DL, a major branch of ML, is an algorithm for learning representations of information based on ANNs [45].”
MethodJamil, M. R. M., Hasyim, A. T. M., Othman, M. S., Muqsith, A., Noh, N. M., (IPGM), I. P. G. M., & Kamal, M. F. M. (2023) · Journal of Technical Education and Training · doi:10.30880/jtet.2023.15.02.001 · Cited by 50
Improving deep learning performance with missing values via deletion and compensation
Sánchez-Morales, A., Sancho‐Gómez, J., Martínez-García, J.-A., & Figueiras-Vidal, A. R. (2019) · Neural Computing and Applications · doi:10.1007/s00521-019-04013-2 · Cited by 37
“By learning multiple levels of representations that depict different levels of abstraction of the data, deep learning algorithms learn a hierarchy of concepts [22, 23].”
BackgroundPayan, M., Asadi, P., Jamaldar, A., Salimi, M., Ranjbar, P. Z., Armaghani, D. J., He, X., & Sheng, D. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.111095 · Cited by 35
“KNN is a non-parametric supervised learning algorithm that predicts a data point based on the characteristics of its nearest neighbors in the feature space, making it beneficial for intricate or non-linear relationships (Cover and Hart, 1967; Deng and Yu, 2014; Ansary and Ansary, 2023).”
Oil Rig Recognition Using Convolutional Neural Network on Sentinel-1 SAR Images
Falqueto, L. E., de Sá, J. A. S., Paes, R. L., & Pássaro, A. (2019) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2019.2894845 · Cited by 34
“Advances in computer technology and artificial intelligence techniques [2] have shed new perspectives on synthetic aperture radar (SAR) feature extraction and SAR target recognition [3].”
BackgroundReal-Time Epileptic Seizure Detection During Sleep Using Passive Infrared Sensors
Hanosh, O., Ansari, R., Younis, K. S., & Çetin, A. E. (2019) · IEEE Sensors Journal · doi:10.1109/jsen.2019.2907664 · Cited by 34
“Deep learning techniques are modeled to mimic the human brain ability to make an accurate decision for different complex problems [30].”
BackgroundMethodOnline Self-Learning Fuzzy Discrete Event Systems
Ying, H., & Lin, F. (2019) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2019.2931254 · Cited by 34
A New Activation Function for Deep Neural Network
Sharma, O. (2019) · International Conference on Machine Learning, Big Data, Cloud and Parallel Computing (COM-IT-CON) · doi:10.1109/comitcon.2019.8862253 · Cited by 34
“Deep learning is functionally dependent on the following technical aspects [1-3].”
BackgroundDeep Learning for Classifying of White Blood Cancer
Ding, Y., Yang, Y., & Cui, Y. (2019) · Lecture notes in bioengineering · doi:10.1007/978-981-15-0798-4_4 · Cited by 34
ImagePairs: Realistic Super Resolution Dataset via Beam Splitter Camera Rig
Joze, H. R. V., Zharkov, I., Powell, K. D., Ringler, C., Liang, L., Roulston, A., Lutz, M., & Pradeep, V. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00267 · Cited by 51
“Because of the nature of deep the learning networks, being a multi-layered feature extraction cascade [14], more data is required in order to train these complex methods [50].”
BackgroundImage-processing based taxonomy analysis of bacterial macromorphology using machine-learning models
Sajedi, H., Mohammadipanah, F., & Pashaei, A. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09284-9 · Cited by 34
“To prevent over fitting, several techniques are proved to be effective, including data augmentation [9, 10], dropout, and regularization [5].”
MethodUncertainty analysis in well log classification by Bayesian long short-term memory networks
Feng, R. (2021) · Journal of Petroleum Science and Engineering · doi:10.1016/j.petrol.2021.108816 · Cited by 34
Rachmatullah, M. N., Nurmaini, S., Sapitri, A. I., Darmawahyuni, A., Tutuko, B., & Firdaus, F. (2021) · Bulletin of Electrical Engineering and Informatics · doi:10.11591/eei.v10i4.3060 · Cited by 34
“One of the ML algorithms, called deep learning (DL) algorithm, can work using less data [20]-[22].”
MethodArtificial intelligence‐based process control in chemical, biochemical, and biomedical engineering
Dutta, D., & Upreti, S. R. (2021) · The Canadian Journal of Chemical Engineering · doi:10.1002/cjce.24246 · Cited by 38
Boukdir, A., Benaddy, M., Ellahyani, A., Meslouhi, O. E., & Kardouchi, M. (2021) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-021-06167-5 · Cited by 34
Deep learning-based facial image analysis in medical research: a systematic review protocol
Su, Z., Liang, B., Shi, F., Gelfond, J., Šegalo, S., Wang, J., Jia, P., & Hao, X. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-047549 · Cited by 38
“9 Simply put, deep learning is a mechanism that allows computers to solve complex problems by neural network architecture.”
BackgroundHu, H., Shen, L., Guan, Q., Li, X., Zhou, Q., & Ruan, S. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108452 · Cited by 37
Impact and prospect of the fourth industrial revolution in food safety: Mini-review
Kim, S., & Kim, S. (2022) · Food Science and Biotechnology · doi:10.1007/s10068-022-01047-6 · Cited by 34
“Various types of powerful neural networks with characteristics of multiple hidden layers and back propagation were suggested after the adoption of deep learning (Deng and Yu, 2014).”
BackgroundAI-Enhanced Education: Teaching and Learning Reimagined
Meng, N., Dhimolea, T. K., & Ali, Z. (2022) · Educational communications and technology: issues and innovations · doi:10.1007/978-3-030-84729-6_7 · Cited by 43
Chowdhuri, I., Pal, S. C., Saha, A., Chakrabortty, R., & Roy, P. (2022) · Bulletin of Engineering Geology and the Environment · doi:10.1007/s10064-022-02761-5 · Cited by 34
“Deep learning algorithms are a subset of machine learning algorithms (MLAs) that use numerous layers of nonlinear information to model complicated data relationships, most frequently utilizing a multi-layer neural network (Deng and Yu 2014).”
BackgroundZhang, X., Chung, F.-L., & Wang, S. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2912625 · Cited by 36
“3) Since DBN-TSK-FC adopts the least learning machine (LLM) [14] and does not require very slow fine-tuning training which is certainly required after the unsupervised pretraining [24], [25], [27] of the existing DBN learning, it has a much faster training speed than the existing DBN learning.”
BackgroundMethodKalwar, J. H., & Bhatti, S. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2402.00920 · Cited by 63
“The hierarchical nature of deep neural networks allows them to automatically learn abstract features and representations, making them highly effective for tasks like image recognition, natural language processing, and speech recognition[12].”
BackgroundMachine Learning and Deep Learning
Möller, D. P. F. (2023) · Advances in information security · doi:10.1007/978-3-031-26845-8_8 · Cited by 36
A critical review of machine-learning for “multi-omics” marine metabolite datasets
Manochkumar, J., Cherukuri, A. K., Kumar, R. S., Almansour, A. I., Ramamoorthy, S., & Efferth, T. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107425 · Cited by 36
Das, P., Kashem, A. M., Islam, M., Ahmed, A., Haque, M. A., & Khan, M. (2024) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2024.136711 · Cited by 33
AI‐Powered Mining of Highly Customized and Superior ESIPT‐Based Fluorescent Probes
Huang, W., Huang, S., Fang, Y., Zhu, T., Chu, F., Liu, Q., Yu, K., Chen, F., Dong, J. N., & Zeng, W. (2024) · Advanced Science · doi:10.1002/advs.202405596 · Cited by 39
Du, J., Zhang, Y., Wang, P., Tansey, K. J., Liu, J., & Zhang, S. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3544434 · Cited by 33
“…convolutional neural networks (CNNs), recurrent neural networks (RNNs), long short-term memory (LSTM), gated recurrent unit (GRU), and transformer, which are commonly applied in diverse areas such as image and speech recognition, natural language processing, and agricultural applications [18].”
Deep Learning for Image Reconstruction in Electrical Tomography: A Review
Li, Y., Zhu, Q., & Liu, Z. (2025) · IEEE Sensors Journal · doi:10.1109/jsen.2025.3554696 · Cited by 37
“Deep learning is a machine learning method based on artificial neural networks [76].”
Deep BBN Learning for Health Assessment toward Decision-Making on Structures under Uncertainties
Pan, H. X., Gui, G., Lin, Z., & Yan, C. (2018) · KSCE Journal of Civil Engineering · doi:10.1007/s12205-018-1301-2 · Cited by 33
“…such as the SVM or conventional artificial neural network, uses one or zero hidden layer for a shallow linear pattern separation, while the deep learning algorithms are framed by a deep architecture using multiple hidden layers to extract more complex nonlinear representation (Deng and Yu, 2014).”
BackgroundMethodInfluentialBackground Knowledge Based Multi-Stream Neural Network for Text Classification
Ren, F., & Deng, J. (2018) · Applied Sciences · doi:10.3390/app8122472 · Cited by 36
“As a branch of machine learning, deep learning has been widely researched and applied in NLP (Natural Language Processing) [13,14] after the presentation of word2vec model [15,16].”
BackgroundDigital Staining of High-Definition Fourier Transform Infrared (FT-IR) Images Using Deep Learning
Lotfollahi, M., Berisha, S., Daeinejad, D., & Mayerich, D. M. (2019) · Applied Spectroscopy · doi:10.1177/0003702818819857 · Cited by 33
Hittawe, M. M., Afzal, S., Jamil, T., Snoussi, H., Hoteit, I., & Knio, O. (2019) · Journal of Electronic Imaging · doi:10.1117/1.jei.28.2.021012 · Cited by 33
“Deep learning has enabled significant and rapid progress in the fields of facial recognition, speech recognition, computer vision, and automated signal processing.(11)”
BackgroundLiu, H., Hussain, F., Shen, Y., Morales-Menéndez, R., Abubakar, M., Yawar, S. J., & Arain, H. J. (2019) · Electric Power Components and Systems · doi:10.1080/15325008.2019.1666178 · Cited by 34
“It was effectively used in different applications such as object recognition, speech recognition, natural language understanding [63 – 66 Comparison between SSA and WT [29].”
MethodSkeleton-Based Dynamic Hand Gesture Recognition Using an Enhanced Network with One-Shot Learning
Ma, C., Zhang, S., Wang, A., Qi, Y., & Chen, G. (2020) · Applied Sciences · doi:10.3390/app10113680 · Cited by 40
“The existing networks fail to complete the optimization of the model with small size training samples, while one-shot learning could infer results as expected [10].”
ResultDeep Melanoma classification with K-Fold Cross-Validation for Process optimization
Nie, Y., Santis, L. D., Carratù, M., O’Nils, M., Sommella, P., & Lundgren, J. (2020) · IEEE International Symposium on Medical Measurements and Applications (MeMeA) · doi:10.1109/memea49120.2020.9137222 · Cited by 37
“Deep learning is one technique from machine learning that utilizes many layers of nonlinear information processing to perform feature extraction, pattern recognition, and classification [19].”
MethodRecent Advances in Deep Learning Techniques and Its Applications: An Overview
Hazra, A., Choudhary, P., & Singh, M. S. (2020) · Lecture notes in bioengineering · doi:10.1007/978-981-15-6329-4_10 · Cited by 35
Predicting functions of maize proteins using graph convolutional network
Zhou, G., Wang, J., Zhang, X., Guo, M., & Yu, G. (2020) · BMC Bioinformatics · doi:10.1186/s12859-020-03745-6 · Cited by 33
Pham, H. T. T. L., Rafieizonooz, M., Han, S., & Lee, D. (2021) · Sustainability · doi:10.3390/su132413579 · Cited by 39
Ghasemi, E., Ebrahimi, M., & Ebrahimie, E. (2022) · Cognitive Neurodynamics · doi:10.1007/s11571-021-09746-2 · Cited by 33
“This continues until the outputs reach a high accuracy (Deng and Yu 2014).”
BackgroundRETRACTED ARTICLE: CNN deep learning-based image to vector depiction
Waheed, S. R., Rahim, M. S. M., Suaib, N. M., & Al-Shammari, A. A. S. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-14434-w · Cited by 33
“However, extensive research enabled the resolution of such mysteries [11, 12, 17, 21, 45].”
BackgroundRetractedExploiting CXL-based Memory for Distributed Deep Learning
Arif, M., Assogba, K., Rafique, M. M., & Vazhkudai, S. S. (2022) · Proceedings of the International Conference on Parallel Processing · doi:10.1145/3545008.3545054 · Cited by 48
“Modern enterprise, scientific, and high-performance computing (HPC) applications [14] are distributed, highly scalable, and consume huge amount of data during execution.”
BackgroundMultiscale Maize Tassel Identification Based on Improved RetinaNet Model and UAV Images
Wang, B., Yang, G., Yang, H. F., Gu, J., Xu, S., Zhao, D., & Xu, B. (2023) · Remote Sensing · doi:10.3390/rs15102530 · Cited by 33
Compression of network traffic parameters for detecting cyber attacks based on deep learning
Komar, M., Sachenko, A., Golovko, V. A., & Dorosh, V. (2018) · International Conference on Dependable Systems, Services and Technologies (DESSERT) · doi:10.1109/dessert.2018.8409096 · Cited by 35
Krinitskiy, M., Verezemskaya, P., Grashchenkov, K., Tilinina, N. D., Gulev, S., & Lazzara, M. A. (2018) · Atmosphere · doi:10.3390/atmos9110426 · Cited by 33
Chen, Z., Yang, C., & Fang, S. (2019) · IEEE Access · doi:10.1109/access.2019.2960771 · Cited by 36
“Experiences show that if these driving cycle data are simply treated as input data of both traditional machine learning method and deep learning algorithms, the results are usually unsatisfactory [30].”
BackgroundDeep neural network based environment sound classification and its implementation on hearing aid app
Fan, X., Sun, T., Chen, W., & Fan, Q. (2020) · Measurement · doi:10.1016/j.measurement.2020.107790 · Cited by 33
Ensemble sparse supervised model for bearing fault diagnosis in smart manufacturing
Zhang, F., Yan, J., Fu, P., Wang, J., & Gao, R. X. (2020) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2019.101920 · Cited by 33
DeepGOA: Predicting Gene Ontology Annotations of Proteins via Graph Convolutional Network
Zhou, G., Wang, J., Zhang, X., & Yu, G. (2019) · 2019 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm47256.2019.8983075 · Cited by 32
“In recent years, deep learning has significantly sparked the development of image recognition and speech recognition [20].”
BackgroundFarm-flow dataset: Intrusion detection in smart agriculture based on network flows
Ferreira, R., Bispo, I. A., Rabadao, C. M. D. S., Santos, L., & Costa, R. L. D. C. (2024) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2024.109892 · Cited by 36
Partial discharges at DC voltage - measurement and pattern recognition
Pirker, A., & Schichler, U. (2016) · International Conference on Condition Monitoring and Diagnosis (CMD) · doi:10.1109/cmd.2016.7757811 · Cited by 32
“The big database of measured PD sequences can be used to implement and feed powerful representation-learning algorithms that help to recognize the explanatory factors of correlations behind the data [8, 9].”
BackgroundTuning Deep Learning Performance for Android Malware Detection
Booz, J., McGiff, J., Hatcher, W. G., Yu, W., Nguyen, J. H., & Lu, C. (2018) · ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD) · doi:10.1109/snpd.2018.8441128 · Cited by 37
“Though many differing definitions have been given to describe deep learning, two common elements are: (i) the presence of multiple, non-linear, layers for data processing, and (ii) the notion of processing data at an increasingly higher level and abstract manner throughout the network [4].”
BackgroundGavrishchaka, V., Senyukova, O., & Koepke, M. E. (2019) · Advances in Physics X · doi:10.1080/23746149.2019.1582361 · Cited by 40
“However, the main advantage of DL, capable of alleviating many existed issues, comes from the structured approach to DNN training and hierarchical representation which can be outlined as follows [5,6].”
BackgroundInfluentialA robust deep learning model for missing value imputation in big NCDC dataset
Gad, I., Hosahalli, D., Manjunatha, B. R., & Ghoneim, O. A. (2020) · Iran Journal of Computer Science · doi:10.1007/s42044-020-00065-z · Cited by 35
“Deep learning models are considered as most important in the machine learning field for massive improvement in performance of weather and climate forecasting [11,13].”
BackgroundPersian speech recognition using deep learning
Veisi, H., & Mani, A. H. (2020) · International Journal of Speech Technology · doi:10.1007/s10772-020-09768-x · Cited by 35
Identification of maceral groups in Chinese bituminous coals based on semantic segmentation models
Wang, Y., Bai, X., Wu, L., Zhang, Y., & Qu, S. (2021) · Fuel · doi:10.1016/j.fuel.2021.121844 · Cited by 32
Chowdhuri, I., Pal, S. C., Janizadeh, S., Saha, A., Ahmadi, K., Chakrabortty, R., Islam, A. R. M. T., Roy, P., & Shit, M. (2022) · Geocarto International · doi:10.1080/10106049.2022.2068675 · Cited by 33
“Recent advances have paved way for DLAs that are characterised as a specific case MLAs which uses several layers of non-linear knowledge to model dynamic relationships between data (Deng and Yu 2014).”
BackgroundUnboxing the Black Box of Attention Mechanisms in Remote Sensing Big Data Using XAI
Zaryabi, E. H., Moradi, L., Kalantar, B., Ueda, N., & Halin, A. B. A. (2022) · Remote Sensing · doi:10.3390/rs14246254 · Cited by 39
AFnet and PAFnet: Fast and Accurate SAR Autofocus Based on Deep Learning
Liu, Z., Yang, S., Gao, Q., Feng, Z., Wang, M., & Jiao, L. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3217063 · Cited by 32
“See https://www.ieee.org/publications/rights/index.html for more information. made great breakthroughs in speech recognition [31], signal processing [32], [33], natural language processing [34], and magnetic resonance imaging [35].”
BackgroundDiabetic retinopathy detection by optimized deep learning model
Rachapudi, V., Rao, K. S., Rao, T. S. M., Dileep, P., & Roy, T. L. D. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-14606-8 · Cited by 36
“A deep learning (DL) model has emerged in various fields [14].”
BackgroundA general steganographic framework for neural network models
Yang, Z., Wang, Z., & Zhang, X. (2023) · Information Sciences · doi:10.1016/j.ins.2023.119250 · Cited by 32
Savaş, S. (2024) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-023-00941-7 · Cited by 33
Deep learning based parts of speech tagger for Bengali
Kabir, M. F., Abdullah-Al-Mamun, K., & Huda, M. N. (2016) · International Conference on Informatics, Electronics & Vision (ICIEV) · doi:10.1109/iciev.2016.7760098 · Cited by 35
“This paper is an investigation of Deep Learning [1] techniques applied for POS tagging of Bengali Language.”
MethodInfluentialHussain, K. F., Afifi, M., & Moussa, G. (2018) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2018.2838117 · Cited by 32
“Recently, deep learning is considered the state-of-the-art to solve many problems, such as speech recognition, document retrieval, and object recognition [33].”
Background
Metadata
- Authors
- Deng, L., & Yu, D.
- Affiliations
- Microsoft (United States) (US)
- Venue
- Foundations and Trends® in Signal Processing
- Publisher
- Emerald
- Published
- 2014-06-30
- Volume
- 7
- Issue
- 3-4
- Pages
- 197-387
- ISSN
- 1932-8346 (ISSN-L)
- 1932-8354
- OpenAlex
- W4205947740
- Cited by
- 3,480
- References
- 21
- Citations by year
- 2026: 113 · 2025: 206 · 2024: 298 · 2023: 410 · 2022: 469 · 2021: 453 · 2020: 404 · 2019: 426 · 2018: 304 · 2017: 188 · 2016: 146 · 2015: 57 · 2014: 3
- FWCI
- 117.48
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Foundations and Trends® in Signal Processing (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- deep learning, signal processing, information processing, speech recognition, computer vision, natural language processing, text processing, information retrieval, multimodal information processing, multi-task learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.