Deep Learning: Methods and Applications
Open accessThe DOI matches its Crossref record; 28 of the 168 references it cites were found in a registry or an index, and 140 are not checked yet.
Abstract
This monograph provides an overview of general deep learning methodology and its applications to a variety of signal and information processing tasks. The application areas are chosen with the following three criteria in mind: (1) expertise or knowledge of the authors; (2) the application areas that have already been transformed by the successful use of deep learning technology, such as speech recognition and computer vision; and (3) the application areas that have the potential to be impacted significantly by deep learning and that have been experiencing research growth, including natural language and text processing, information retrieval, and multimodal information processing empowered by multi-task deep learning.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Deep learning is successfully used as a tool for machine learning, where a neural network is capable of automatically learning features.”
From Medical image analysis using convolutional neural networks: a review (2018) · cites this paper as [47]
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Self-citationLearning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239 · cited 6×
“Since 2006, deep structured learning, or more commonly called deep learning or hierarchical learning, has emerged as a new area of machine learning research [20, 163].”
BackgroundMethodInfluentialLearning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542 · cited 1×
“, speech or text), but until recently they had not been widely used partly because they are difficult to train to capture long-term dependencies, giving rise to gradient vanishing or gradient explosion problems which were known in early 1990s [29, 167].”
BackgroundWolpert, D. H. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80023-1 · Cited by 7,951
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878 · cited 1×
“[347] developed the recursive neural tensor network, where each layer is constructed similarly to that of the neural tensor network described in [340] with an illustration shown in Figure 8.”
MethodCaruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636 · cited 1×
“The several architectures discussed so far in this chapter for multimodal processing and learning can be regarded as special cases of more general multi-task learning and transfer learning [22, 47].”
Background
Research works printed but not linked: 276
- Abdel-Hamid, 2013, Proceedings of Interspeech,
- Abdel-Hamid, 2013, Proceedings of Interspeech.
- Abdel-Hamid, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Acero, 2000, Proceedings of Interspeech
- Alain, 2013, Proceedings of International Conference on Learning Representations (ICLR).
- Arisoy, 2012, Proceedings of the Joint Human Language Technology Conference and the North American Chapter of the Association of Computational Linguistics (HLT-NAACL) Workshop.
- Aslan, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Ba, 2013, Proceedings of Neural Information Processing Systems (NIPS
- Baldi, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- E. Battenberg , E.Schmidt, and J.Bello. Deep learning for music, special session at International Conference on Acoustics Speech and Signal Processing (ICASSP) (http://www.icassp2014.org/ special_sections.html#ss8), 2014.
- Batternberg, 2012, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Bell, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Bengio, 2008, Scholarpedia,
- Bengio, 2012, Deep learning of representations for unsupervised and transfer learning, Journal of Machine Learning Research Workshop and Conference Proceedings, 27, 17
- Bengio, 2013, Statistical Language and Speech Processing,, 1
- Bengio, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Bengio, 2000, Proceedings of Neural Information Processing Systems (NIPS
- Bengio, 2003, A neural probabilistic language model, Journal of Machine Learning Research,, 3, 1137
- Bengio, 2006, Proceedings of Neural Information Processing Systems (NIPS
- Bengio, 2013, Proceedings of International Conference on Machine Learning (ICML), 2014.
- Bengio, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Bergstra, 2012, Random search for hyper-parameter optimization, Journal on Machine Learning Research,, 3, 281
- Bilmes, 2010, Dynamic graphical models, IEEE Signal Processing Magazine,, 33, 29
- Bordes, 2013, Machine Learning,
- Bordes, 2011, Proceedings of Association for the Advancement of Artificial Intelligence (AAAI).
- Bottou, 2013, From machine learning to machine reasoning: An essay, Journal of Machine Learning Research,, 14, 3207
- Bottou, 2004, Proceedings of Neural Information Processing Systems (NIPS
- Boulanger-Lewandowski, 2012, Proceedings of International Conference on Machine Learning (ICML).
- Boulanger-Lewandowski, 2013, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Bourlard, 1993, Connectionist Speech Recognition: A Hybrid Approach.
- Breiman, 1996, Stacked regression, Machine Learning,, 24, 49, 10.1023/a:1018046112532 · doi:10.1023/a:1018046112532 · Paper page
- Cardinal, 2013, Large vocabulary speech recognition on parallel architectures, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 2290, 10.1109/tasl.2013.2271591 · doi:10.1109/tasl.2013.2271591
- Chen, 2014, Proceedings of International Conference on Learning Representations.
- Chen, 2012, Proceedings of Interspeech.
- Chengalvarayan, 1997, IEEE Transactions on Speech and Audio Processing, 243
- Chengalvarayan, 1997, IEEE Transactions on Speech and Audio Processing,, 232
- Chengalvarayan, 1998, Speech trajectory discrimination using the minimum classification error learning, IEEE Transactions on Speech and Audio Processing,, 6, 505, 10.1109/89.725317 · doi:10.1109/89.725317
- Cho, 2009, Proceedings of Neural Information Processing Systems (NIPS, 342
- Ciresan, 2012, Proceedings of Neural Information Processing Systems (NIPS
- Ciresan, 2010, Neural Computation
- Ciresan, 2011, Proceedings of International Joint Conference on Neural Networks (IJCNN).
- Ciresan, 2012, Proceedings of Computer Vision and Pattern Recognition (CVPR).
- Ciresan, 2012, Proceedings of International Joint Conference on Neural Networks (IJCNN).
- Coates, 2013, Proceedings of International Conference on Machine Learning (ICML).
- Cohen, 2005, Proceedings of International Joint Conference on Artificial Intelligence (IJCAI),, 671
- Collobert, 2011, Proceedings of Artificial Intelligence and Statistics (AISTATS
- Collobert, 2008, Proceedings of International Conference on Machine Learning (ICML).
- Collobert, 2011, Natural language processing (almost) from scratch, Journal on Machine Learning Research,, 12, 2493
- Dahl, 2010, Phone recognition with the mean-covariance restricted boltzmann machine, Proceedings of Neural Information Processing Systems (NIPS, 23, 469
- Dahl, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dahl, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dahl, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dean, 2012, Proceedings of Neural Information Processing Systems (NIPS
- Demuynck, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Deng, 1993, IEEE Transactions on Speech and Audio Processing, 471
- Deng, 2003, Mathematical Foundations of Speech and Language Processing,, 115
- Deng, 2011, Proceedings of Asian-Pacific Signal & Information Processing Annual Summit and Conference (APSIPA-ASC).
- Deng, 2012, The MNIST database of handwritten digit images for machine learning research, IEEE Signal Processing Magazine,, 29
- Deng, 2013, Neural Information Processing Systems (NIPS) Workshop on Learning Output Representations.
- Deng, 2013, Asian-Pacific Signal & Information Processing Association Transactions on Signal and Information Processing.
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2001, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2014, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 1992, Structural design of a hidden Markov model based speech recognizer using multi-valued phonetic features: Comparison with segmental speech units, Journal of the Acoustical Society of America,, 92, 3058, 10.1121/1.404202 · doi:10.1121/1.404202
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2004, Challenges in adopting speech recognition, Communications of the Association for Computing Machinery (ACM),, 47, 11
- Deng, 2012, Proceedings of Interspeech.
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2003, Speech Processing — A Dynamic and Optimization-Oriented Approach
- Deng, 1996, Transitional speech units and their representation by regressive Markov states: Applications to speech recognition, IEEE Transactions on speech and audio processing,, 4, 301, 10.1109/89.506934 · doi:10.1109/89.506934
- Deng, 2010, Proceedings of Interspeech.
- Deng, 2012, Proceedings of IEEE Workshop on Spoken Language Technologies
- Deng, 2002, Distributed speech processing in mipad’s multimodal user interface, IEEE Transactions on Speech and Audio Processing,, 10, 605, 10.1109/tsa.2002.804538 · doi:10.1109/tsa.2002.804538
- Deng, 2005, Dynamic compensation of HMM variances using the feature enhancement uncertainty computed from a parametric model of speech distortion, IEEE Transactions on Speech and Audio Processing,, 13, 412, 10.1109/tsa.2005.845814 · doi:10.1109/tsa.2005.845814
- Deng, 2007, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2011, Proceedings of Interspeech.
- Deng, 2009, Neural Information Processing Systems (NIPS) Workshop
- Deng, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deselaers, 2009, Proceedings of 4th Workshop on Statistical Machine Translation,, 233
- Dognin, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Erhan, Journal on Machine Learning Research,, 201
- Fernandez, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 6885
- Fine, 1998, Machine Learning, 41
- Frome, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Fu, 2007, Proceedings of Interspeech
- Gales, 2011, Robust Speech Recognition of Uncertain or Missing Data: Theory and Application, 101, 10.1007/978-3-642-21317-5_5 · doi:10.1007/978-3-642-21317-5_5
- Gao, 2010, Proceedings of Conference on Information and Knowledge Management (CIKM).
- Gao, 2013, Proceedings of Neural Information Processing Systems (NIPS) Workshop on Deep Learning
- Gao, 2014, Proceedings of Association for Computational Linguistics (ACL).
- Gao, 2011, Proceedings of Special Interest Group on Information Retrieval (SIGIR).
- Gens, 2012, Neural Information Processing Systems (NIPS),
- Gibson, 2010, Error approximation and minimum phone error acoustic model estimation, IEEE Transactions on Audio, Speech, and Language Processing,, 18, 1269, 10.1109/tasl.2009.2032607 · DOI
- Glorot, 2010, Proceedings of Artificial Intelligence and Statistics (AISTATS).
- Glorot, 2011, Proceedings of Artificial Intelligence and Statistics (AIS-TATS
- Goodfellow, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Graves, 2012, Representation Learning Workshop, International Conference on Machine Learning (ICML),
- Graves, 2006, Proceedings of International Conference on Machine Learning (ICML).
- Graves, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Graves, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Grezl, 2008, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Gutmann, 2012, Noise-contrastive estimation of unnormalized statistical models, with applications to natural image statistics, Journal of Machine Learning Research,, 13, 307
- Hain, 2012, IEEE Transactions on Audio, Speech, and Language Processing,, 486
- Hamel, 2010, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Hawkins, 2004, On Intelligence: How a New Understanding of the Brain will lead to the Creation of Truly Intelligent Machines
- He, 2011, IEEE Signal Processing Magazine,
- He, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- He, 2013, Proceedings of the IEEE.
- Heigold, 2013, Investigations on an EM-style optimization algorithm for discriminative training of HMMs, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 2616, 10.1109/tasl.2013.2280234 · doi:10.1109/tasl.2013.2280234
- Heigold, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Heintz, 2009, Discriminative input stream combination for conditional random field phone recognition, IEEE Transactions on Audio, Speech, and Language Processing,, 17, 1533, 10.1109/tasl.2009.2022204 · doi:10.1109/tasl.2009.2022204
- Henderson, 2013, Proceedings of Special Interest Group on Disclosure and Dialogue (SIGDIAL).
- Hermans, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Hermansky, 2000, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Hinton, 1990, Artificial Intelligence,, 1
- Hinton, 2003, Canadian Psychology,, 10
- Hinton, 2011, A better way to learn features, Communications of the Association for Computing Machinery (ACM),, 54
- Hinton, 2006, Neural Computation,, 1527
- Hinton, 2010, Topics in Cognitive Science,, 1
- Huang, 2012, Proceedings of Association for Computational Linguistics (ACL).
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Association for Computing Machinery (ACM) International Conference Information and Knowledge Management (CIKM),
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2001, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Proceedings of Interspeech,, 2360
- Humphrey, 2012, Proceedings of International Conference on Machine Learning and Application (ICMLA).
- Humphrey, 2012, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Humphrey, 2013, Journal of Intelligent Information Systems,
- Hutchinson, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Hutchinson, 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence,, 1944
- Imseng, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Jaitly, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Jaitly, 2012, Proceedings of Interspeech.
- Jarrett, 2009, Proceedings of International Conference on Computer Vision,, 2146
- Kahou, 2013, Proceedings of International Conference on Multimodal Interaction (ICMI).
- Kang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 8012
- Kashiwagi, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Kavukcuoglu, 2010, Proceedings of Neural Information Processing Systems (NIPS
- Ketabdar, 2010, IEEE Transactions on Audio, Speech, and Language Processing,, 1094
- Kingsbury, 2009, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Kingsbury, 2012, Proceedings of Interspeech.
- Kiros, 2013, Proceedings of Neural Information Processing Systems (NIPS) Deep Learning Workshop.
- Ko, 2013, IEEE Transactions on Audio, Speech, and Language Processing, 1285
- Krizhevsky, 2012, Proceedings of Neural Information Processing Systems (NIPS).
- Kubo, 2012, Proceedings of Interspeech.
- Kurzweil, 2012, How to Create a Mind.
- Lal, 2013, IEEE Transactions on Audio, Speech, and Language Processing,, 2506
- Larochelle, 2008, Proceedings of International Conference on Machine Learning (ICML).
- Le, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Le, 2010, Proceedings of Empirical Methods in Natural Language Processing (EMNLP, 778
- Le, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Le, 2013, IEEE Transactions on Audio, Speech, and Language Processing, 197
- Le, 2011, Proceedings of International Conference on Machine Learning (ICML).
- Le, 2012, Proceedings of International Conference on Machine Learning (ICML).
- LeCun, 2012, Proceedings of European Conference on Computer Vision (ECCV).
- LeCun, 1995, The Handbook of Brain Theory and Neural Networks,, 255
- LeCun, 1998, Proceedings of the IEEE,, 2278
- LeCun, 2007, Proceedings of International Conference on Document Analysis and Recognition (ICDAR).
- Lee, 2004, Proceedings of International Conference on Spoken Language Processing (ICSLP),, 109
- Lee, 2009, Proceedings of International Conference on Machine Learning (ICML).
- Lee, 2011, Communications of the Association for Computing Machinery (ACM),, 95
- Lee, 2010, Proceedings of Neural Information Processing Systems (NIPS
- Lena, 2012, Proceedings of Neural Information Processing Systems (NIPS).
- Li, 2014, IEEE/Association for Computing Machinery (ACM) Transactions on Audio, Speech, and Language Processing, 1
- Li, 2012, Proceedings of IEEE Spoken Language Technology (SLT
- Li, 2013, Proceedings Conference on Affective Computing and Intelligent Interaction (ACII),, 312
- Liao, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Liao, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Lin, 2009, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Lin, 2011, Proceedings of Computer Vision and Pattern Recognition (CVPR
- Ling, 2013, Modeling spectral envelopes using restricted boltzmann machines for statistical parametric speech synthesis, International Conference on Acoustics Speech and Signal Processing (ICASSP),, 7825
- Ling, 2013, Articulatory control of HMM-based parametric speech synthesis using feature-space-switched multiple regression
- Lu, 2013, Joint uncertainty decoding for noise robust subspace gaussian mixture models, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 1791, 10.1109/tasl.2013.2248718 · doi:10.1109/tasl.2013.2248718
- Ma, 2000, Computer, Speech and Language
- Maas, 2013, Rectifier nonlinearities improve neural network acoustic models
- Manning, 2009, Introduction to Information Retrieval.
- J.Markoff, 2012, Scientists see promise in deep-learning programs
- Martens, 2010, Deep learning with hessian-free optimization
- Martens, 2011, Learning recurrent neural networks with hessian-free optimization
- McGraw, 2013, Learning lexicons from speech using a pronunciation mixture model, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 357, 10.1109/tasl.2012.2226158 · DOI
- Mikolov, 2013, Efficient estimation of word representations in vector space
- Mikolov, 2010, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 1045
- Mikolov, 2013, Distributed representations of words and phrases and their compositionality
- Minami, 2002, A recognition method with parametric trajectory synthesized using direct relations between static and dynamic feature vector time series, 957
- Mnih, 2008, A scalable hierarchical distributed language model, 1081
- Mnih, 2013, Learning word embeddings efficiently with noise-contrastive estimation
- Mnih, 2013, laying arari with deep reinforcement learning
- Mohamed, 2009, Deep belief networks for phone recognition
- Morin, 2005, Hierarchical probabilistic neural network language models
- Murphy, 2012, Machine Learning
- Nair, 2009, 3-d object recognition with deep belief nets
- Ngiam, 2011, Learning deep energy models
- Ngiam, 2011, Multimodal deep learning
- Olshausen, 2012, Can ‘deep learning’ offer deep insights about visual representation?
- Ostendorf, 1999, Moving beyond the ‘beads-on-a-string’ model of speech
- Oudre, 2011, Probabilistic template-based chord recognition, IEEE Transactions on Audio, Speech, and Language Processing, 19, 2249, 10.1109/tasl.2010.2098870 · doi:10.1109/tasl.2010.2098870
- Palangi, 2013, Learning input and recurrent weight matrices in echo state networks
- Palangi, 2013, Using deep stacking network to improve structured compressive sensing with multiple measurement vectors
- Pascanu, 2014, How to construct deep recurrent neural networks
200 of 276 shown
Cited by
Items 301–400 of 1,005
Modern data science for analytical chemical data – A comprehensive review
Szymańska, E. (2018) · Analytica Chimica Acta · doi:10.1016/j.aca.2018.05.038 · Cited by 138
Deep-learning seismic full-waveform inversion for realistic structural models
Liu, B., Yang, S., Ren, Y., Xu, X., Jiang, P., & Chen, Y. (2020) · Geophysics · doi:10.1190/geo2019-0435.1 · Cited by 130
Asheralieva, A., & Niyato, D. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2961958 · Cited by 127
“The DQL problem is to find the weights ω which minimize the loss function, given by [39], [40], [48]–[51] L where ) is an optimal value, i.e., a solution of the Bellman optimality equation in (31b) and the optimization problem in (13a).”
BackgroundHan, Y., Wang, S., Ren, Y., Wang, C., Gao, P., & Chen, G. (2019) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi8060243 · Cited by 134
Introduction to digital pathology and computer-aided pathology
Nam, S., Chong, Y., Jung, C. K., Kwak, T.-Y., Lee, J. Y., Park, J., Rho, M. J., & Go, H. (2020) · Journal of Pathology and Translational Medicine · doi:10.4132/jptm.2019.12.31 · Cited by 125
“Deep learning (DL), a particular approach of ML, comprises multiple layers of neural networks that usually include an input layer, an output layer, and multiple hidden layers [ 10 ] .”
BackgroundShavaki, F. H., & Ghahnavieh, A. E. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10289-z · Cited by 152
“4 Deep auto‐encoder (DAE) and its application in the SCM The DAE is a special DNN without class labels in which the input vectors and output vectors have equal dimensionality (Deng and Yu 2014).”
BackgroundLSTM, WaveNet, and 2D CNN for nonlinear time history prediction of seismic responses
Ning, C., Xie, Y., & Sun, L. (2023) · Engineering Structures · doi:10.1016/j.engstruct.2023.116083 · Cited by 128
Deep learning-based welding image recognition: A comprehensive review
Liu, T., Zheng, P., & Bao, J. (2023) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2023.05.026 · Cited by 135
Diagnosis of Focal Liver Diseases Based on Deep Learning Technique for Ultrasound Images
Hassan, T. M., Elmogy, M. M., & Sallam, E. A. (2017) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-016-2387-9 · Cited by 127
“Deep learning uses many nonlinear processing layers for feature extraction and transformation [9].”
BackgroundMethodPatient-Specific Deep Architectural Model for ECG Classification
Luo, K., Li, J., Wang, Z., & Cuschieri, A. (2017) · Journal of Healthcare Engineering · doi:10.1155/2017/4108720 · Cited by 147
“The objective function of DAE can be written as in (8), which can be optimized by the stochastic gradient descent method [21].”
BackgroundDGCC: data-driven granular cognitive computing
Wang, G. (2017) · Granular Computing · doi:10.1007/s41066-017-0048-3 · Cited by 151
“…recognition, speech recognition, natural language processing and bioinformatics where they have produced state-of-the-art results on various tasks (Goller and Kuchler 1996; Deng et al. 2013; Deng and Yu 2014; Cires¸an et al. 2013; Mesnil et al. 2015; Krizhevsky et al. 2012; Chicco et al. 2014).”
BackgroundDeep Learning for Zero-day Malware Detection and Classification: A Survey
Deldar, F., & Abadi, M. (2023) · ACM Computing Surveys · doi:10.1145/3605775 · Cited by 156
“Deep learning is a class of machine learning algorithms that allows computational models composed of multiple processing layers to progressively extract higher-level features from the raw input [34].”
BackgroundLearning for Personalized Medicine: A Comprehensive Review From a Deep Learning Perspective
Zhang, S., Bamakan, S. M. H., Qu, Q., & Li, S. (2019) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2018.2864254 · Cited by 125
“4) Reproducibility: The training of a deep learning network requires fine-tuning that contains some level of flexibility [18].”
BackgroundDistributed Compressive Sensing: A Deep Learning Approach
Palangi, H., Ward, R. K., & Deng, L. (2016) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2016.2557301 · Cited by 137
“Similar to all deep learning methods, it has the important feature of learning the structure of S from the raw data automatically.”
BackgroundSelf-citationDekhtiar, J., Durupt, A., Bricogne, M., Eynard, B., Rowson, H., & Kiritsis, D. (2018) · Computers in Industry · doi:10.1016/j.compind.2018.04.005 · Cited by 135
Zhao, Z., Zhang, Y., Cömert, Z., & Deng, Y. (2019) · Frontiers in Physiology · doi:10.3389/fphys.2019.00255 · Cited by 125
“…in the number of training datasets and the dramatic increase in chip computational power, DL has achieved remarkable success in object detection, computer vision, natural language processing, and voice recognition, so it has also promoted the development of AI (Deng and Yu, 2014; Bengio, 2015).”
BackgroundZhou, Y. (2022) · Energy and AI · doi:10.1016/j.egyai.2022.100187 · Cited by 133
Chopra, R., & Sharma, G. D. (2021) · Journal of risk and financial management · doi:10.3390/jrfm14110526 · Cited by 144
Body condition estimation on cows from depth images using Convolutional Neural Networks
Álvarez, J. R., Arroqui, M., Mangudo, P., Toloza, J. M., Jatip, D., Rodríguez, J. M., Teyseyre, A., Sanz, C., Zunino, A., Machado, C. F., et al. (2018) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2018.09.039 · Cited by 123
“CNNs (Bengio et al., 2015) have been found highly effective and been commonly used in computer vision and image classification (Deng and Yu, 2014; Hijazi et al., 2015; Krizhevsky et al., 2012; Szegedy et al., 2015).”
MethodASA: A framework for Arabic sentiment analysis
Oussous, A., Benjelloun, F.-Z., Lahcen, A. A., & Belfkih, S. (2019) · Journal of Information Science · doi:10.1177/0165551519849516 · Cited by 132
“It is based on at most three layers levels and widely used for linear problems [58].”
BackgroundResultA comprehensive exploration to the machine learning techniques for diabetes identification
Wei, S., Zhao, X., & Miao, C. (2018) · IEEE World Forum on Internet of Things (WF-IoT) · doi:10.1109/wf-iot.2018.8355130 · Cited by 122
“In this experiment, all the layers we use in this model are dense layers, which means every pair of neurons in adjacent layers are connected [9].”
MethodA Comparison of Traditional Machine Learning and Deep Learning in Image Recognition
Lai, Y. (2019) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1314/1/012148 · Cited by 148
Deep Bidirectional LSTM Network Learning-Based Sentiment Analysis for Arabic Text
Elfaik, H., & Nfaoui, E. H. (2020) · Journal of Intelligent Systems · doi:10.1515/jisys-2020-0021 · Cited by 122
Khanjani, Z., Watson, G., & Janeja, V. P. (2023) · Frontiers in Big Data · doi:10.3389/fdata.2022.1001063 · Cited by 121
“We can consider two major categories for ANNs: shallow ANNs and deep ANNs (Deng, 2014).”
MethodInfluentialA Deep Neural Networks Approach to Automatic Recognition Systems for Volcano-Seismic Events
Títos, M., Rodríguez, Á. B., García, L., & Benítez, C. (2018) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2018.2803198 · Cited by 126
“DNNs define the state-of-the-art frameworks in many scientific disciplines, such as speech recognition [4], [18] and computer vision [19].”
Deep&Dense Convolutional Neural Network for Hyperspectral Image Classification
Paoletti, M. E., Haut, J. M., Plaza, J., & Plaza, A. (2018) · Remote Sensing · doi:10.3390/rs10091454 · Cited by 129
“In this sense, deep ANN architectures [67,68] (also called deep neural networks or DNNs) have attracted broad attention in HSI data classification due to their ability to extract more abstract data representations from the original data in a hierarchical way.”
BackgroundTransformed ℓ1 regularization for learning sparse deep neural networks
Ma, R., Miao, J., Niu, L., & Zhang, P. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.08.015 · Cited by 150
Bayesian Machine Learning: EEG\/MEG signal processing measurements
Wu, W., Nagarajan, S., & Chen, Z. (2016) · IEEE Signal Processing Magazine · doi:10.1109/msp.2015.2481559 · Cited by 115
“[49] L.”
BackgroundMethodInfluentialMorabito, F. C., Campolo, M., Mammone, N., Versaci, M., Franceschetti, S., Tagliavini, F., Sofia, V., Fatuzzo, D., Gambardella, A., Labate, A., et al. (2017) · International Journal of Neural Systems · doi:10.1142/s0129065716500398 · Cited by 118
Graph convolutional autoencoder model for the shape coding and cognition of buildings in maps
Yan, X., Ai, T., Yang, M. J., & Tong, X. (2020) · International Journal of Geographical Information Systems · doi:10.1080/13658816.2020.1768260 · Cited by 127
Noisy training for deep neural networks in speech recognition
Yin, S., Liu, C., Zhang, Z., Lin, Y., Wang, D., Tejedor, J., Zheng, T. F., & Li, Y. (2015) · EURASIP Journal on Audio, Speech, and Music Processing · doi:10.1186/s13636-014-0047-0 · Cited by 118
“The advantage of DNNs in modeling state emission distributions, when compared to the conventional GMM, has been discussed in some previous publications, e.g., [1,2].”
BackgroundAleesa, A. M., Zaidan, B. B., Zaidan, A. A., & Sahar, N. M. (2019) · Neural Computing and Applications · doi:10.1007/s00521-019-04557-3 · Cited by 136
Early Detection of the Advanced Persistent Threat Attack Using Performance Analysis of Deep Learning
Joloudari, J. H., Haderbadi, M., Mashmool, A., GhasemiGol, M., Band, S. S., & Mosavi, A. H. (2020) · IEEE Access · doi:10.1109/access.2020.3029202 · Cited by 140
Review of the Application of Artificial Intelligence in Education
Yufei, L., Saleh, S., Jiahui, H., & Abdullah, S. M. S. (2020) · International Journal of Innovation, Creativity and Change · doi:10.53333/ijicc2013/12850 · Cited by 92
Özbay, E. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10231-3 · Cited by 138
Sunil, C. K., Jaidhar, C. D., & Patil, N. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120381 · Cited by 132
Sarkar, S., & Das, S. (2016) · Biomedical Engineering and Computational Biology · doi:10.4137/becb.s34255 · Cited by 118
Abbas, S., Bouazzi, I. R., Ojo, S., Hejaili, A. A., Sampedro, G. A., Almadhor, A. S., & Greguš, M. (2024) · PeerJ Computer Science · doi:10.7717/peerj-cs.1793 · Cited by 136
“According to Deng & Yu (2014) , the deep learning method incorporates the learning area that employs irregular data in numerous stages through organizational frameworks.”
MethodRecurrent neural network training with dark knowledge transfer
Tang, Z., Wang, D., & Zhang, Z. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472809 · Cited by 125
An Overview of Lead and Accompaniment Separation in Music
Rafii, Z., Liutkus, A., Stöter, F.-R., Mimilakis, S. I., Fitzgerald, D., & Pardo, B. (2018) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2018.2825440 · Cited by 138
Ellefsen, A. L., Æsøy, V., Ushakov, S., & Zhang, H. (2019) · IEEE Transactions on Reliability · doi:10.1109/tr.2019.2907402 · Cited by 126
“For real-value data applications, Gaussian–Bernoulli RBM (GB-RBM) is normally used as the initial RBM to convert realvalued stochastic variables to binary stochastic variables [95], [96].”
MethodAn automatic approach based on CNN architecture to detect Covid-19 disease from chest X-ray images
Hira, S., Bai, A., & Hira, S. (2020) · Applied Intelligence · doi:10.1007/s10489-020-02010-w · Cited by 116
An overview of deep learning in big data, image, and signal processing in the modern digital age
França, R. P., Monteiro, A. C. B., Arthur, R., & Iano, Y. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-822226-3.00003-9 · Cited by 146
Systematic study on deep learning-based plant disease detection or classification
Sunil, C. K., Jaidhar, C. D., & Patil, N. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10517-0 · Cited by 115
“2019b) proposed a cucumber plant leaf disease detection approach using a Global Pooling Dilated CNN (GPDCNN) by incorporating the convolution with global pooling. Widened convolution was added instead of the kernel of an AlexNet; it intensifies the feature extraction ability and recovers the spatial resolution. To min…”
BackgroundMethodA convolutional neural network with feature fusion for real-time hand posture recognition
Chevtchenko, S. F., Vale, R. F., Macario, V., & Cordeiro, F. R. (2018) · Applied Soft Computing · doi:10.1016/j.asoc.2018.09.010 · Cited by 119
A real-time hourly ozone prediction system using deep convolutional neural network
Eslami, E., Choi, Y., Lops, Y., & Sayeed, A. (2019) · Neural Computing and Applications · doi:10.1007/s00521-019-04282-x · Cited by 117
Deep Learning Techniques for Speech Emotion Recognition: A Review
Pandey, S. K., Shekhawat, H. S., & Prasanna, S. R. M. (2019) · 2019 29th International Conference Radioelektronika (RADIOELEKTRONIKA) · doi:10.1109/radioelek.2019.8733432 · Cited by 93
“[21]”
Deep Learning Method for Denial of Service Attack Detection Based on Restricted Boltzmann Machine
İmamverdiyev, Y., & Abdullayeva, F. J. (2018) · Big Data · doi:10.1089/big.2018.0023 · Cited by 120
“In Ref., 32 to detect DDoS attacks in the web-application layer deep learning method is used.”
InfluentialFabric defect detection based on a deep convolutional neural network using a two-stage strategy
Xiang, J., Wang, J., Zhou, J., Meng, S., Pan, R., & Gao, W. (2020) · Textile Research Journal · doi:10.1177/0040517520935984 · Cited by 113
Reinforcement and deep reinforcement learning for wireless Internet of Things: A survey
Frikha, M. S., Gammar, S. M., Lahmadi, A., & Andrey, L. (2021) · Computer Communications · doi:10.1016/j.comcom.2021.07.014 · Cited by 122
He, J., Li, K., Liao, X., Zhang, P., & Jiang, N. (2019) · IEEE Access · doi:10.1109/access.2019.2907076 · Cited by 112
“tional layer in its hidden layers [14].”
Zhang, W., Zhou, H., Bao, X., & Cui, H. (2022) · Energy · doi:10.1016/j.energy.2022.126190 · Cited by 117
Abdi, N., Albaseer, A. M., & Abdallah, M. M. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3354045 · Cited by 124
“This focus aligns with the established consensus in the literature (as in [26] and [32]) on the advanced efficacy of DL over traditional ML methods.”
BackgroundPneumonia Detection Using Chest Radiographs With Novel EfficientNetV2L Model
Ali, M., Shahroz, M., Akram, U., Mushtaq, M. F., Altamiranda, S. C., Obregón, S. A., Díez, I. D. L. T., & Ashraf, I. (2024) · IEEE Access · doi:10.1109/access.2024.3372588 · Cited by 132
“The integration of deep learning in pneumonia disease classification empowers healthcare professionals with an automated and efficient tool for early diagnosis [35].”
MethodFlexible mobility on-demand: an environmental scan
Liyanage, S., Dia, H., Abduljabbar, R., & Bagloee, S. (2019) · Sustainability · doi:10.3390/su11051262 · Cited by 111
Gating mass cytometry data by deep learning
Li, H., Shaham, U., Stanton, K., Yao, Y., Montgomery, R. R., & Kluger, Y. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx448 · Cited by 119
“Recently, deep learning methods have achieved outstanding performance in various computational tasks, such as image analysis, natural language processing, and pattern recognition (Deng and Yu, 2014).”
BackgroundCPS data streams analytics based on machine learning for Cloud and Fog Computing: A survey
Fei, X., Shah, N., Verba, N., Chao, K., Sánchez-Anguix, V., Lewandowski, J., James, A. E., & Usman, Z. (2018) · Future Generation Computer Systems · doi:10.1016/j.future.2018.06.042 · Cited by 125
“For various closely related definitions of deep learning, please refer to [56].”
BackgroundDeep Learning Applications in Agriculture: A Short Review
Santos, L. C., dos Santos, F. N., Oliveira, P. M., & Shinde, P. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-35990-4_12 · Cited by 111
Deep belief echo-state network and its application to time series prediction
Sun, X., Li, T., Li, Q., Huang, Y., & Li, Y. (2017) · Knowledge-Based Systems · doi:10.1016/j.knosys.2017.05.022 · Cited by 110
Pastur-Romay, L., Cedrón, F., Pazos, A., & Porto-Pazos, A. (2016) · International Journal of Molecular Sciences · doi:10.3390/ijms17081313 · Cited by 109
“As was pointed out, DNNs have become the state-of-the-art algorithms of ML in speech recognition, computer vision, natural language processing and many other tasks (see Table 1) [26,27].”
Efficient diagnosis system for Parkinson's disease using deep belief network
Al-Fatlawi, A. H., Jabardi, M. H., & Ling, S. H. (2016) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2016.7743941 · Cited by 128
Singh, G., & Khare, N. (2022) · International Journal of Computers and Applications · doi:10.1080/1206212x.2021.1885150 · Cited by 59
“DNNs are artificial neural networks (ANN) that have various layers in the middle of the input and output layers [34].”
BackgrounddeepGesture: Deep learning-based gesture recognition scheme using motion sensors
Kim, J., Hong, G.-S., Kim, B., & Dogra, D. P. (2018) · Displays · doi:10.1016/j.displa.2018.08.001 · Cited by 112
Feature-Based Fusion Using CNN for Lung and Heart Sound Classification
Tariq, Z., Shah, S. K., & Lee, Y. (2022) · Sensors · doi:10.3390/s22041521 · Cited by 116
“These learning techniques are among the fastest-growing fields at present in the area of audio classification [16].”
BackgroundAbunadi, I., & Senan, E. M. (2022) · Sensors · doi:10.3390/s22041629 · Cited by 108
Sentiment analysis for user reviews using Bi-LSTM self-attention based CNN model
Bhuvaneshwari, P., Rao, A. N., Robinson, H., & Thippeswamy, M. N. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-12410-4 · Cited by 107
“Since it uses multiple layers of non-linear processing units, it can learn multiple representations and abstractions from the raw data effectively [3].”
BackgroundExtraction of skin lesions from non-dermoscopic images for surgical excision of melanoma
Jafari, M. H., Nasr-Esfahani, E., Karimi, N., Soroushmehr, S. M. R., Samavi, S., & Najarian, K. (2017) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-017-1567-8 · Cited by 76
“A review of literature is given in [20] and [21].”
BackgroundHatipoğlu, N., & Bilgin, G. (2017) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-017-1630-1 · Cited by 114
Ontology learning: Grand tour and challenges
Khadir, A. C., Aliane, H., & Guessoum, A. (2020) · Computer Science Review · doi:10.1016/j.cosrev.2020.100339 · Cited by 105
A Generic Quality Control Framework for Fetal Ultrasound Cardiac Four-Chamber Planes
Dong, J., Liu, S., Liao, Y., Wen, H., Lei, B., Li, S., & Wang, T. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2019.2948316 · Cited by 104
“[18], speech recognition [19] and medical image analysis [1], [20]–[22].”
BackgroundOptimizing Neuro-Oncology Imaging: A Review of Deep Learning Approaches for Glioma Imaging
Shaver, M., Kohanteb, P. A., Chiou, C., Bardis, M. D., Chantaduly, C., Bota, D. A., Filippi, C. G., Weinberg, B. D., Grinband, J., Chow, D. S., et al. (2019) · Cancers · doi:10.3390/cancers11060829 · Cited by 109
“For example, while linear measurements may be sufficient for rounded nodular lesions, these measurements may be inaccurate for tumors with irregular margins, a feature common in high-grade gliomas given their propensity for necrosis and eccentric growth [11].”
BackgroundInfluentialUnderwater object detection: architectures and algorithms – a comprehensive review
Fayaz, S., Parah, S. A., & Qureshi, G. J. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-12502-1 · Cited by 116
“For texts, images, sounds, etc., to make sense, deep learning algorithms transform input data via more layers than algorithms based on shallow learning [23].”
Towards the Automatic Classification of Avian Flight Calls for Bioacoustic Monitoring
Salamon, J., Bello, J. P., Farnsworth, A., Robbins, M., Keen, S., Klinck, H., & Kelling, S. (2016) · PLOS ONE · doi:10.1371/journal.pone.0166866 · Cited by 98
Deep-STEP: A Deep Learning Approach for Spatiotemporal Prediction of Remote Sensing Data
Das, M., & Ghosh, S. K. (2016) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2016.2619984 · Cited by 103
“The details of DSN can be found in [5].”
BackgroundMethodShort term load forecasting using multiple linear regression for big data
Saber, A. Y., & Alam, A. (2017) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci.2017.8285261 · Cited by 103
“In recent years, computational intelligence (AI), deep learning based techniques including neural network (NN) have been used [8-10].”
BackgroundRole of Big Data and Machine Learning in Diagnostic Decision Support in Radiology
Syeda-Mahmood, T. F. (2018) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2018.01.028 · Cited by 111
Deep-learning-based visual data analytics for smart construction management
Pal, A., & Hsieh, S. (2021) · Automation in Construction · doi:10.1016/j.autcon.2021.103892 · Cited by 112
A Survey of Autonomous Driving from a Deep Learning Perspective
Zhao, J., Wu, Y., Deng, R., Xu, S., Gao, J., & Burke, A. F. (2025) · ACM Computing Surveys · doi:10.1145/3729420 · Cited by 150
Automated reference-free detection of motion artifacts in magnetic resonance images
Küstner, T., Liebgott, A., Mauch, L., Martirosian, P., Bamberg, F., Nikolaou, K., Yang, B., Schick, F., & Gatidis, S. (2018) · Magnetic Resonance Materials in Physics Biology and Medicine · doi:10.1007/s10334-017-0650-z · Cited by 102
A novel chatter detection method for milling using deep convolution neural networks
Şener, B., Gudelek, M. U., Özbayoğlu, A. M., & Ünver, H. Ö. (2021) · Measurement · doi:10.1016/j.measurement.2021.109689 · Cited by 102
Understanding Subtitles by Character-Level Sequence-to-Sequence Learning
Zhang, H., Li, J., Ji, Y., & Yue, H. (2016) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2016.2601521 · Cited by 101
“We explicitly normalized the L 2 -norm of the gradient of the cost function each time to be at most a predefined threshold of 1, when the norm was larger than the threshold [20].”
MethodApplicability of machine learning to a crack model in concrete bridges
Okazaki, Y., Okazaki, S., Asamoto, S., & Chun, P. (2020) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12532 · Cited by 101
“…deep learning in which multiple intermediate layers are used to progressively extract higher-level features from raw input has been proposed (Deng & Yu, 2013; Rafiei & Adeli, 2017a, 2017b, 2018a, 2018b; Schmidhuber, 2015), the ANN with a single intermediate layer can even be used to…”
BackgroundAn unsupervised deep-learning method for porosity estimation based on poststack seismic data
Feng, R., Hansen, T. M., Graña, D., & Balling, N. (2020) · Geophysics · doi:10.1190/geo2020-0121.1 · Cited by 101
System Design Perspective for Human-Level Agents Using Deep Reinforcement Learning: A Survey
Nguyen, N. D., Nguyen, T., & Nahavandi, S. (2017) · IEEE Access · doi:10.1109/access.2017.2777827 · Cited by 100
“Deep learning is a subset of machine learning that effectively employs neural networks to learn on multiple levels, each corresponding with different levels of abstraction [11].”
BackgroundVolkova, S., Ayton, E., Porterfield, K., & Corley, C. D. (2017) · PLOS ONE · doi:10.1371/journal.pone.0188941 · Cited by 100
Hyperspectral image analysis using deep learning — A review
Petersson, H., Gustafsson, D. K. J., & Bergstrom, D. (2016) · International Conference on Image Processing Theory, Tools and Applications (IPTA) · doi:10.1109/ipta.2016.7820963 · Cited by 100
“A hierarchical feature representation is considered to be richer in a sense that more properties can be represented in a multilevel structure[3], [2], [8], [13].”
BackgroundHADM: Hybrid Analysis for Detection of Malware
Xu, L., Zhang, D., Jayasena, N., & Cavazos, J. (2017) · Lecture notes in networks and systems · doi:10.1007/978-3-319-56991-8_51 · Cited by 111
“In some literature, DNN is also referred to as Deep Belief Network (DBN) [10].”
MethodEnhancing images of shale formations by a hybrid stochastic and deep learning algorithm
Kamrava, S., Tahmasebi, P., & Sahimi, M. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.07.009 · Cited by 106
An Empirical Evaluation of Deep Learning for Network Anomaly Detection
Malaiya, R. K., Kwon, D., Suh, S. C., Kim, H., Kim, I., & Kim, J. (2019) · IEEE Access · doi:10.1109/access.2019.2943249 · Cited by 113
“While deep learning has been applied for a variety of applications such as image processing and natural language processing [20], [21], it has not been thoroughly examined for the application of network anomaly detection.”
BackgroundA systematic review of fuzzing based on machine learning techniques
Wang, Y., Jia, P., Liu, L., Huang, C., & Liu, Z. (2020) · PLoS ONE · doi:10.1371/journal.pone.0237749 · Cited by 100
“Deep learning (Deng et al. 2014; LeCun et al. 2015) is an artificial neural network composed of multiple nonlinear processing units to representation learning of data, which is a deeper extension of the machine learning algorithm.”
BackgroundArtificial intelligence in nutrition research: perspectives on current and future applications
Côté, M., & Lamarche, B. (2021) · Applied Physiology, Nutrition, and Metabolism · doi:10.1139/apnm-2021-0448 · Cited by 109
The Internet of Sounds: Convergent Trends, Insights, and Future Directions
Turchet, L., Lagrange, M., Rottondi, C., Fazekas, G., Peters, N., Østergaard, J., Font, F., Bäckström, T., & Fischione, C. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3253602 · Cited by 112
“These fields, however, are increasingly dominated by deep learning solutions [116], [268], [269].”
BackgroundStructural damage detection using deep learning of ultrasonic guided waves
Melville, J., Alguri, K. S., Deemer, C., & Harley, J. B. (2018) · AIP Conference Proceedings · doi:10.1063/1.5031651 · Cited by 96
A Comprehensive Review on AI-Enabled Models for Parkinson’s Disease Diagnosis
Dixit, S., Bohre, K., Singh, Y., Himeur, Y., Mansoor, W., Atalla, S., & Srinivasan, K. (2023) · Electronics · doi:10.3390/electronics12040783 · Cited by 109
Ma, J., Su, H., Zhao, W., & Liu, B. (2018) · Complexity · doi:10.1155/2018/3813029 · Cited by 98
“Companies such as Google, Microsoft, Apple, IBM, and Baidu [24], whose products are widely used, are researching deep learning and have made achievements, such as AlphaGo.”
BackgroundA deep learning framework for predicting cyber attacks rates
Fang, X., Xu, M., Xu, S., & Zhao, P. (2019) · EURASIP Journal on Information Security · doi:10.1186/s13635-019-0090-6 · Cited by 98
Eshkevari, S. S., Takáč, M., Pakzad, S. N., & Jahani, M. (2020) · Engineering Structures · doi:10.1016/j.engstruct.2020.111582 · Cited by 119
Prabhavalkar, R., Alsharif, O., Bruguier, A., & McGraw, L. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472823 · Cited by 97
“Advances in computational capabilities coupled with the availability of large annotated speech corpora have made it possible to train NN-based AMs with a large number of parameters [5] with great success.”
BackgroundTowards Deep Learning Prospects: Insights for Social Media Analytics
Hayat, M. K., Daud, A. Y., Alshdadi, A. A., Banjar, A., Abbasi, R. A., Bao, Y., & Dawood, H. (2019) · IEEE Access · doi:10.1109/access.2019.2905101 · Cited by 111
“DL methods and applications [8] feast through the zeal of application domains including business, education, economics, health informatics etc.”
MethodXie, J., Huang, J., Zeng, C., Jiang, S., & Podlich, N. (2020) · Geosciences · doi:10.3390/geosciences10110425 · Cited by 107
“The RNN unit takes the current and previous input data into consideration at the same time, enabling the method to perform better at predicting future trends given some historical sequence of data [43,48].”
Method
Metadata
- Authors
- Deng, L., & Yu, D.
- Affiliations
- Microsoft (United States) (US)
- Venue
- Foundations and Trends® in Signal Processing
- Publisher
- Emerald
- Published
- 2014-06-30
- Volume
- 7
- Issue
- 3-4
- Pages
- 197-387
- ISSN
- 1932-8346 (ISSN-L)
- 1932-8354
- OpenAlex
- W4205947740
- Cited by
- 3,480
- References
- 21
- Citations by year
- 2026: 113 · 2025: 206 · 2024: 298 · 2023: 410 · 2022: 469 · 2021: 453 · 2020: 404 · 2019: 426 · 2018: 304 · 2017: 188 · 2016: 146 · 2015: 57 · 2014: 3
- FWCI
- 117.48
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Foundations and Trends® in Signal Processing (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- deep learning, signal processing, information processing, speech recognition, computer vision, natural language processing, text processing, information retrieval, multimodal information processing, multi-task learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.