Deep Learning: Methods and Applications
Open accessThe DOI matches its Crossref record; 28 of the 168 references it cites were found in a registry or an index, and 140 are not checked yet.
Abstract
This monograph provides an overview of general deep learning methodology and its applications to a variety of signal and information processing tasks. The application areas are chosen with the following three criteria in mind: (1) expertise or knowledge of the authors; (2) the application areas that have already been transformed by the successful use of deep learning technology, such as speech recognition and computer vision; and (3) the application areas that have the potential to be impacted significantly by deep learning and that have been experiencing research growth, including natural language and text processing, information retrieval, and multimodal information processing empowered by multi-task deep learning.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Deep learning is successfully used as a tool for machine learning, where a neural network is capable of automatically learning features.”
From Medical image analysis using convolutional neural networks: a review (2018) · cites this paper as [47]
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Self-citationLearning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239 · cited 6×
“Since 2006, deep structured learning, or more commonly called deep learning or hierarchical learning, has emerged as a new area of machine learning research [20, 163].”
BackgroundMethodInfluentialLearning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542 · cited 1×
“, speech or text), but until recently they had not been widely used partly because they are difficult to train to capture long-term dependencies, giving rise to gradient vanishing or gradient explosion problems which were known in early 1990s [29, 167].”
BackgroundWolpert, D. H. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80023-1 · Cited by 7,951
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878 · cited 1×
“[347] developed the recursive neural tensor network, where each layer is constructed similarly to that of the neural tensor network described in [340] with an illustration shown in Figure 8.”
MethodCaruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636 · cited 1×
“The several architectures discussed so far in this chapter for multimodal processing and learning can be regarded as special cases of more general multi-task learning and transfer learning [22, 47].”
Background
Research works printed but not linked: 276
- Abdel-Hamid, 2013, Proceedings of Interspeech,
- Abdel-Hamid, 2013, Proceedings of Interspeech.
- Abdel-Hamid, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Acero, 2000, Proceedings of Interspeech
- Alain, 2013, Proceedings of International Conference on Learning Representations (ICLR).
- Arisoy, 2012, Proceedings of the Joint Human Language Technology Conference and the North American Chapter of the Association of Computational Linguistics (HLT-NAACL) Workshop.
- Aslan, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Ba, 2013, Proceedings of Neural Information Processing Systems (NIPS
- Baldi, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- E. Battenberg , E.Schmidt, and J.Bello. Deep learning for music, special session at International Conference on Acoustics Speech and Signal Processing (ICASSP) (http://www.icassp2014.org/ special_sections.html#ss8), 2014.
- Batternberg, 2012, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Bell, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Bengio, 2008, Scholarpedia,
- Bengio, 2012, Deep learning of representations for unsupervised and transfer learning, Journal of Machine Learning Research Workshop and Conference Proceedings, 27, 17
- Bengio, 2013, Statistical Language and Speech Processing,, 1
- Bengio, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Bengio, 2000, Proceedings of Neural Information Processing Systems (NIPS
- Bengio, 2003, A neural probabilistic language model, Journal of Machine Learning Research,, 3, 1137
- Bengio, 2006, Proceedings of Neural Information Processing Systems (NIPS
- Bengio, 2013, Proceedings of International Conference on Machine Learning (ICML), 2014.
- Bengio, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Bergstra, 2012, Random search for hyper-parameter optimization, Journal on Machine Learning Research,, 3, 281
- Bilmes, 2010, Dynamic graphical models, IEEE Signal Processing Magazine,, 33, 29
- Bordes, 2013, Machine Learning,
- Bordes, 2011, Proceedings of Association for the Advancement of Artificial Intelligence (AAAI).
- Bottou, 2013, From machine learning to machine reasoning: An essay, Journal of Machine Learning Research,, 14, 3207
- Bottou, 2004, Proceedings of Neural Information Processing Systems (NIPS
- Boulanger-Lewandowski, 2012, Proceedings of International Conference on Machine Learning (ICML).
- Boulanger-Lewandowski, 2013, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Bourlard, 1993, Connectionist Speech Recognition: A Hybrid Approach.
- Breiman, 1996, Stacked regression, Machine Learning,, 24, 49, 10.1023/a:1018046112532 · doi:10.1023/a:1018046112532 · Paper page
- Cardinal, 2013, Large vocabulary speech recognition on parallel architectures, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 2290, 10.1109/tasl.2013.2271591 · doi:10.1109/tasl.2013.2271591
- Chen, 2014, Proceedings of International Conference on Learning Representations.
- Chen, 2012, Proceedings of Interspeech.
- Chengalvarayan, 1997, IEEE Transactions on Speech and Audio Processing, 243
- Chengalvarayan, 1997, IEEE Transactions on Speech and Audio Processing,, 232
- Chengalvarayan, 1998, Speech trajectory discrimination using the minimum classification error learning, IEEE Transactions on Speech and Audio Processing,, 6, 505, 10.1109/89.725317 · doi:10.1109/89.725317
- Cho, 2009, Proceedings of Neural Information Processing Systems (NIPS, 342
- Ciresan, 2012, Proceedings of Neural Information Processing Systems (NIPS
- Ciresan, 2010, Neural Computation
- Ciresan, 2011, Proceedings of International Joint Conference on Neural Networks (IJCNN).
- Ciresan, 2012, Proceedings of Computer Vision and Pattern Recognition (CVPR).
- Ciresan, 2012, Proceedings of International Joint Conference on Neural Networks (IJCNN).
- Coates, 2013, Proceedings of International Conference on Machine Learning (ICML).
- Cohen, 2005, Proceedings of International Joint Conference on Artificial Intelligence (IJCAI),, 671
- Collobert, 2011, Proceedings of Artificial Intelligence and Statistics (AISTATS
- Collobert, 2008, Proceedings of International Conference on Machine Learning (ICML).
- Collobert, 2011, Natural language processing (almost) from scratch, Journal on Machine Learning Research,, 12, 2493
- Dahl, 2010, Phone recognition with the mean-covariance restricted boltzmann machine, Proceedings of Neural Information Processing Systems (NIPS, 23, 469
- Dahl, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dahl, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dahl, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dean, 2012, Proceedings of Neural Information Processing Systems (NIPS
- Demuynck, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Deng, 1993, IEEE Transactions on Speech and Audio Processing, 471
- Deng, 2003, Mathematical Foundations of Speech and Language Processing,, 115
- Deng, 2011, Proceedings of Asian-Pacific Signal & Information Processing Annual Summit and Conference (APSIPA-ASC).
- Deng, 2012, The MNIST database of handwritten digit images for machine learning research, IEEE Signal Processing Magazine,, 29
- Deng, 2013, Neural Information Processing Systems (NIPS) Workshop on Learning Output Representations.
- Deng, 2013, Asian-Pacific Signal & Information Processing Association Transactions on Signal and Information Processing.
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2001, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2014, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 1992, Structural design of a hidden Markov model based speech recognizer using multi-valued phonetic features: Comparison with segmental speech units, Journal of the Acoustical Society of America,, 92, 3058, 10.1121/1.404202 · doi:10.1121/1.404202
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2004, Challenges in adopting speech recognition, Communications of the Association for Computing Machinery (ACM),, 47, 11
- Deng, 2012, Proceedings of Interspeech.
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2003, Speech Processing — A Dynamic and Optimization-Oriented Approach
- Deng, 1996, Transitional speech units and their representation by regressive Markov states: Applications to speech recognition, IEEE Transactions on speech and audio processing,, 4, 301, 10.1109/89.506934 · doi:10.1109/89.506934
- Deng, 2010, Proceedings of Interspeech.
- Deng, 2012, Proceedings of IEEE Workshop on Spoken Language Technologies
- Deng, 2002, Distributed speech processing in mipad’s multimodal user interface, IEEE Transactions on Speech and Audio Processing,, 10, 605, 10.1109/tsa.2002.804538 · doi:10.1109/tsa.2002.804538
- Deng, 2005, Dynamic compensation of HMM variances using the feature enhancement uncertainty computed from a parametric model of speech distortion, IEEE Transactions on Speech and Audio Processing,, 13, 412, 10.1109/tsa.2005.845814 · doi:10.1109/tsa.2005.845814
- Deng, 2007, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2011, Proceedings of Interspeech.
- Deng, 2009, Neural Information Processing Systems (NIPS) Workshop
- Deng, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deselaers, 2009, Proceedings of 4th Workshop on Statistical Machine Translation,, 233
- Dognin, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Erhan, Journal on Machine Learning Research,, 201
- Fernandez, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 6885
- Fine, 1998, Machine Learning, 41
- Frome, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Fu, 2007, Proceedings of Interspeech
- Gales, 2011, Robust Speech Recognition of Uncertain or Missing Data: Theory and Application, 101, 10.1007/978-3-642-21317-5_5 · doi:10.1007/978-3-642-21317-5_5
- Gao, 2010, Proceedings of Conference on Information and Knowledge Management (CIKM).
- Gao, 2013, Proceedings of Neural Information Processing Systems (NIPS) Workshop on Deep Learning
- Gao, 2014, Proceedings of Association for Computational Linguistics (ACL).
- Gao, 2011, Proceedings of Special Interest Group on Information Retrieval (SIGIR).
- Gens, 2012, Neural Information Processing Systems (NIPS),
- Gibson, 2010, Error approximation and minimum phone error acoustic model estimation, IEEE Transactions on Audio, Speech, and Language Processing,, 18, 1269, 10.1109/tasl.2009.2032607 · DOI
- Glorot, 2010, Proceedings of Artificial Intelligence and Statistics (AISTATS).
- Glorot, 2011, Proceedings of Artificial Intelligence and Statistics (AIS-TATS
- Goodfellow, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Graves, 2012, Representation Learning Workshop, International Conference on Machine Learning (ICML),
- Graves, 2006, Proceedings of International Conference on Machine Learning (ICML).
- Graves, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Graves, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Grezl, 2008, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Gutmann, 2012, Noise-contrastive estimation of unnormalized statistical models, with applications to natural image statistics, Journal of Machine Learning Research,, 13, 307
- Hain, 2012, IEEE Transactions on Audio, Speech, and Language Processing,, 486
- Hamel, 2010, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Hawkins, 2004, On Intelligence: How a New Understanding of the Brain will lead to the Creation of Truly Intelligent Machines
- He, 2011, IEEE Signal Processing Magazine,
- He, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- He, 2013, Proceedings of the IEEE.
- Heigold, 2013, Investigations on an EM-style optimization algorithm for discriminative training of HMMs, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 2616, 10.1109/tasl.2013.2280234 · doi:10.1109/tasl.2013.2280234
- Heigold, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Heintz, 2009, Discriminative input stream combination for conditional random field phone recognition, IEEE Transactions on Audio, Speech, and Language Processing,, 17, 1533, 10.1109/tasl.2009.2022204 · doi:10.1109/tasl.2009.2022204
- Henderson, 2013, Proceedings of Special Interest Group on Disclosure and Dialogue (SIGDIAL).
- Hermans, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Hermansky, 2000, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Hinton, 1990, Artificial Intelligence,, 1
- Hinton, 2003, Canadian Psychology,, 10
- Hinton, 2011, A better way to learn features, Communications of the Association for Computing Machinery (ACM),, 54
- Hinton, 2006, Neural Computation,, 1527
- Hinton, 2010, Topics in Cognitive Science,, 1
- Huang, 2012, Proceedings of Association for Computational Linguistics (ACL).
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Association for Computing Machinery (ACM) International Conference Information and Knowledge Management (CIKM),
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2001, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Proceedings of Interspeech,, 2360
- Humphrey, 2012, Proceedings of International Conference on Machine Learning and Application (ICMLA).
- Humphrey, 2012, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Humphrey, 2013, Journal of Intelligent Information Systems,
- Hutchinson, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Hutchinson, 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence,, 1944
- Imseng, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Jaitly, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Jaitly, 2012, Proceedings of Interspeech.
- Jarrett, 2009, Proceedings of International Conference on Computer Vision,, 2146
- Kahou, 2013, Proceedings of International Conference on Multimodal Interaction (ICMI).
- Kang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 8012
- Kashiwagi, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Kavukcuoglu, 2010, Proceedings of Neural Information Processing Systems (NIPS
- Ketabdar, 2010, IEEE Transactions on Audio, Speech, and Language Processing,, 1094
- Kingsbury, 2009, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Kingsbury, 2012, Proceedings of Interspeech.
- Kiros, 2013, Proceedings of Neural Information Processing Systems (NIPS) Deep Learning Workshop.
- Ko, 2013, IEEE Transactions on Audio, Speech, and Language Processing, 1285
- Krizhevsky, 2012, Proceedings of Neural Information Processing Systems (NIPS).
- Kubo, 2012, Proceedings of Interspeech.
- Kurzweil, 2012, How to Create a Mind.
- Lal, 2013, IEEE Transactions on Audio, Speech, and Language Processing,, 2506
- Larochelle, 2008, Proceedings of International Conference on Machine Learning (ICML).
- Le, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Le, 2010, Proceedings of Empirical Methods in Natural Language Processing (EMNLP, 778
- Le, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Le, 2013, IEEE Transactions on Audio, Speech, and Language Processing, 197
- Le, 2011, Proceedings of International Conference on Machine Learning (ICML).
- Le, 2012, Proceedings of International Conference on Machine Learning (ICML).
- LeCun, 2012, Proceedings of European Conference on Computer Vision (ECCV).
- LeCun, 1995, The Handbook of Brain Theory and Neural Networks,, 255
- LeCun, 1998, Proceedings of the IEEE,, 2278
- LeCun, 2007, Proceedings of International Conference on Document Analysis and Recognition (ICDAR).
- Lee, 2004, Proceedings of International Conference on Spoken Language Processing (ICSLP),, 109
- Lee, 2009, Proceedings of International Conference on Machine Learning (ICML).
- Lee, 2011, Communications of the Association for Computing Machinery (ACM),, 95
- Lee, 2010, Proceedings of Neural Information Processing Systems (NIPS
- Lena, 2012, Proceedings of Neural Information Processing Systems (NIPS).
- Li, 2014, IEEE/Association for Computing Machinery (ACM) Transactions on Audio, Speech, and Language Processing, 1
- Li, 2012, Proceedings of IEEE Spoken Language Technology (SLT
- Li, 2013, Proceedings Conference on Affective Computing and Intelligent Interaction (ACII),, 312
- Liao, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Liao, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Lin, 2009, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Lin, 2011, Proceedings of Computer Vision and Pattern Recognition (CVPR
- Ling, 2013, Modeling spectral envelopes using restricted boltzmann machines for statistical parametric speech synthesis, International Conference on Acoustics Speech and Signal Processing (ICASSP),, 7825
- Ling, 2013, Articulatory control of HMM-based parametric speech synthesis using feature-space-switched multiple regression
- Lu, 2013, Joint uncertainty decoding for noise robust subspace gaussian mixture models, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 1791, 10.1109/tasl.2013.2248718 · doi:10.1109/tasl.2013.2248718
- Ma, 2000, Computer, Speech and Language
- Maas, 2013, Rectifier nonlinearities improve neural network acoustic models
- Manning, 2009, Introduction to Information Retrieval.
- J.Markoff, 2012, Scientists see promise in deep-learning programs
- Martens, 2010, Deep learning with hessian-free optimization
- Martens, 2011, Learning recurrent neural networks with hessian-free optimization
- McGraw, 2013, Learning lexicons from speech using a pronunciation mixture model, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 357, 10.1109/tasl.2012.2226158 · DOI
- Mikolov, 2013, Efficient estimation of word representations in vector space
- Mikolov, 2010, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 1045
- Mikolov, 2013, Distributed representations of words and phrases and their compositionality
- Minami, 2002, A recognition method with parametric trajectory synthesized using direct relations between static and dynamic feature vector time series, 957
- Mnih, 2008, A scalable hierarchical distributed language model, 1081
- Mnih, 2013, Learning word embeddings efficiently with noise-contrastive estimation
- Mnih, 2013, laying arari with deep reinforcement learning
- Mohamed, 2009, Deep belief networks for phone recognition
- Morin, 2005, Hierarchical probabilistic neural network language models
- Murphy, 2012, Machine Learning
- Nair, 2009, 3-d object recognition with deep belief nets
- Ngiam, 2011, Learning deep energy models
- Ngiam, 2011, Multimodal deep learning
- Olshausen, 2012, Can ‘deep learning’ offer deep insights about visual representation?
- Ostendorf, 1999, Moving beyond the ‘beads-on-a-string’ model of speech
- Oudre, 2011, Probabilistic template-based chord recognition, IEEE Transactions on Audio, Speech, and Language Processing, 19, 2249, 10.1109/tasl.2010.2098870 · doi:10.1109/tasl.2010.2098870
- Palangi, 2013, Learning input and recurrent weight matrices in echo state networks
- Palangi, 2013, Using deep stacking network to improve structured compressive sensing with multiple measurement vectors
- Pascanu, 2014, How to construct deep recurrent neural networks
200 of 276 shown
Cited by
Items 401–500 of 1,005
Xie, P., Li, Y., Deng, B., Du, C., Rui, S., Deng, W., Wang, M., Boey, J., Armstrong, D. G., Ma, Y., et al. (2022) · International Wound Journal · doi:10.1111/iwj.13691 · Cited by 88
“32,33 In addition to the predictive power, interpretability is also a central character of the model.”
BackgroundMohanty, D. K., Parida, A. K., & Khuntia, S. S. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106898 · Cited by 104
DeNNeS: deep embedded neural network expert system for detecting cyber attacks
Mahdavifar, S., & Ghorbani, A. A. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-04830-w · Cited by 104
Tazin, T., Sarker, S., Gupta, P., Ayaz, F. I., Islam, S., Khan, M. M., Bourouis, S., Idris, S. A., & Alshazly, H. A. (2021) · Computational Intelligence and Neuroscience · doi:10.1155/2021/2392395 · Cited by 95
“Each successive layer’s output becomes the input for the subsequent layer, which aids in data abstraction as we go deeper into the network [8].”
BackgroundRetractedBokhove, C., & Downey, C. (2018) · Methodological Innovations · doi:10.1177/2059799118790743 · Cited by 94
“All major commercial speech recognition systems are based on deep learning (e.g. see Deng and Yu, 2014).”
BackgroundDiabetic retinopathy detection through convolutional neural networks with synaptic metaplasticity
Vives-Boix, V., & Fernández, D. R. (2021) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2021.106094 · Cited by 94
Effective scheduling algorithm for load balancing in fog environment using CNN and MPSO
Talaat, F. M., Ali, H. A., Saraya, M. S., & Saleh, A. I. (2022) · Knowledge and Information Systems · doi:10.1007/s10115-021-01649-2 · Cited by 94
“DL architectures such as deep neural networks, deep belief networks, recurrent neural networks, and convolutional neural networks havebeen implemented tofields such as classification, object detection, and speech recognition [26].”
MethodLocal binary pattern network: A deep learning approach for face recognition
Xi, M., Chen, L., Polajnar, D., & Tong, W. (2016) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2016.7532955 · Cited by 102
“CNN obtains the facial discriminative representations from a set of hierarchically connected and trainable convolutional kernels [2, 1].”
BackgroundMethodData augmentation importance for classification of skin lesions via deep learning
Ayan, E., & Ünver, H. M. (2018) · Electric Electronics, Computer Science, Biomedical Engineerings' Meeting (EBBT) · doi:10.1109/ebbt.2018.8391469 · Cited by 93
Gjoreski, M., Gams, M., Luštrek, M., Genc, P., Garbas, J.-U., & Hassan, T. (2020) · IEEE Access · doi:10.1109/access.2020.2986810 · Cited by 106
“DL represents a class of ML algorithms that use a cascade of multiple layers of nonlinear processing units, which are typically neurons [51].”
BackgroundA Deep-Learning-Based Framework for Automated Diagnosis of COVID-19 Using X-ray Images
Khan, I. U., & Aslam, N. (2020) · Information · doi:10.3390/info11090419 · Cited by 93
“It can be used for supervised, unsupervised, and semisupervised learning [23].”
BackgroundVision-Based Approaches for Automatic Food Recognition and Dietary Assessment: A Survey
Subhi, M. A., Ali, S. H. M., & Mohammed, M. A. (2019) · IEEE Access · doi:10.1109/access.2019.2904519 · Cited by 103
“become popular owing to its marginally exceptional performance with enhanced processing abilities, large datasets, and outstanding classification ability compared to other traditional methods [56], [57].”
BackgroundMa, R., Letu, H., Yang, K., Wang, T., Shi, C., Xu, J., Shi, J., Shi, C., & Chen, L. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2963262 · Cited by 96
“DNNs are considered nonlinear statistical data modeling tools where the complex relationships between inputs and outputs are modeled or patterns are found [43].”
BackgroundDeep learning techniques for rating prediction: a survey of the state-of-the-art
Khan, Z. Y., Niu, Z., Sandiwarno, S., & Prince, R. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-020-09892-9 · Cited by 103
Deep CNN and Deep GAN in Computational Visual Perception‐Driven Image Analysis
Abirami, R. N., Vincent, P. M. D. R., Srinivasan, K., Tariq, U., & Chang, C. (2021) · Complexity · doi:10.1155/2021/5541134 · Cited by 103
“Deep learning or hierarchical learning has emerged as a subfield of machine learning, which, in turn, is a subfield of artificial intelligence [43].”
BackgroundTalaat, F. M. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-12223-5 · Cited by 82
“It is applied in fields of object detection, classification, and speech recognition [6].”
MethodAn Attack Detection Framework Based on BERT and Deep Learning
Seyyar, Y. E., YAVUZ, A. G., & Ünver, H. M. (2022) · IEEE Access · doi:10.1109/access.2022.3185748 · Cited by 106
“DL can be defined as a class of ML techniques that uses a plurality of nonlinear hidden layers for feature extraction, transformation, pattern analysis, and classification [31].”
MethodCNID: Research of Network Intrusion Detection Based on Convolutional Neural Network
Liu, G., & Zhang, J. (2020) · Discrete Dynamics in Nature and Society · doi:10.1155/2020/4705982 · Cited by 111
“Convolutional neural networks are neural networks that use convolution operations in place of ordinary matrix multiplication operations in at least one layer of the network [28], as shown in Figure 5.”
MethodCustomized Inverse Design of Metamaterial Absorber Based on Target-Driven Deep Learning Method
Hou, J., Lin, H. L., Xu, W., Tian, Y., Wang, Y., Shi, X., Deng, F., & Chen, L. (2020) · IEEE Access · doi:10.1109/access.2020.3038933 · Cited by 94
“In the past few years, deep learning has shown advantages in a wide range of applications in different areas such as computer vision, natural language processing, speech recognition, and face recognition [33]–[35].”
BackgroundDetection and Classification of Different Weapon Types Using Deep Learning
Kaya, V., Tuncer, S., & Baran, A. (2021) · Applied Sciences · doi:10.3390/app11167535 · Cited by 97
“Deep learning is a sub-field of machine learning [9].”
CNN-Based Polarimetric Decomposition Feature Selection for PolSAR Image Classification
Yang, C., Hou, B., Ren, B., Hu, Y., & Jiao, L. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2922978 · Cited by 90
“In recent years, deep learning shows excellent performance in natural and PolSAR images classification [20]–[23], object detection [24]–[26], and natural language processing [27]–[29].”
BackgroundMachine learning for music genre: multifaceted review and experimentation with audioset
Castillo, J. R., & Flores, M. J. (2019) · Journal of Intelligent Information Systems · doi:10.1007/s10844-019-00582-9 · Cited by 103
Solar Wind Prediction Using Deep Learning
Upendran, V., Cheung, M. C. M., Hanasoge, S. M., & Krishnamurthi, G. (2020) · Space Weather · doi:10.1029/2020sw002478 · Cited by 90
Wheat ear counting using K-means clustering segmentation and convolutional neural network
Xu, X., Li, H., Yin, F., Xi, L., Qiao, H., Ma, Z., Shen, S., Jiang, B., & Ma, X. (2020) · Plant Methods · doi:10.1186/s13007-020-00648-8 · Cited by 90
“Deep learning allows the neural network to grasp data features by itself, providing a more abstract high-level representation by combining low-level features to describe the high-level attribute categories or features of the identified objects [32–35].”
BackgroundCAN-Bus Attack Detection With Deep Learning
Amato, F., Coppolino, L., Mercaldo, F., Moscato, F., Nardone, R., & Santone, A. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3046974 · Cited by 90
Depression diagnosis by deep learning using EEG signals: A systematic review
Safayari, A., & Bolhasani, H. (2021) · Medicine in Novel Technology and Devices · doi:10.1016/j.medntd.2021.100102 · Cited by 105
Integrating Scene Text and Visual Appearance for Fine-Grained Image Classification
Bai, X., Yang, M., Lyu, P., Xu, Y., & Luo, J. (2018) · IEEE Access · doi:10.1109/access.2018.2878899 · Cited by 95
Fast incremental method for smooth nonconvex optimization
Reddi, S. J., Sra, S., Póczos, B., & Smola, A. J. (2016) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2016.7798553 · Cited by 106
“Problems of the form (1) are of central importance in machine learning where they occur as instances of empirical risk minimization; well-known examples include logistic regression (convex) [10] and deep neural networks (nonconvex) [7].”
BackgroundDeep Learning Based on NASNet for Plant Disease Recognition Using Leave Images
Adedoja, A. O., Owolawi, P. A., & Mapayi, T. (2019) · International Conference on Artificial Intelligence, Big Data, Computing and Data Communication Systems (icABCD) · doi:10.1109/icabcd.2019.8851029 · Cited by 101
“Deep learning has been applied successfully in the field of computer vision and is commonly accepted in the community [20].”
BackgroundUsing LSTM recurrent neural networks for monitoring the LHC superconducting magnets
Wielgosz, M., Skoczeń, A., & Mertik, M. (2017) · Nuclear Instruments and Methods in Physics Research Section A Accelerators Spectrometers Detectors and Associated Equipment · doi:10.1016/j.nima.2017.06.020 · Cited by 102
“The neural nets are capable of capturing latent content of the modeled objects in large hierarchies [16–19].”
BackgroundAn Unsupervised Deep Hyperspectral Anomaly Detector
Ma, N., Peng, Y., Wang, S., & Leong, P. (2018) · Sensors · doi:10.3390/s18030693 · Cited by 88
Statistical workflow for feature selection in human metabolomics data
Antonelli, J., Claggett, B. L., Henglin, M., Kim, A., Ovsak, G., Kim, N., Deng, K., Rao, K., Tyagi, O., Watrous, J. D., et al. (2019) · Metabolites · doi:10.3390/metabo9070143 · Cited by 88
“Examples of commonly used approaches include support vector machines (SVM), neural networks, and the previously mentioned random forests [56,57].”
MethodAutomatic Pearl Classification Machine Based on a Multistream Convolutional Neural Network
Xuan, Q., Fang, B., Liu, Y., Wang, J., Zhang, J., Zheng, Y., & Bao, G. (2017) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2017.2784394 · Cited by 88
“Recently, deep learning [5] is becoming a hot topic in the area of machine learning, leading a series of breakthroughs in both academia and industry.”
BackgroundHeat transfer prediction of supercritical water with artificial neural networks
Chang, W., Chu, X., Fareed, A. F. B. S., Pandey, S., Luo, J., Weigand, B., & Laurien, E. (2017) · Applied Thermal Engineering · doi:10.1016/j.applthermaleng.2017.12.063 · Cited by 88
Enhancing Arabic aspect-based sentiment analysis using deep learning models
Al-Dabet, S., Tedmori, S., & AL-Smadi, M. (2021) · Computer Speech & Language · doi:10.1016/j.csl.2021.101224 · Cited by 93
Droplet based microfluidics integrated with machine learning
Srikanth, S., Dubey, S. K., Javed, A., & Goel, S. (2021) · Sensors and Actuators A Physical · doi:10.1016/j.sna.2021.113096 · Cited by 95
Denoising arterial spin labeling perfusion MRI with deep machine learning
Xie, D., Li, Y., Yang, H., Li, B., Wang, T., Zhou, F., Zhang, L., & Wang, Z. (2020) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2020.01.005 · Cited by 94
“Using a hierarchical multiple layers (deep) of “neurons” (the processing units) with a greedy layer-wise training, DL can reliably learn any nonlinear function from the sampled data [35] [37] [6] [19].”
BackgroundMethodDaas, S., Yahi, A., Bakir, T., Sedhane, M., Boughazi, M., & Bourennane, E. (2020) · IET Image Processing · doi:10.1049/iet-ipr.2020.0491 · Cited by 98
Lyu, P., Zhang, K., Yu, W., Wang, B., & Liu, C. (2022) · Advanced Engineering Informatics · doi:10.1016/j.aei.2022.101564 · Cited by 92
Abedi, H., Ansariyan, A., Morita, P. P., Wong, A. K. C., Boger, J. N., & Shaker, G. S. A. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3235268 · Cited by 94
“On the other hand, deep recurrent neural networks (DRNNs) have successfully addressed classification problems that feature temporal sequences [54].”
BackgroundMethodShallow and deep learning classifiers in medical image analysis
Prinzi, F., Currieri, T., Gaglio, S., & Vitabile, S. (2024) · European Radiology Experimental · doi:10.1186/s41747-024-00428-2 · Cited by 90
“DL algorithms are considered a specialization of ML [44], in which a substantial architectural difference is present: the depth.”
BackgroundReal-time, simultaneous myoelectric control using a convolutional neural network
Ameri, A., Akhaee, M. A., Scheme, E., & Englehart, K. B. (2018) · PLoS ONE · doi:10.1371/journal.pone.0203835 · Cited by 94
“Like other deep learning methods, CNNs are attractive as they can learn classification tasks directly from the raw data, eliminating the need for feature engineering and extraction [21].”
BackgroundShan, C., Weng, C., Wang, G., Su, D., Luo, M., Yu, D., & Xie, L. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682490 · Cited by 86
“A conventional NN based ASR system [1, 2, 3, 4, 5] includes several individual components such as acoustic model, lexicon and LM, etc.”
MethodSelf-citationDeep learning a boon for biophotonics?
Pradhan, P., Guo, S., Ryabchykov, O., Popp, J., & Bocklitz, T. W. (2020) · Journal of Biophotonics · doi:10.1002/jbio.201960186 · Cited by 91
Machine Learning and Deep Learning: Open Issues and Future Research Directions for the Next 10 Years
Pramod, A., Naicker, H. S., & Tyagi, A. K. (2021) · Computational Analysis and Deep Learning for Medical Care · doi:10.1002/9781119785750.ch18 · Cited by 85
An Automated Hyperparameter Search-Based Deep Learning Model for Highway Traffic Prediction
Yi, H., & Bui, K. N. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.2987614 · Cited by 85
Rousset, G., Despinoy, M., Schindler, K., & Mangeas, M. (2021) · Remote Sensing · doi:10.3390/rs13122257 · Cited by 93
“Among comparisons of methods to classify LULC from satellite images on several benchmark datasets, Deep Learning has recently stood out as a particularly effective framework for automatic image interpretation [12].”
BackgroundChemali, E., Kollmeyer, P. J., Preindl, M., Fahmy, Y., & Emadi, A. (2022) · Energies · doi:10.3390/en15031185 · Cited by 82
A multimodal convolutional neuro-fuzzy network for emotion understanding of movie clips
Nguyen, T.-L., Kavuri, S., & Lee, M. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.06.010 · Cited by 84
In Search of Big Medical Data Integration Solutions - A Comprehensive Survey
Dhayne, H., Haque, R., Kilany, R., & Taher, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2927491 · Cited by 84
A survey on hybrid human-artificial intelligence for autonomous driving
Ning, H., Yin, R., Ullah, A., & Shi, F. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3074695 · Cited by 84
“DNNs have strong fault tolerance, self-learning, and self-adaptation ability and can simulate complex nonlinear mapping, which meets the multisensor data fusion [121].”
BackgroundArtificial Neural Networks as Decision Support Tools in Cytopathology: Past, Present, and Future
Pouliakis, A., Karakitsou, E., Margari, N., Bountris, P., Haritou, M., Panayiotides, J. G., Koutsouris, D., & Karakitsos, P. (2016) · Biomedical Engineering and Computational Biology · doi:10.4137/becb.s31601 · Cited by 91
“, 119, Comparison of the performance of the applied techniques is not always feasible.”
BackgroundPart‐Based Mesh Segmentation: A Survey
Rodrigues, R. S. V., Morgado, J., & Gomes, A. J. P. (2018) · Computer Graphics Forum · doi:10.1111/cgf.13323 · Cited by 84
“Therefore, there is room to further develop supervised methods, as well as semi-supervised (SSV) methods; for example, using modern computational intelligence techniques like deep learning [DY14].”
MethodApplications of Machine Learning to Wind Engineering
Wu, T., & Snaiki, R. (2022) · Frontiers in Built Environment · doi:10.3389/fbuil.2022.811460 · Cited by 87
“Deepneural networks (DNN) are also a type of FFNN characterized by a deep architecture equipped with multiple layers, and hence allows for better generalization and accuracy (Deng and Yu 2014; Pouyanfar et al., 2018).”
BackgroundDeep Learning-Based Rumor Detection on Microblogging Platforms: A Systematic Review
Al-Sarem, M., Boulila, W., Harby, M. A., Qadir, J., & Alsaeedi, A. (2019) · IEEE Access · doi:10.1109/access.2019.2947855 · Cited by 90
“different levels of representation and abstraction to help to make sense of data Deng and Yu [15].”
BackgroundA Deep Learning Approach for Network Intrusion Detection Based on NSL-KDD Dataset
Zhang, C., Ruan, F., Yin, L., Chen, X., Zhai, L., & Liu, F. (2019) · IEEE International Conference on Anti-counterfeiting, Security, and Identification (ASID) · doi:10.1109/icasid.2019.8925239 · Cited by 93
Deep Learning on 1-D Biosignals: a Taxonomy-based Survey
Ganapathy, N., Swaminathan, R., & Deserno, T. (2018) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1667083 · Cited by 83
“with a minimized recognition error [11, 34].”
MethodClassification of Alcoholic EEG Signals Using a Deep Learning Method
Farsi, L., Siuly, S., Kabir, E., & Wang, H. (2020) · IEEE Sensors Journal · doi:10.1109/jsen.2020.3026830 · Cited by 83
“…machine learning methods consist of shallow architectures having at most one layer of non-liner feature transformation (e.g. SVMs use a shallow linear pattern separation model) [20], which requires more computational elements and hard to model complex concepts and multi-level abstractions.”
MethodA Review of Text-Based Recommendation Systems
Kanwal, S., Nawaz, S., Malik, M. K., & Nawaz, Z. (2021) · IEEE Access · doi:10.1109/access.2021.3059312 · Cited by 98
“Information processing tasks such as text analysis and speech recognition have acquired excellent efficiency due to deep learning or hierarchical neural networks [74].”
BackgroundDropout prediction in Moocs using deep learning and machine learning
Basnet, R. B., Johnson, C., & Doleck, T. (2022) · Education and Information Technologies · doi:10.1007/s10639-022-11068-7 · Cited by 91
“Deep learning has two distinct features: “(1) models consisting of multiple layers or stages of nonlinear information processing; and (2) methods for supervised or unsupervised learning of feature representation at successively higher, more abstract layers” (Deng & Yu, 2014, p. 201).”
MethodYu, L., Yousif, M. Z., Zhang, M., Hoyas, S., Vinuesa, R., & Lim, H.-C. (2022) · Physics of Fluids · doi:10.1063/5.0129203 · Cited by 83
Polarimetric Imaging via Deep Learning: A Review
Li, X., Yan, L., Qi, P., Zhang, L., Goudail, F., Liu, T., Zhai, J., & Hu, H. (2023) · Remote Sensing · doi:10.3390/rs15061540 · Cited by 87
Poznyak, A., Chaírez, I., & Poznyak, T. I. (2019) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2019.07.003 · Cited by 84
ResInNet: A Novel Deep Neural Network With Feature Reuse for Internet of Things
Sun, X., Gui, G., Li, Y., Liu, R. P., & An, Y. (2018) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2853663 · Cited by 86
“The hybrid deep neural network called DBN-DNN is one of the most outstanding deep learning architecture, proposed independently in the groundbreaking works of Hinton et al. [16]–[18] and Deng and Yu [19].”
MethodUnsupervised Seismic Random Noise Attenuation Based on Deep Convolutional Neural Network
Zhang, M., Liu, Y., & Chen, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2959238 · Cited by 85
“In order to solve above problems, we adopt the manner of unsupervised learning [51], [52] to construct deep CNN that can effectively attenuate random noise.”
BackgroundMethodLung Disease Classification using Deep Convolutional Neural Network
Tariq, Z., Shah, S. K., & Lee, Y. (2019) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm47256.2019.8983071 · Cited by 82
“These learning techniques are among the fastest-growing fields nowadays in the area of audio classification [7].”
BackgroundDeep Learning in Object Detection: a Review
Masita, K., Hasan, A. N., & Shongwe, T. (2020) · International Conference on Artificial Intelligence, Big Data, Computing and Data Communication Systems (icABCD) · doi:10.1109/icabcd49160.2020.9183866 · Cited by 93
Sorghum Panicle Detection and Counting Using Unmanned Aerial System Images and Deep Learning
Lin, Z., & Guo, W. (2020) · Frontiers in Plant Science · doi:10.3389/fpls.2020.534853 · Cited by 82
“Abundant training datasets are critical for effective deep learning tasks (Deng et al., 2014; LeCun et al., 2015), especially for complex computer vision tasks such as sorghum panicle detection and counting.”
BackgroundJafarian, T., Masdari, M., Ghaffari, A., & Majidzadeh, K. (2020) · Cluster Computing · doi:10.1007/s10586-020-03184-1 · Cited by 91
“Deep learning technique includes of an developing algo-rithm that is based on knowledge-based learning and key-words with respect to deep learning are as: artificial intelligence, unsupervised machine learning, and learning multiple layers [83, 84].”
MethodA comprehensive review of approaches to detect fatigue using machine learning techniques
Hooda, R., Joshi, V. S., & Shah, M. (2021) · Chronic Diseases and Translational Medicine · doi:10.1016/j.cdtm.2021.07.002 · Cited by 98
“These neural networks progressively extract high‐ level features from the input.(3) The most popular used DL algorithms are convolutional neural networks, generative adversarial networks, long short‐term memory, recurrent neural networks (RNNs), and so forth.”
MethodDeep Manifold Learning Combined With Convolutional Neural Networks for Action Recognition
Chen, X., Weng, J., Lu, W., Xu, J., & Weng, J. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2740318 · Cited by 87
“popular designs [42], such as stacked denoising, autoencoders, deep Boltzmann machine, and DBN.”
Zhang, L., Huang, J., & Liu, L. (2019) · Journal of Medical Systems · doi:10.1007/s10916-019-1356-8 · Cited by 80
“Deep neural network can classify images directly, but it does not take advantage of the low-level features of images [31].”
BackgroundRetractedAl-Asaly, M. S., Bencherif, M. A., Alsanad, A., & Hassan, M. M. (2021) · Neural Computing and Applications · doi:10.1007/s00521-021-06665-5 · Cited by 88
“Deep learning is part of machine learning (ML); it is an aspect of the modern generation of neural networks (NN), and it emerged as a concept from research on artificial neural networks (ANNs) [20].”
BackgroundSalinari, A., Machì, M., Armas Diaz, Y., Cianciosi, D., Qi, Z., Yang, B., Ferreiro Cotorruelo, M. S., Villar, S. G., Dzul Lopez, L. A., Battino, M., et al. (2023) · Diseases · doi:10.3390/diseases11030097 · Cited by 71
“For this reason, its fields of application are more complex and less used [28].”
BackgroundMultimodal deep representation learning for video classification
Tian, H., Tao, Y., Pouyanfar, S., Chen, S., & Shyu, M. (2018) · World Wide Web · doi:10.1007/s11280-018-0548-3 · Cited by 83
“Till now, deep neural networks, a major breakthrough in machine learning, have been directly used in many real-world applications such as autonomous vehicles, games, science, and even art [8, 11, 20].”
BackgroundWhispered speech recognition using deep denoising autoencoder
Grozdić, Đ., Jovičić, S. T., & Subotić, M. (2016) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2016.12.012 · Cited by 79
Automated Stoichiometry Analysis of Single-Molecule Fluorescence Imaging Traces via Deep Learning
Xu, J., Qin, G., Luo, F., Wang, L., Zhao, R., Li, N., Yuan, J., & Fang, X. (2019) · Journal of the American Chemical Society · doi:10.1021/jacs.9b00688 · Cited by 81
Using deep networks for fraud detection in the credit card transactions
Kazemi, Z., & Zarrabi, H. (2017) · International Conference on Knowledge-Based Engineering and Innovation · doi:10.1109/kbei.2017.8324876 · Cited by 93
“One of the most popular deep networks, emerge in autoencoders [3].”
BackgroundResultCustomer Perception Analysis Using Deep Learning and NLP
Ramaswamy, S., & DeClerck, N. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.10.326 · Cited by 70
Luo, S., & Weng, Y. (2019) · Applied Energy · doi:10.1016/j.apenergy.2019.03.129 · Cited by 78
Rachineni, K., Kakita, V. M. R., Awasthi, N. P., Shirke, V. S., Hosur, R. V., & Shukla, S. C. (2022) · Current Research in Food Science · doi:10.1016/j.crfs.2022.01.008 · Cited by 78
“The technical details of these logistic regression, DNN, and LGBM classification algorithms can be found in the given references (Juliana and William, 2016; Deng and Yu, 2014; Ke et al., 2017).”
Deep Learning and Machine Learning for Early Detection of Stroke and Haemorrhage
Al-Mekhlafi, Z. G., Senan, E. M., Rassem, T. H., Mohammed, B. A., Makbol, N. M., Alanazi, A., Almurayziq, T. S., & Ghaleb, F. A. A. (2022) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2022.024492 · Cited by 78
Onan, A. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120908 · Cited by 82
Neural networks with non-uniform embedding and explicit validation phase to assess Granger causality
Montalto, A., Stramaglia, S., Faes, L., Tessitore, G., Prevete, R., & Marinazzo, D. (2015) · Neural Networks · doi:10.1016/j.neunet.2015.08.003 · Cited by 78
Using Deep Learning for Energy Expenditure Estimation with wearable sensors
Zhu, J., Pande, A., Mohapatra, P., & Han, J. J. (2015) · 2015 17th International Conference on E-health Networking, Application & Services (HealthCom) · doi:10.1109/healthcom.2015.7454554 · Cited by 69
“Deep learning [11] is an emerging machine learning technique based on well developed concept of neural networks [12], augmented with series of improvements [13] in the structure and training of such networks.”
MethodA Brief Survey and an Application of Semantic Image Segmentation for Autonomous Driving
Kaymak, Ç., & Uçar, A. (2019) · Smart innovation, systems and technologies · doi:10.1007/978-3-030-11479-4_9 · Cited by 92
“Companies such as Google [15], Facebook [16], Microsoft [17] and Baidu [18] have realized the progress in deep learning and carried out studies on this topic with great investments.”
BackgroundEstimation of reservoir porosity based on seismic inversion results using deep learning methods
Feng, R. (2020) · Journal of Natural Gas Science and Engineering · doi:10.1016/j.jngse.2020.103270 · Cited by 77
Possible Applications of Edge Computing in the Manufacturing Industry—Systematic Literature Review
Kubiak, K., Dec, G. R., & Stadnicka, D. (2022) · Sensors · doi:10.3390/s22072445 · Cited by 89
“Each layer is taught to transform input into a more meaningful concept (e.g., pixels—edges—a shape—a flower) [34].”
BackgroundAutomated Detection and Characterization of Colon Cancer with Deep Convolutional Neural Networks
Hasan, M. I., Ali, M. S., Rahman, M. H., & Islam, M. K. (2022) · Journal of Healthcare Engineering · doi:10.1155/2022/5269913 · Cited by 89
“We applied some augmentation parameters with suited values after splitting the dataset into training, testing, and validation sets by rotating, random cropping, mirroring, and color-shifting [56]. factors we utilized to enrich our dataset are depicted in Table 2.”
MethodThakkar, A., & Lohiya, R. (2023) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-023-09943-8 · Cited by 85
“In [27], classification of DL techniques is presented that classifies DL techniques in three categories namely, generative, discriminative, and hybrid.”
MethodDigital Comics Image Indexing Based on Deep Learning
Nguyen, N.-V., Rigaud, C., & Burie, J.-C. (2018) · Journal of Imaging · doi:10.3390/jimaging4070089 · Cited by 91
“The learning process may be supervised or unsupervised, with the layers forming a hierarchy from low-level to high-level feature representations [56].”
BackgroundA Review of Artificial Intelligence Algorithms Used for Smart Machine Tools
Chang, C., Lee, H.-W., & Liu, C.-H. (2018) · Inventions · doi:10.3390/inventions3030041 · Cited by 88
“…a survey of transfer learning methods [46], the DL approach to tissue-regulated splicing code [47], the methods and applications of DL algorithms [48], the introduction of DL methods [49], a survey of the application of DL to machine health monitoring [50], an overview of DL approaches [51], an…”
MethodApplications of Machine Learning in Networking: A Survey of Current Issues and Future Challenges
Ridwan, M. A., Radzi, N. A. M., Abdullah, F., & Jalil, Y. E. (2021) · IEEE Access · doi:10.1109/access.2021.3069210 · Cited by 88
Coleman, G., Bender, A., Hu, K., Sharpe, S. M., Schumann, A. W., Wang, Z., Bagavathiannan, M., Boyd, N. S., & Walsh, M. (2022) · Weed Technology · doi:10.1017/wet.2022.84 · Cited by 81
Angle-Closure Detection in Anterior Segment OCT Based on Multilevel Deep Network
Fu, H., Xu, Y., Lin, S., Wong, D. W. K., Baskaran, M., Mahesh, M., Aung, T., & Liu, J. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2897162 · Cited by 80
“techniques have been shown to surpass the performance of handcrafted features in many areas [15]–[17].”
BackgroundDeep Learning Techniques for Cyber Security Intrusion Detection : A Detailed Analysis
Ferrag, M. A., Maglaras, L. A., Janicke, H., & Smith, R. (2019) · Electronic workshops in computing · doi:10.14236/ewic/icscsr19.16 · Cited by 78
“According to Deng and Yu (2014), deep learning techniques can be classified into two models, namely, 1) deep discriminative models and 2) generative/unsupervised models.”
BackgroundAdvanced Image Classification Using Wavelets and Convolutional Neural Networks
Williams, T. L., & Li, R. (2016) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2016.0046 · Cited by 87
“The result is the classification and organization of huge, messy, disorderly data, in speeds much faster than shallower forms of machine learning [2] [3].”
BackgroundFerreira, R., Sabbaghi, A., & Huang, Q. (2019) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2019.2936821 · Cited by 84
“NNs enjoy the ability to learn complex relationships across a wide range of domains [27], [28].”
BackgroundData-driven robotic visual grasping detection for unknown objects: A problem-oriented review
Tian, H., Song, K., Li, S., Ma, S., Xu, J. L., & Yan, Y. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118624 · Cited by 82
Survey on deep learning methods in human action recognition
Koohzadi, M., & Charkari, N. M. (2017) · IET Computer Vision · doi:10.1049/iet-cvi.2016.0355 · Cited by 80
“Some interesting approaches in deep learning have been studied in [21, 22].”
Background
Metadata
- Authors
- Deng, L., & Yu, D.
- Affiliations
- Microsoft (United States) (US)
- Venue
- Foundations and Trends® in Signal Processing
- Publisher
- Emerald
- Published
- 2014-06-30
- Volume
- 7
- Issue
- 3-4
- Pages
- 197-387
- ISSN
- 1932-8346 (ISSN-L)
- 1932-8354
- OpenAlex
- W4205947740
- Cited by
- 3,480
- References
- 21
- Citations by year
- 2026: 113 · 2025: 206 · 2024: 298 · 2023: 410 · 2022: 469 · 2021: 453 · 2020: 404 · 2019: 426 · 2018: 304 · 2017: 188 · 2016: 146 · 2015: 57 · 2014: 3
- FWCI
- 117.48
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Foundations and Trends® in Signal Processing (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- deep learning, signal processing, information processing, speech recognition, computer vision, natural language processing, text processing, information retrieval, multimodal information processing, multi-task learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.