Deep Learning: Methods and Applications
Open accessThe DOI matches its Crossref record; 28 of the 168 references it cites were found in a registry or an index, and 140 are not checked yet.
Abstract
This monograph provides an overview of general deep learning methodology and its applications to a variety of signal and information processing tasks. The application areas are chosen with the following three criteria in mind: (1) expertise or knowledge of the authors; (2) the application areas that have already been transformed by the successful use of deep learning technology, such as speech recognition and computer vision; and (3) the application areas that have the potential to be impacted significantly by deep learning and that have been experiencing research growth, including natural language and text processing, information retrieval, and multimodal information processing empowered by multi-task deep learning.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Deep learning is successfully used as a tool for machine learning, where a neural network is capable of automatically learning features.”
From Medical image analysis using convolutional neural networks: a review (2018) · cites this paper as [47]
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Self-citationLearning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239 · cited 6×
“Since 2006, deep structured learning, or more commonly called deep learning or hierarchical learning, has emerged as a new area of machine learning research [20, 163].”
BackgroundMethodInfluentialLearning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542 · cited 1×
“, speech or text), but until recently they had not been widely used partly because they are difficult to train to capture long-term dependencies, giving rise to gradient vanishing or gradient explosion problems which were known in early 1990s [29, 167].”
BackgroundWolpert, D. H. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80023-1 · Cited by 7,951
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878 · cited 1×
“[347] developed the recursive neural tensor network, where each layer is constructed similarly to that of the neural tensor network described in [340] with an illustration shown in Figure 8.”
MethodCaruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636 · cited 1×
“The several architectures discussed so far in this chapter for multimodal processing and learning can be regarded as special cases of more general multi-task learning and transfer learning [22, 47].”
Background
Research works printed but not linked: 276
- Abdel-Hamid, 2013, Proceedings of Interspeech,
- Abdel-Hamid, 2013, Proceedings of Interspeech.
- Abdel-Hamid, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Acero, 2000, Proceedings of Interspeech
- Alain, 2013, Proceedings of International Conference on Learning Representations (ICLR).
- Arisoy, 2012, Proceedings of the Joint Human Language Technology Conference and the North American Chapter of the Association of Computational Linguistics (HLT-NAACL) Workshop.
- Aslan, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Ba, 2013, Proceedings of Neural Information Processing Systems (NIPS
- Baldi, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- E. Battenberg , E.Schmidt, and J.Bello. Deep learning for music, special session at International Conference on Acoustics Speech and Signal Processing (ICASSP) (http://www.icassp2014.org/ special_sections.html#ss8), 2014.
- Batternberg, 2012, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Bell, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Bengio, 2008, Scholarpedia,
- Bengio, 2012, Deep learning of representations for unsupervised and transfer learning, Journal of Machine Learning Research Workshop and Conference Proceedings, 27, 17
- Bengio, 2013, Statistical Language and Speech Processing,, 1
- Bengio, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Bengio, 2000, Proceedings of Neural Information Processing Systems (NIPS
- Bengio, 2003, A neural probabilistic language model, Journal of Machine Learning Research,, 3, 1137
- Bengio, 2006, Proceedings of Neural Information Processing Systems (NIPS
- Bengio, 2013, Proceedings of International Conference on Machine Learning (ICML), 2014.
- Bengio, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Bergstra, 2012, Random search for hyper-parameter optimization, Journal on Machine Learning Research,, 3, 281
- Bilmes, 2010, Dynamic graphical models, IEEE Signal Processing Magazine,, 33, 29
- Bordes, 2013, Machine Learning,
- Bordes, 2011, Proceedings of Association for the Advancement of Artificial Intelligence (AAAI).
- Bottou, 2013, From machine learning to machine reasoning: An essay, Journal of Machine Learning Research,, 14, 3207
- Bottou, 2004, Proceedings of Neural Information Processing Systems (NIPS
- Boulanger-Lewandowski, 2012, Proceedings of International Conference on Machine Learning (ICML).
- Boulanger-Lewandowski, 2013, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Bourlard, 1993, Connectionist Speech Recognition: A Hybrid Approach.
- Breiman, 1996, Stacked regression, Machine Learning,, 24, 49, 10.1023/a:1018046112532 · doi:10.1023/a:1018046112532 · Paper page
- Cardinal, 2013, Large vocabulary speech recognition on parallel architectures, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 2290, 10.1109/tasl.2013.2271591 · doi:10.1109/tasl.2013.2271591
- Chen, 2014, Proceedings of International Conference on Learning Representations.
- Chen, 2012, Proceedings of Interspeech.
- Chengalvarayan, 1997, IEEE Transactions on Speech and Audio Processing, 243
- Chengalvarayan, 1997, IEEE Transactions on Speech and Audio Processing,, 232
- Chengalvarayan, 1998, Speech trajectory discrimination using the minimum classification error learning, IEEE Transactions on Speech and Audio Processing,, 6, 505, 10.1109/89.725317 · doi:10.1109/89.725317
- Cho, 2009, Proceedings of Neural Information Processing Systems (NIPS, 342
- Ciresan, 2012, Proceedings of Neural Information Processing Systems (NIPS
- Ciresan, 2010, Neural Computation
- Ciresan, 2011, Proceedings of International Joint Conference on Neural Networks (IJCNN).
- Ciresan, 2012, Proceedings of Computer Vision and Pattern Recognition (CVPR).
- Ciresan, 2012, Proceedings of International Joint Conference on Neural Networks (IJCNN).
- Coates, 2013, Proceedings of International Conference on Machine Learning (ICML).
- Cohen, 2005, Proceedings of International Joint Conference on Artificial Intelligence (IJCAI),, 671
- Collobert, 2011, Proceedings of Artificial Intelligence and Statistics (AISTATS
- Collobert, 2008, Proceedings of International Conference on Machine Learning (ICML).
- Collobert, 2011, Natural language processing (almost) from scratch, Journal on Machine Learning Research,, 12, 2493
- Dahl, 2010, Phone recognition with the mean-covariance restricted boltzmann machine, Proceedings of Neural Information Processing Systems (NIPS, 23, 469
- Dahl, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dahl, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dahl, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dean, 2012, Proceedings of Neural Information Processing Systems (NIPS
- Demuynck, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Deng, 1993, IEEE Transactions on Speech and Audio Processing, 471
- Deng, 2003, Mathematical Foundations of Speech and Language Processing,, 115
- Deng, 2011, Proceedings of Asian-Pacific Signal & Information Processing Annual Summit and Conference (APSIPA-ASC).
- Deng, 2012, The MNIST database of handwritten digit images for machine learning research, IEEE Signal Processing Magazine,, 29
- Deng, 2013, Neural Information Processing Systems (NIPS) Workshop on Learning Output Representations.
- Deng, 2013, Asian-Pacific Signal & Information Processing Association Transactions on Signal and Information Processing.
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2001, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2014, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 1992, Structural design of a hidden Markov model based speech recognizer using multi-valued phonetic features: Comparison with segmental speech units, Journal of the Acoustical Society of America,, 92, 3058, 10.1121/1.404202 · doi:10.1121/1.404202
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2004, Challenges in adopting speech recognition, Communications of the Association for Computing Machinery (ACM),, 47, 11
- Deng, 2012, Proceedings of Interspeech.
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2003, Speech Processing — A Dynamic and Optimization-Oriented Approach
- Deng, 1996, Transitional speech units and their representation by regressive Markov states: Applications to speech recognition, IEEE Transactions on speech and audio processing,, 4, 301, 10.1109/89.506934 · doi:10.1109/89.506934
- Deng, 2010, Proceedings of Interspeech.
- Deng, 2012, Proceedings of IEEE Workshop on Spoken Language Technologies
- Deng, 2002, Distributed speech processing in mipad’s multimodal user interface, IEEE Transactions on Speech and Audio Processing,, 10, 605, 10.1109/tsa.2002.804538 · doi:10.1109/tsa.2002.804538
- Deng, 2005, Dynamic compensation of HMM variances using the feature enhancement uncertainty computed from a parametric model of speech distortion, IEEE Transactions on Speech and Audio Processing,, 13, 412, 10.1109/tsa.2005.845814 · doi:10.1109/tsa.2005.845814
- Deng, 2007, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2011, Proceedings of Interspeech.
- Deng, 2009, Neural Information Processing Systems (NIPS) Workshop
- Deng, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deselaers, 2009, Proceedings of 4th Workshop on Statistical Machine Translation,, 233
- Dognin, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Erhan, Journal on Machine Learning Research,, 201
- Fernandez, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 6885
- Fine, 1998, Machine Learning, 41
- Frome, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Fu, 2007, Proceedings of Interspeech
- Gales, 2011, Robust Speech Recognition of Uncertain or Missing Data: Theory and Application, 101, 10.1007/978-3-642-21317-5_5 · doi:10.1007/978-3-642-21317-5_5
- Gao, 2010, Proceedings of Conference on Information and Knowledge Management (CIKM).
- Gao, 2013, Proceedings of Neural Information Processing Systems (NIPS) Workshop on Deep Learning
- Gao, 2014, Proceedings of Association for Computational Linguistics (ACL).
- Gao, 2011, Proceedings of Special Interest Group on Information Retrieval (SIGIR).
- Gens, 2012, Neural Information Processing Systems (NIPS),
- Gibson, 2010, Error approximation and minimum phone error acoustic model estimation, IEEE Transactions on Audio, Speech, and Language Processing,, 18, 1269, 10.1109/tasl.2009.2032607 · DOI
- Glorot, 2010, Proceedings of Artificial Intelligence and Statistics (AISTATS).
- Glorot, 2011, Proceedings of Artificial Intelligence and Statistics (AIS-TATS
- Goodfellow, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Graves, 2012, Representation Learning Workshop, International Conference on Machine Learning (ICML),
- Graves, 2006, Proceedings of International Conference on Machine Learning (ICML).
- Graves, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Graves, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Grezl, 2008, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Gutmann, 2012, Noise-contrastive estimation of unnormalized statistical models, with applications to natural image statistics, Journal of Machine Learning Research,, 13, 307
- Hain, 2012, IEEE Transactions on Audio, Speech, and Language Processing,, 486
- Hamel, 2010, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Hawkins, 2004, On Intelligence: How a New Understanding of the Brain will lead to the Creation of Truly Intelligent Machines
- He, 2011, IEEE Signal Processing Magazine,
- He, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- He, 2013, Proceedings of the IEEE.
- Heigold, 2013, Investigations on an EM-style optimization algorithm for discriminative training of HMMs, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 2616, 10.1109/tasl.2013.2280234 · doi:10.1109/tasl.2013.2280234
- Heigold, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Heintz, 2009, Discriminative input stream combination for conditional random field phone recognition, IEEE Transactions on Audio, Speech, and Language Processing,, 17, 1533, 10.1109/tasl.2009.2022204 · doi:10.1109/tasl.2009.2022204
- Henderson, 2013, Proceedings of Special Interest Group on Disclosure and Dialogue (SIGDIAL).
- Hermans, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Hermansky, 2000, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Hinton, 1990, Artificial Intelligence,, 1
- Hinton, 2003, Canadian Psychology,, 10
- Hinton, 2011, A better way to learn features, Communications of the Association for Computing Machinery (ACM),, 54
- Hinton, 2006, Neural Computation,, 1527
- Hinton, 2010, Topics in Cognitive Science,, 1
- Huang, 2012, Proceedings of Association for Computational Linguistics (ACL).
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Association for Computing Machinery (ACM) International Conference Information and Knowledge Management (CIKM),
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2001, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Proceedings of Interspeech,, 2360
- Humphrey, 2012, Proceedings of International Conference on Machine Learning and Application (ICMLA).
- Humphrey, 2012, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Humphrey, 2013, Journal of Intelligent Information Systems,
- Hutchinson, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Hutchinson, 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence,, 1944
- Imseng, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Jaitly, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Jaitly, 2012, Proceedings of Interspeech.
- Jarrett, 2009, Proceedings of International Conference on Computer Vision,, 2146
- Kahou, 2013, Proceedings of International Conference on Multimodal Interaction (ICMI).
- Kang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 8012
- Kashiwagi, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Kavukcuoglu, 2010, Proceedings of Neural Information Processing Systems (NIPS
- Ketabdar, 2010, IEEE Transactions on Audio, Speech, and Language Processing,, 1094
- Kingsbury, 2009, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Kingsbury, 2012, Proceedings of Interspeech.
- Kiros, 2013, Proceedings of Neural Information Processing Systems (NIPS) Deep Learning Workshop.
- Ko, 2013, IEEE Transactions on Audio, Speech, and Language Processing, 1285
- Krizhevsky, 2012, Proceedings of Neural Information Processing Systems (NIPS).
- Kubo, 2012, Proceedings of Interspeech.
- Kurzweil, 2012, How to Create a Mind.
- Lal, 2013, IEEE Transactions on Audio, Speech, and Language Processing,, 2506
- Larochelle, 2008, Proceedings of International Conference on Machine Learning (ICML).
- Le, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Le, 2010, Proceedings of Empirical Methods in Natural Language Processing (EMNLP, 778
- Le, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Le, 2013, IEEE Transactions on Audio, Speech, and Language Processing, 197
- Le, 2011, Proceedings of International Conference on Machine Learning (ICML).
- Le, 2012, Proceedings of International Conference on Machine Learning (ICML).
- LeCun, 2012, Proceedings of European Conference on Computer Vision (ECCV).
- LeCun, 1995, The Handbook of Brain Theory and Neural Networks,, 255
- LeCun, 1998, Proceedings of the IEEE,, 2278
- LeCun, 2007, Proceedings of International Conference on Document Analysis and Recognition (ICDAR).
- Lee, 2004, Proceedings of International Conference on Spoken Language Processing (ICSLP),, 109
- Lee, 2009, Proceedings of International Conference on Machine Learning (ICML).
- Lee, 2011, Communications of the Association for Computing Machinery (ACM),, 95
- Lee, 2010, Proceedings of Neural Information Processing Systems (NIPS
- Lena, 2012, Proceedings of Neural Information Processing Systems (NIPS).
- Li, 2014, IEEE/Association for Computing Machinery (ACM) Transactions on Audio, Speech, and Language Processing, 1
- Li, 2012, Proceedings of IEEE Spoken Language Technology (SLT
- Li, 2013, Proceedings Conference on Affective Computing and Intelligent Interaction (ACII),, 312
- Liao, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Liao, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Lin, 2009, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Lin, 2011, Proceedings of Computer Vision and Pattern Recognition (CVPR
- Ling, 2013, Modeling spectral envelopes using restricted boltzmann machines for statistical parametric speech synthesis, International Conference on Acoustics Speech and Signal Processing (ICASSP),, 7825
- Ling, 2013, Articulatory control of HMM-based parametric speech synthesis using feature-space-switched multiple regression
- Lu, 2013, Joint uncertainty decoding for noise robust subspace gaussian mixture models, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 1791, 10.1109/tasl.2013.2248718 · doi:10.1109/tasl.2013.2248718
- Ma, 2000, Computer, Speech and Language
- Maas, 2013, Rectifier nonlinearities improve neural network acoustic models
- Manning, 2009, Introduction to Information Retrieval.
- J.Markoff, 2012, Scientists see promise in deep-learning programs
- Martens, 2010, Deep learning with hessian-free optimization
- Martens, 2011, Learning recurrent neural networks with hessian-free optimization
- McGraw, 2013, Learning lexicons from speech using a pronunciation mixture model, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 357, 10.1109/tasl.2012.2226158 · DOI
- Mikolov, 2013, Efficient estimation of word representations in vector space
- Mikolov, 2010, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 1045
- Mikolov, 2013, Distributed representations of words and phrases and their compositionality
- Minami, 2002, A recognition method with parametric trajectory synthesized using direct relations between static and dynamic feature vector time series, 957
- Mnih, 2008, A scalable hierarchical distributed language model, 1081
- Mnih, 2013, Learning word embeddings efficiently with noise-contrastive estimation
- Mnih, 2013, laying arari with deep reinforcement learning
- Mohamed, 2009, Deep belief networks for phone recognition
- Morin, 2005, Hierarchical probabilistic neural network language models
- Murphy, 2012, Machine Learning
- Nair, 2009, 3-d object recognition with deep belief nets
- Ngiam, 2011, Learning deep energy models
- Ngiam, 2011, Multimodal deep learning
- Olshausen, 2012, Can ‘deep learning’ offer deep insights about visual representation?
- Ostendorf, 1999, Moving beyond the ‘beads-on-a-string’ model of speech
- Oudre, 2011, Probabilistic template-based chord recognition, IEEE Transactions on Audio, Speech, and Language Processing, 19, 2249, 10.1109/tasl.2010.2098870 · doi:10.1109/tasl.2010.2098870
- Palangi, 2013, Learning input and recurrent weight matrices in echo state networks
- Palangi, 2013, Using deep stacking network to improve structured compressive sensing with multiple measurement vectors
- Pascanu, 2014, How to construct deep recurrent neural networks
200 of 276 shown
Cited by
Items 801–900 of 1,005
Quantum Information-Empowered Graph Neural Network for Hyperspectral Change Detection
Lin, C.-H., Lin, T.-H., & Chanussot, J. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3490703 · Cited by 43
“With the development of deep learning (DL), convolutional neural networks (CNNs) have demonstrated remarkable success across diverse domains, revolutionizing numerous fields of study and application [19], [20].”
Hassanpour, S., Bay, G., & Langlotz, C. (2017) · Journal of digital imaging · doi:10.1007/s10278-016-9931-8 · Cited by 45
Optimal Predictive analytics of Pima Diabetics using Deep Learning
Balaji, H., Iyengar, N. C. S. N., & Caytiles, R. D. (2017) · International Journal of Database Theory and Application · doi:10.14257/ijdta.2017.10.9.05 · Cited by 43
Janik, M., Bossew, P., & Kurihara, O. (2018) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2018.02.233 · Cited by 46
Automatic knowledge extraction of any Chatbot from conversation
Arsovski, S., Osipyan, H., Muniru, I. O., & Cheok, A. D. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.07.014 · Cited by 43
Nanehkaran, Y. A., Zhang, D., Salimi, S., Chen, J., Tian, Y., & Al-Nabhan, N. (2020) · The Journal of Supercomputing · doi:10.1007/s11227-020-03388-7 · Cited by 43
Burggräf, P., Wagner, J., & Heinbach, B. (2021) · IEEE Access · doi:10.1109/access.2021.3054563 · Cited by 49
“In addition to those three, Deep Learning (DL), uses multiple layers to progressively extract higher-level features from raw input data [38], typically using Neural Network architectures with a signifi-cant amount of hidden layers.”
BackgroundAdaptive, Hybrid Feature Selection (AHFS)
Viharos, Z. J., Kis, K. B., Fodor, Á., & Büki, M. I. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.107932 · Cited by 43
Lops, Y., Pouyaei, A., Choi, Y., Jung, J., Salman, A. K., & Sayeed, A. (2021) · Geophysical Research Letters · doi:10.1029/2021gl093096 · Cited by 44
“The latter (LeCun et al., 2015) shows significant promise in addressing the limitations of missing data by modeling high-level abstractions within data sets (Bengio, 2009; Deng & Yu, 2014).”
BackgroundEgger, J., Pepe, A., Gsaxner, C., Jin, Y., Li, J., & Kern, R. (2021) · PeerJ Computer Science · doi:10.7717/peerj-cs.773 · Cited by 52
Atasoy, V. E., Süzer, A. E., & Ekici, S. (2021) · Journal of Energy Resources Technology · doi:10.1115/1.4052771 · Cited by 43
Using artificial intelligence in digital video production: A systematic review study
Orak, C., & Turan, Z. (2024) · Journal of Educational Technology and Online Learning · doi:10.31681/jetol.1459434 · Cited by 44
“It is frequently used in areas such as information retrieval, object recognition and computer vision, multi-model and multi-task learning, visual perception, speech and voice recognition (Deng & Yu, 2014).”
Robust ASR using neural network based speech enhancement and feature simulation
Sivasankaran, S., Nugraha, A. A., Emmanuel Vincent, A., Morales-Cordovilla, J. A., Dalmia, S., Illina, I., & Antoine Liutkus, A. (2015) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2015.7404834 · Cited by 42
“More recently, deep neural networks (DNNs) [7] have been applied to single-channel speech enhancement and source separation and shown to provide a significant increase in ASR performance compared to these earlier approaches [8].”
Xiao, W., Wang, Q., Pan, F., Cao, R., Wu, X., & Sun, L. (2019) · Biomedical Optics Express · doi:10.1364/boe.10.001613 · Cited by 42
“The training algorithm is performed by iterating the process of feeding the frequency spectrum in batches through the net model and using an optimizer to minimize the error between the output produced by the system and the label [33].”
MethodPulgar, F. J., Charte, F., Rivera, A. J., & del Jesús, M. J. (2019) · Information Fusion · doi:10.1016/j.inffus.2019.07.004 · Cited by 43
Prediction of Customer Churn Using Machine Learning
Momin, S., Bohra, T., & Raut, P. (2019) · EAI/Springer Innovations in Communication and Computing · doi:10.1007/978-3-030-19562-5_20 · Cited by 51
Differential Channel-State-Information-Based Human Activity Recognition in IoT Networks
Khan, P., Reddy, B. S. K., Pandey, A., Kumar, S., & Youssef, M. A. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2997237 · Cited by 45
“Batchnorm is used as a regularization technique as it seems to outperform dropout regularization [44].”
BackgroundMethodIoT Attack Detection with Deep Learning Analysis
Pecori, R., Tayebi, A., Vannucci, A., & Veltri, L. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207171 · Cited by 42
“Deep Learning (DL) regards a particular branch of machine learning, encompassing techniques that allow the simulation of information processing typical of biological nervous systems [10].”
BackgroundFuzzy deep learning based urban traffic incident detection
Hatri, C. E., & Boumhidi, J. (2017) · International Conference on Intelligent Systems and Computer Vision (ISCV) · doi:10.1109/isacv.2017.8054903 · Cited by 42
Hourly and Daily PM 2.5 Estimations Using MERRA‐2: A Machine Learning Approach
Sayeed, A., Lin, P., Gupta, P., Tran, N. N. M., Buchard, V., & Christopher, S. A. (2022) · Earth and Space Science · doi:10.1029/2022ea002375 · Cited by 41
“Deep learning models (Y. LeCun et al., 2015) such as convolutional neural networks (CNN) show significant promise in addressing the limitations of missing data by modeling high-level abstractions within datasets (Bengio, 2009; Deng, 2014).”
BackgroundA Deep-Neuro-Fuzzy approach for estimating the interaction forces in Robotic surgery
Avilés-Rivero, A. I., Alsaleh, S. M., Montseny, E., Sobrevilla, P., & Casals, A. (2016) · IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) · doi:10.1109/fuzz-ieee.2016.7737812 · Cited by 41
“Moreover, it was motivated by the fact that the human information processing mechanisms (including vision and audition) need deep architecture for extracting complex structures [5].”
BackgroundDeepFense: online accelerated defense against adversarial deep learning
Rouhani, B. D., Samragh, M., Javaheripi, M., Javidi, T., & Koushanfar, F. (2018) · doi:10.1145/3240765.3240791 · Cited by 44
“ass of machine learning algorithms that has provided a paradigm shift in our ability to comprehend raw data by showing superb inference accuracy resembling the learning capability of human brain [2], [3]. A DL network is a hierarchical learning topology consisting of several processing layers stacked on top of one ano…”
BackgroundDeep Belief Network for Meteorological Time Series Prediction in the Internet of Things
Cheng, Y. J., Zhou, X., Wan, S., & Choo, K. R. (2018) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2878477 · Cited by 44
Exploring deep learning capabilities in knee osteoarthritis case study for classification
Christodoulou, E., Moustakidis, S., Papandrianos, N. I., Tsaopoulos, D. E., & Papageorgiou, E. I. (2019) · International Conference on Information, Intelligence, Systems & Applications (IISA) · doi:10.1109/iisa.2019.8900714 · Cited by 46
“subspace where the problem to be linearly separable [25].”
BackgroundTemporal Convolutional Neural Networks for Radar Micro-Doppler Based Gait Recognition
Addabbo, P., Bernardi, M. L., Biondi, F., Cimitile, M., Clemente, C., & Orlando, D. (2021) · Sensors · doi:10.3390/s21020381 · Cited by 46
“DL, taking inspiration by the way information is processed in biological nervous systems and their neurons, represent the data hierarchically, through several levels of abstraction corresponding to various artificial perceptrons [17].”
BackgroundWeb-Based Music Genre Classification for Timeline Song Visualization and Analysis
Castillo, J. R., & Flores, M. J. (2021) · IEEE Access · doi:10.1109/access.2021.3053864 · Cited by 43
“FCNNs have been used in problems related to audio or music [22] and there is a belief that related MIR problems still have room for improvement with the potential of deep learning [23].”
MethodMekruksavanich, S., Jantawong, P., Charoenphol, A., & Jitpattanakul, A. (2021) · International Computer Science and Engineering Conference · doi:10.1109/icsec53205.2021.9684626 · Cited by 42
“Deep learning approaches have been utilized more successfully in the past several years for fall recognition [13] than other approaches such as threshold-based algorithms [14], [15].”
MethodZavrak, S., & İskefiyeli, M. (2023) · Neural Computing and Applications · doi:10.1007/s00521-023-08376-5 · Cited by 41
“RNNs are neural networks and are specific examples of AEs [47] originally proposed as a compression technique [48].”
Deep Learning Approach to DGA Classification for Effective Cyber Security
Karunakaran, P. (2021) · Journal of Ubiquitous Computing and Communication Technologies · doi:10.36548/jucct.2020.4.003 · Cited by 40
“Another DGA srizbi is used data transformation using exclusive or (EX-OR) operation [8, 9, 10].”
MethodExplaining predictions and attacks in federated learning via random forests
Haffar, R., Sánchez, D., & Domingo‐Ferrer, J. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03435-1 · Cited by 44
“Deep learning (DL) models are the cornerstone of many modern AI systems due to their ability to solve many complex tasks such as computer vision, natural language processing or speech recognition [1, 2].”
BackgroundDiagnosis of Acanthamoeba Keratitis: Past, Present and Future
Azzopardi, M., Chong, Y. J., Ng, B., Recchioni, A., Logeswaran, A., & Ting, D. S. J. (2023) · Diagnostics · doi:10.3390/diagnostics13162655 · Cited by 49
Inverse Problems in Geodynamics Using Machine Learning Algorithms
Shahnas, M. H., Yuen, D. A., & Pysklywec, R. N. (2018) · Journal of Geophysical Research Solid Earth · doi:10.1002/2017jb014846 · Cited by 45
“…in model parameters in mantle convection we maintain that machine learning is a promising fi rst step, before advancing into deep learning (Deng & Yu, 2014; Goodfellow et al., 2017), where the complexity of the problem and accuracy would demand more levels of neural networks and enhanced…”
BackgroundA survey on leveraging deep neural networks for object tracking
Krebs, S., Duraisamy, B., & Flohr, F. B. (2017) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2017.8317904 · Cited by 42
A new deep belief network based on RBM with glial chains
Geng, Z., Li, Z., & Han, Y. M. (2018) · Information Sciences · doi:10.1016/j.ins.2018.06.043 · Cited by 41
Deep Neural Network Hardware Implementation Based on Stacked Sparse Autoencoder
Coutinho, M. G. F., Torquato, M. F., & Fernandes, M. A. C. (2019) · IEEE Access · doi:10.1109/access.2019.2907261 · Cited by 42
Han, H., Soylu, F., & Anchan, M. (2019) · Trends in Neuroscience and Education · doi:10.1016/j.tine.2019.100113 · Cited by 47
“Particularly, simulation 680 methods based on evolutionary modeling [96] and deep learning [97] might be feasible 681 methodologies to conduct such predictions.”
MethodMedeiros, D. S. V., Neto, H. N. C., Lopez, M. A., Magalhães, L., Fernandes, N. C., Vieira, A. B., Silva, E. F., & Mattos, D. M. F. (2020) · Journal of Internet Services and Applications · doi:10.1186/s13174-020-00127-2 · Cited by 46
Joseph, S., & George, J. P. (2020) · IEEE International Conference on Signal and Image Processing (ICSIP) · doi:10.1109/icsip49896.2020.9339435 · Cited by 40
“Deep learning, which was first presented by Geoffrey Hinton et al. [17,18], is greatly explored in various pattern recognition tasks, including character recognition [19–21].”
BackgroundClassification of Canine Maturity and Bone Fracture Time Based on X-Ray Images of Long Bones
Ergün, G. B., & Güney, S. (2021) · IEEE Access · doi:10.1109/access.2021.3101040 · Cited by 40
“In recent years, many fields of study, particularly biomedicine, have been positively affected by the phenomenon of deep learning [1].”
BackgroundMulti-scale residual network model combined with Global Average Pooling for action recognition
Li, J., Yu, H., Zhang, M., Li, G., & Zhang, B. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-021-11435-5 · Cited by 44
Cancer diagnosis using artificial intelligence: a review
Shastry, K. A., & Sanjay, H. A. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-021-10074-4 · Cited by 47
“1 (Deng et al. 2014; LeCun et al. 2015).”
Adversarial Perturbation Defense on Deep Neural Networks
Zhang, X., Zheng, X., & Mao, W. (2021) · ACM Computing Surveys · doi:10.1145/3465397 · Cited by 60
“By functionally mimicking the human neocortex, the DNN is constructed with numerous fully connected neurons combined with nonlinear activations [1].”
BackgroundMethodA comprehensive survey on computational learning methods for analysis of gene expression data
Bhandari, N., Walambe, R. A., Kotecha, K. V., & Khare, S. (2022) · Frontiers in Molecular Biosciences · doi:10.3389/fmolb.2022.907150 · Cited by 47
“Recent advancement in the ML domain is deep learning (DL) which is based on artificial neural networks (ANN) (Deng and Yu, 2014; LeCun, Bengio and Hinton, 2015).”
BackgroundInfluentialSpeech emotion recognition using the novel PEmoNet (Parallel Emotion Network)
Bhangale, K. B., & Kothandaraman, M. (2023) · Applied Acoustics · doi:10.1016/j.apacoust.2023.109613 · Cited by 43
Bhangale, K. B., & Kothandaraman, M. (2023) · Circuits Systems and Signal Processing · doi:10.1007/s00034-023-02562-5 · Cited by 40
“However,itisimportanttoselectthespeechdescriptorthatprovidesdistinctive features,betterspectralrepresentation,localandglobalattributesofthespeechsignal [13,52].”
A Comprehensive Review of Processing-in-Memory Architectures for Deep Neural Networks
Kaur, R., Asad, A., & Mohammadi, F. (2024) · Computers · doi:10.3390/computers13070174 · Cited by 39
“It explores the challenges faced by monolithic chip architectures and highlights the potential of chiplet-based designs in addressing these challenges [34–42].”
BackgroundRecent Advances in Deep Learning for Channel Coding: A Survey
Matsumine, T., & Ochiai, H. (2024) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2024.3472094 · Cited by 44
“For details on the theory of general DL techniques, please refer, e.g., to [91]–[100].”
Neural Semantic Personalized Ranking for item cold-start recommendation
Ebesu, T., & Fang, Y. (2017) · Information Retrieval · doi:10.1007/s10791-017-9295-9 · Cited by 45
“On the other hand, deep learning models recently demonstrated great success for learning effective representations in various applications including computer vision, speech recognition, and natural language processing (Deng and Yu 2014; LeCun et al. 2015).”
BackgroundBaby Cry Sound Detection: A Comparison of Hand Crafted Features and Deep Learning Approach
Torres, R., Battaglino, D., & Lepauloux, L. (2017) · Communications in computer and information science · doi:10.1007/978-3-319-65172-9_15 · Cited by 39
“Although primarily designed for image classification tasks, CNNs have proven to be successful in speech and music recognition [11].”
BackgroundTargeting Virus-host Protein Interactions: Feature Extraction and Machine Learning Approaches
Zheng, N., Wang, K., Zhan, W., & Deng, L. (2018) · Current Drug Metabolism · doi:10.2174/1389200219666180829121038 · Cited by 39
Self-citationŻabiński, T., Mączka, T., Kluska, J., Madera, M., & Sęp, J. (2019) · Procedia CIRP · doi:10.1016/j.procir.2019.02.012 · Cited by 39
Eye movement behavior identification for Alzheimer’s disease diagnosis
Biondi, J. A., Fernández, G., Castro, S. M., & Agamennoni, O. E. (2018) · Journal of Integrative Neuroscience · doi:10.31083/j.jin.2018.04.0416 · Cited by 40
“Since the popularization of deep-learning neural networks [14, 15], much effort has been directed to their use in medicine.”
BackgroundMAVNet: An Effective Semantic Segmentation Micro-Network for MAV-Based Tasks
Nguyen, T., Wozencraft, J. M., Taylor, C. J., Kumar, V., Shivakumar, S. S., Miller, I. D., Keller, J. F., Lee, E. S., Zhou, A., Özaslan, T., et al. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2928734 · Cited by 46
“In the field of semantic segmentation, deep learning has become the de-facto approach with superior accuracy and robustness over classical machine learning approaches [3], [4].”
BackgroundFull training convolutional neural network for ECG signals classification
Karboub, K., Tabaa, M., Dellagi, S., Dandache, A., & Moutaouakkil, F. (2019) · AIP conference proceedings · doi:10.1063/1.5138541 · Cited by 44
Deep learning in gastric tissue diseases: a systematic review
Gonçalves, W. G. E., Santos, M. H. P. D., Lobato, F. M. F., Ribeiro‐dos‐Santos, Â., & de Araújo, G. S. (2020) · BMJ Open Gastroenterology · doi:10.1136/bmjgast-2019-000371 · Cited by 42
Keystroke Dynamics Based User Authentication using Deep Multilayer Perceptron
Andrean, A., Jayabalan, M., & Thiruchelvam, V. (2020) · International Journal of Machine Learning and Computing · doi:10.18178/ijmlc.2020.10.1.910 · Cited by 39
“This is possible due to its multi-level structure, and sparsity characteristic of the architecture which increases the representation efficiency by only utilizing up to 4% of the neurons [18].”
BackgroundKesse, M. A., Buah, E., Handroos, H., & Ayetor, G. K. (2020) · Metals · doi:10.3390/met10040451 · Cited by 39
Sbahi, S., Ouazzani, N., Latrach, L., Hejjaj, A., & Mandi, L. (2020) · Ecotoxicology and Environmental Safety · doi:10.1016/j.ecoenv.2020.111118 · Cited by 39
Spectrum-Sharing UAV-Assisted Mission-Critical Communication: Learning-Aided Real-Time Optimisation
Nguyen, M.-H. T., Garcia‐Palacios, E., Do‐Duy, T., Nguyen, L. D., Mai, S. T., & Duong, T. Q. (2021) · IEEE Access · doi:10.1109/access.2021.3050522 · Cited by 39
“In this regard, DNN [23], [24] is an efficient machine learning approach that can be applied in real-time optimisation methods.”
MethodHuang, Z., Yang, C., Chen, X., Zhou, X., Chen, G., Huang, T., & Gui, W. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107314 · Cited by 39
Effective Connectivity in Default Mode Network for Alcoholism Diagnosis
Khan, D. M., Yahya, N., Kamel, N., & Faye, I. (2021) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2021.3075737 · Cited by 43
“Considering the shallow architecture of machine learning with at most a single non-linear feature transformation layer [90], these architectures mostly fail to identify abnormal data points that are present under deep hidden layers [38].”
BackgroundSingh, N., Ansari, M. A., Tripathy, M., & Singh, V. P. (2021) · IETE Journal of Research · doi:10.1080/03772063.2021.1920849 · Cited by 39
“[57].”
Orbital angular momentum optical communications enhanced by artificial intelligence
Li, B., Luan, H., Li, K., Chen, Q., Meng, W., Cheng, K., Gu, M., & Fang, X. (2022) · Journal of Optics · doi:10.1088/2040-8986/ac8108 · Cited by 42
Colon cancer stage detection in colonoscopy images using YOLOv3 MSF deep learning architecture
Murugesan, M., Arieth, R. M., Shankarlal, B., & Nirmala, R. (2022) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2022.104283 · Cited by 41
Artificial Intelligence, Big Data, and Machine Learning in Industry 4.0
Λαμπρόπουλος, Γ. (2023) · IGI Global eBooks · doi:10.4018/978-1-7998-9220-5.ch125 · Cited by 49
Sasdelli, M., Ishida, É. E. O., Vilalta, R., Aguena, M., Busti, V. C., Camacho, H., Trindade, A. M. M., Gieseke, F. C., de Souza, R. S., Fantaye, Y. T., et al. (2016) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stw1228 · Cited by 43
Traffic Matrix Prediction and Estimation Based on Deep Learning for Data Center Networks
Nie, L., Jiang, D., Guo, L., Yu, S., & Song, H. (2016) · IEEE Globecom Workshops (GC Wkshps) · doi:10.1109/glocomw.2016.7849067 · Cited by 38
“(3) where I and J are the numbers of visible and hidden units, respectively [17].”
BackgroundInfluentialA Stochastic Semismooth Newton Method for Nonsmooth Nonconvex Optimization
Milzarek, A., Xiao, X., Cen, S., Wen, Z., & Ulbrich, M. (2019) · SIAM Journal on Optimization · doi:10.1137/18m1181249 · Cited by 38
“Moreover, in various interesting problems such as deep learning, dictionary learning, training of neural networks, and classification tasks with nonconvex activation functions, [49, 48, 8, 23, 42, 73, 33], the loss function f is nonconvex, which represents another major challenge for stochastic optimization approaches.”
BackgroundUsing Metaheuristics for Hyper-Parameter Optimization of Convolutional Neural Networks
Bibaeva, V. (2018) · Machine learning for signal processing ... · doi:10.1109/mlsp.2018.8516989 · Cited by 39
“As stated in [1, 11], more research is needed to find new approaches suitable for deeper models.”
BackgroundAudio IoT Analytics for Home Automation Safety
Shah, S. K., Tariq, Z., & Lee, Y. (2018) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2018.8622587 · Cited by 38
“These learning techniques are most growing fields nowadays in the area of audio classification [5].”
BackgroundA DBN-Based Deep Neural Network Model with Multitask Learning for Online Air Quality Prediction
Li, J., Shao, X., & Sun, R. (2019) · Journal of Control Science and Engineering · doi:10.1155/2019/5304535 · Cited by 42
“Multitask learning is often adopted when training data is very limited for the target task domain [28].”
BackgroundKeystroke Analysis for User Identification using Deep Neural Networks
Bernardi, M. L., Cimitile, M., Martinelli, F., & Mercaldo, F. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852068 · Cited by 38
“Deep Learning (DL) is a part of the machine learning algorithms family consisting of a set of emerging techniques [4] inspired by the way information is processed in biological nervous systems.”
BackgroundMultiple Classification of Flower Images Using Transfer Learning
Cengil, E., & Çınar, A. (2019) · International Artificial Intelligence and Data Processing Symposium (IDAP) · doi:10.1109/idap.2019.8875953 · Cited by 38
“Each accomplished layer gets the output from the former layer as input [1].”
BackgroundChallenges of Applying Deep Learning in Real-World Applications
Tyagi, A. K., & Rekha, G. (2019) · Advances in computer and electrical engineering book series · doi:10.4018/978-1-7998-0182-5.ch004 · Cited by 43
Robot-assisted flexible needle insertion using universal distributional deep reinforcement learning
Tan, X., Lee, Y., Chng, C.-B., Lim, K. B., & Chui, C. (2019) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-019-02098-7 · Cited by 38
Indonesian news classification using convolutional neural network
Ramdhani, M. A., Maylawati, D. S., & Mantoro, T. (2020) · Indonesian Journal of Electrical Engineering and Computer Science · doi:10.11591/ijeecs.v19.i2.pp1000-1009 · Cited by 44
“DL is a development of conventional Artificial Neural Network (ANN) with adding multiple hidden layers between the input layer and output layer [8-10].”
BackgroundEEG Classification by Factoring in Sensor Spatial Configuration
Mokatren, L. S., Ansari, R., Çetin, A. E., Leow, A., Ajilore, O., Klumpp, H., & Vural, F. T. Y. (2021) · IEEE Access · doi:10.1109/access.2021.3054670 · Cited by 39
“Deep learning-based methods have repeatedly shown improved performance compared with other classical machine learning algorithms on a wide variety of problems [38].”
BackgroundTaghizadegan, Y., Dabanloo, N. J., Maghooli, K., & Sheikhani, A. (2021) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2021.102928 · Cited by 38
ReHy: A ReRAM-based Digital/Analog Hybrid PIM Architecture for Accelerating CNN Training
Jin, H., Liu, C., Liu, H., Luo, R., Xu, J., Mao, F., & Liao, X. (2021) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2021.3138087 · Cited by 43
“C onvolutional Neural Networks (CNN) have been widely used in many machine learning applications such as image and speech recognition, natural language processing [1], [2].”
MethodExploring Language Markers of Mental Health in Psychiatric Stories
Spruit, M. R., Verkleij, S., de Schepper, K., & Scheepers, F. E. (2022) · Applied Sciences · doi:10.3390/app12042179 · Cited by 43
LW-FIRE: A Lightweight Wildfire Image Classification with a Deep Convolutional Neural Network
Akagić, A., & Buza, E. (2022) · Applied Sciences · doi:10.3390/app12052646 · Cited by 40
Review of Botnet Attack Detection in SDN-Enabled IoT Using Machine Learning
Negera, W. G., Schwenker, F., Debelee, T. G., Melaku, H. M., & Ayano, Y. M. (2022) · Sensors · doi:10.3390/s22249837 · Cited by 47
“Here, the error measures the difference between x i and ˆ x i , usually defined as using mean square error or cross-entropy [120].”
MethodIn silico prediction of hERG blockers using machine learning and deep learning approaches
Chen, Y., Yu, X., Li, W., Tang, Y., & Liu, G. (2023) · Journal of Applied Toxicology · doi:10.1002/jat.4477 · Cited by 39
“Deep learning is a subset of machine learning that uses multilayer neural networks for mathematical fitting to learn the intrinsic patterns of sample data, showing good performance in feature extraction and prediction (Deng & Yu, 2014).”
Mountrakis, G., & Heydari, S. S. (2023) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2023.05.005 · Cited by 38
“Deep learning methods have been used for more than a decade in many domains such as computer vision, speech recognition, and natural language processing (Deng, 2014; Ahmad et al, 2019).”
Situation Control of Unmanned Aerial Vehicles for Road Traffic Monitoring
Kim, N. V., & Chervonenkis, M. (2015) · Modern Applied Science · doi:10.5539/mas.v9n5p1 · Cited by 38
“HoG and Haar-feature are sensitive to rotation and therefore require multiplying copies of these features at the turning angle with a certain step.”
MethodSemantic segmentation of high-resolution satellite images using deep learning
Chaurasia, K., Nandy, R., Pawar, O., Singh, R. R., & Ahire, M. (2021) · Earth Science Informatics · doi:10.1007/s12145-021-00674-7 · Cited by 37
Deep learning-based methods in structural reliability analysis: a review
Afshari, S. S., Zhao, C. Z., Zhuang, X., & Liang, X. (2023) · Measurement Science and Technology · doi:10.1088/1361-6501/acc602 · Cited by 38
Lin, H., Huang, L., Chen, Y., Zheng, L., Huang, M., & Chen, Y. (2023) · Buildings · doi:10.3390/buildings13061478 · Cited by 37
“It uses an artificial neural network as the framework to perform representation learning algorithms on data [13].”
MethodLi, X. G., & Zhang, F. (2023) · Measurement Science and Technology · doi:10.1088/1361-6501/ad068e · Cited by 37
Wang, S., Shibghatullah, A. S., Iqbal, T. J., & Keoy, K. H. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-10371-3 · Cited by 40
Debbadi, R. K., & Boateng, O. (2025) · International Journal of Science and Research Archive · doi:10.30574/ijsra.2025.14.2.0449 · Cited by 41
Polarimetric SAR Feature Extraction With Neighborhood Preservation-Based Deep Learning
Liu, H., Yang, S., Gou, S., Zhu, D., Wang, R., & Jiao, L. (2016) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2016.2618891 · Cited by 37
“There are many models developed for deep learning [21], [22], such as stacked autoencoder (AE), deep belief networks (DBN), and convolutional neural network (CNN).”
BackgroundWhy Deep Learning Is Changing the Way to Approach NGS Data Processing: A Review
Celesti, F., Celesti, A., Wan, J., & Villari, M. (2018) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2018.2825987 · Cited by 42
“It represents a class of machine-learning (ML) algorithms that uses different abstraction levels to give a meaning to data, in which each level takes input from the previous one [8].”
BackgroundChen, H., Liu, Z., Gu, J., Ai, W., Wen, J., & Cai, K. (2018) · Analytical Methods · doi:10.1039/c8ay01076e · Cited by 37
Türkçe Haber Metinlerinin Konvolüsyonel Sinir Ağları ve Word2Vec Kullanılarak Sınıflandırılması
Acı, Ç. İ., & ÇIRAK, A. (2019) · Bilişim Teknolojileri Dergisi · doi:10.17671/gazibtd.457917 · Cited by 45
Analyzing nuclear reactor simulation data and uncertainty with the group method of data handling
Radaideh, M. I., & Kozłowski, T. (2019) · Nuclear Engineering and Technology · doi:10.1016/j.net.2019.07.023 · Cited by 47
Ding, H., Liang-Liang, Y. A. N. G., & Zhao-jian, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2933676 · Cited by 41
Automated Pterygium Detection Using Deep Neural Network
Zamani, N. S. M., Zaki, W. M. D. W., Huddin, A. B., Hussain, A., Mutalib, H. A., & Ali, A. (2020) · IEEE Access · doi:10.1109/access.2020.3030787 · Cited by 37
“[28] in 2006 for use in stock price index forecasts [29], [30], and CNN as proposed by LeCun et al .”
BackgroundMethodThe Future of Human Activity Recognition: Deep Learning or Feature Engineering?
Kanjilal, R., & Uysal, I. (2021) · Neural Processing Letters · doi:10.1007/s11063-020-10400-x · Cited by 42
3D Convolutional Neural Network for Regional Precipitation Nowcasting
吴, 昆. (2018) · Journal of Image and Signal Processing · doi:10.12677/jisp.2018.74023 · Cited by 37
Metadata
- Authors
- Deng, L., & Yu, D.
- Affiliations
- Microsoft (United States) (US)
- Venue
- Foundations and Trends® in Signal Processing
- Publisher
- Emerald
- Published
- 2014-06-30
- Volume
- 7
- Issue
- 3-4
- Pages
- 197-387
- ISSN
- 1932-8346 (ISSN-L)
- 1932-8354
- OpenAlex
- W4205947740
- Cited by
- 3,480
- References
- 21
- Citations by year
- 2026: 113 · 2025: 206 · 2024: 298 · 2023: 410 · 2022: 469 · 2021: 453 · 2020: 404 · 2019: 426 · 2018: 304 · 2017: 188 · 2016: 146 · 2015: 57 · 2014: 3
- FWCI
- 117.48
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Foundations and Trends® in Signal Processing (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- deep learning, signal processing, information processing, speech recognition, computer vision, natural language processing, text processing, information retrieval, multimodal information processing, multi-task learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.