Deep Learning: Methods and Applications
Open accessThe DOI matches its Crossref record; 28 of the 168 references it cites were found in a registry or an index, and 140 are not checked yet.
Abstract
This monograph provides an overview of general deep learning methodology and its applications to a variety of signal and information processing tasks. The application areas are chosen with the following three criteria in mind: (1) expertise or knowledge of the authors; (2) the application areas that have already been transformed by the successful use of deep learning technology, such as speech recognition and computer vision; and (3) the application areas that have the potential to be impacted significantly by deep learning and that have been experiencing research growth, including natural language and text processing, information retrieval, and multimodal information processing empowered by multi-task deep learning.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Deep learning is successfully used as a tool for machine learning, where a neural network is capable of automatically learning features.”
From Medical image analysis using convolutional neural networks: a review (2018) · cites this paper as [47]
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Self-citationLearning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239 · cited 6×
“Since 2006, deep structured learning, or more commonly called deep learning or hierarchical learning, has emerged as a new area of machine learning research [20, 163].”
BackgroundMethodInfluentialLearning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542 · cited 1×
“, speech or text), but until recently they had not been widely used partly because they are difficult to train to capture long-term dependencies, giving rise to gradient vanishing or gradient explosion problems which were known in early 1990s [29, 167].”
BackgroundWolpert, D. H. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80023-1 · Cited by 7,951
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878 · cited 1×
“[347] developed the recursive neural tensor network, where each layer is constructed similarly to that of the neural tensor network described in [340] with an illustration shown in Figure 8.”
MethodCaruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636 · cited 1×
“The several architectures discussed so far in this chapter for multimodal processing and learning can be regarded as special cases of more general multi-task learning and transfer learning [22, 47].”
Background
Research works printed but not linked: 276
- Abdel-Hamid, 2013, Proceedings of Interspeech,
- Abdel-Hamid, 2013, Proceedings of Interspeech.
- Abdel-Hamid, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Acero, 2000, Proceedings of Interspeech
- Alain, 2013, Proceedings of International Conference on Learning Representations (ICLR).
- Arisoy, 2012, Proceedings of the Joint Human Language Technology Conference and the North American Chapter of the Association of Computational Linguistics (HLT-NAACL) Workshop.
- Aslan, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Ba, 2013, Proceedings of Neural Information Processing Systems (NIPS
- Baldi, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- E. Battenberg , E.Schmidt, and J.Bello. Deep learning for music, special session at International Conference on Acoustics Speech and Signal Processing (ICASSP) (http://www.icassp2014.org/ special_sections.html#ss8), 2014.
- Batternberg, 2012, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Bell, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Bengio, 2008, Scholarpedia,
- Bengio, 2012, Deep learning of representations for unsupervised and transfer learning, Journal of Machine Learning Research Workshop and Conference Proceedings, 27, 17
- Bengio, 2013, Statistical Language and Speech Processing,, 1
- Bengio, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Bengio, 2000, Proceedings of Neural Information Processing Systems (NIPS
- Bengio, 2003, A neural probabilistic language model, Journal of Machine Learning Research,, 3, 1137
- Bengio, 2006, Proceedings of Neural Information Processing Systems (NIPS
- Bengio, 2013, Proceedings of International Conference on Machine Learning (ICML), 2014.
- Bengio, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Bergstra, 2012, Random search for hyper-parameter optimization, Journal on Machine Learning Research,, 3, 281
- Bilmes, 2010, Dynamic graphical models, IEEE Signal Processing Magazine,, 33, 29
- Bordes, 2013, Machine Learning,
- Bordes, 2011, Proceedings of Association for the Advancement of Artificial Intelligence (AAAI).
- Bottou, 2013, From machine learning to machine reasoning: An essay, Journal of Machine Learning Research,, 14, 3207
- Bottou, 2004, Proceedings of Neural Information Processing Systems (NIPS
- Boulanger-Lewandowski, 2012, Proceedings of International Conference on Machine Learning (ICML).
- Boulanger-Lewandowski, 2013, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Bourlard, 1993, Connectionist Speech Recognition: A Hybrid Approach.
- Breiman, 1996, Stacked regression, Machine Learning,, 24, 49, 10.1023/a:1018046112532 · doi:10.1023/a:1018046112532 · Paper page
- Cardinal, 2013, Large vocabulary speech recognition on parallel architectures, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 2290, 10.1109/tasl.2013.2271591 · doi:10.1109/tasl.2013.2271591
- Chen, 2014, Proceedings of International Conference on Learning Representations.
- Chen, 2012, Proceedings of Interspeech.
- Chengalvarayan, 1997, IEEE Transactions on Speech and Audio Processing, 243
- Chengalvarayan, 1997, IEEE Transactions on Speech and Audio Processing,, 232
- Chengalvarayan, 1998, Speech trajectory discrimination using the minimum classification error learning, IEEE Transactions on Speech and Audio Processing,, 6, 505, 10.1109/89.725317 · doi:10.1109/89.725317
- Cho, 2009, Proceedings of Neural Information Processing Systems (NIPS, 342
- Ciresan, 2012, Proceedings of Neural Information Processing Systems (NIPS
- Ciresan, 2010, Neural Computation
- Ciresan, 2011, Proceedings of International Joint Conference on Neural Networks (IJCNN).
- Ciresan, 2012, Proceedings of Computer Vision and Pattern Recognition (CVPR).
- Ciresan, 2012, Proceedings of International Joint Conference on Neural Networks (IJCNN).
- Coates, 2013, Proceedings of International Conference on Machine Learning (ICML).
- Cohen, 2005, Proceedings of International Joint Conference on Artificial Intelligence (IJCAI),, 671
- Collobert, 2011, Proceedings of Artificial Intelligence and Statistics (AISTATS
- Collobert, 2008, Proceedings of International Conference on Machine Learning (ICML).
- Collobert, 2011, Natural language processing (almost) from scratch, Journal on Machine Learning Research,, 12, 2493
- Dahl, 2010, Phone recognition with the mean-covariance restricted boltzmann machine, Proceedings of Neural Information Processing Systems (NIPS, 23, 469
- Dahl, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dahl, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dahl, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dean, 2012, Proceedings of Neural Information Processing Systems (NIPS
- Demuynck, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Deng, 1993, IEEE Transactions on Speech and Audio Processing, 471
- Deng, 2003, Mathematical Foundations of Speech and Language Processing,, 115
- Deng, 2011, Proceedings of Asian-Pacific Signal & Information Processing Annual Summit and Conference (APSIPA-ASC).
- Deng, 2012, The MNIST database of handwritten digit images for machine learning research, IEEE Signal Processing Magazine,, 29
- Deng, 2013, Neural Information Processing Systems (NIPS) Workshop on Learning Output Representations.
- Deng, 2013, Asian-Pacific Signal & Information Processing Association Transactions on Signal and Information Processing.
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2001, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2014, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 1992, Structural design of a hidden Markov model based speech recognizer using multi-valued phonetic features: Comparison with segmental speech units, Journal of the Acoustical Society of America,, 92, 3058, 10.1121/1.404202 · doi:10.1121/1.404202
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2004, Challenges in adopting speech recognition, Communications of the Association for Computing Machinery (ACM),, 47, 11
- Deng, 2012, Proceedings of Interspeech.
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2003, Speech Processing — A Dynamic and Optimization-Oriented Approach
- Deng, 1996, Transitional speech units and their representation by regressive Markov states: Applications to speech recognition, IEEE Transactions on speech and audio processing,, 4, 301, 10.1109/89.506934 · doi:10.1109/89.506934
- Deng, 2010, Proceedings of Interspeech.
- Deng, 2012, Proceedings of IEEE Workshop on Spoken Language Technologies
- Deng, 2002, Distributed speech processing in mipad’s multimodal user interface, IEEE Transactions on Speech and Audio Processing,, 10, 605, 10.1109/tsa.2002.804538 · doi:10.1109/tsa.2002.804538
- Deng, 2005, Dynamic compensation of HMM variances using the feature enhancement uncertainty computed from a parametric model of speech distortion, IEEE Transactions on Speech and Audio Processing,, 13, 412, 10.1109/tsa.2005.845814 · doi:10.1109/tsa.2005.845814
- Deng, 2007, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2011, Proceedings of Interspeech.
- Deng, 2009, Neural Information Processing Systems (NIPS) Workshop
- Deng, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deselaers, 2009, Proceedings of 4th Workshop on Statistical Machine Translation,, 233
- Dognin, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Erhan, Journal on Machine Learning Research,, 201
- Fernandez, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 6885
- Fine, 1998, Machine Learning, 41
- Frome, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Fu, 2007, Proceedings of Interspeech
- Gales, 2011, Robust Speech Recognition of Uncertain or Missing Data: Theory and Application, 101, 10.1007/978-3-642-21317-5_5 · doi:10.1007/978-3-642-21317-5_5
- Gao, 2010, Proceedings of Conference on Information and Knowledge Management (CIKM).
- Gao, 2013, Proceedings of Neural Information Processing Systems (NIPS) Workshop on Deep Learning
- Gao, 2014, Proceedings of Association for Computational Linguistics (ACL).
- Gao, 2011, Proceedings of Special Interest Group on Information Retrieval (SIGIR).
- Gens, 2012, Neural Information Processing Systems (NIPS),
- Gibson, 2010, Error approximation and minimum phone error acoustic model estimation, IEEE Transactions on Audio, Speech, and Language Processing,, 18, 1269, 10.1109/tasl.2009.2032607 · DOI
- Glorot, 2010, Proceedings of Artificial Intelligence and Statistics (AISTATS).
- Glorot, 2011, Proceedings of Artificial Intelligence and Statistics (AIS-TATS
- Goodfellow, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Graves, 2012, Representation Learning Workshop, International Conference on Machine Learning (ICML),
- Graves, 2006, Proceedings of International Conference on Machine Learning (ICML).
- Graves, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Graves, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Grezl, 2008, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Gutmann, 2012, Noise-contrastive estimation of unnormalized statistical models, with applications to natural image statistics, Journal of Machine Learning Research,, 13, 307
- Hain, 2012, IEEE Transactions on Audio, Speech, and Language Processing,, 486
- Hamel, 2010, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Hawkins, 2004, On Intelligence: How a New Understanding of the Brain will lead to the Creation of Truly Intelligent Machines
- He, 2011, IEEE Signal Processing Magazine,
- He, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- He, 2013, Proceedings of the IEEE.
- Heigold, 2013, Investigations on an EM-style optimization algorithm for discriminative training of HMMs, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 2616, 10.1109/tasl.2013.2280234 · doi:10.1109/tasl.2013.2280234
- Heigold, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Heintz, 2009, Discriminative input stream combination for conditional random field phone recognition, IEEE Transactions on Audio, Speech, and Language Processing,, 17, 1533, 10.1109/tasl.2009.2022204 · doi:10.1109/tasl.2009.2022204
- Henderson, 2013, Proceedings of Special Interest Group on Disclosure and Dialogue (SIGDIAL).
- Hermans, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Hermansky, 2000, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Hinton, 1990, Artificial Intelligence,, 1
- Hinton, 2003, Canadian Psychology,, 10
- Hinton, 2011, A better way to learn features, Communications of the Association for Computing Machinery (ACM),, 54
- Hinton, 2006, Neural Computation,, 1527
- Hinton, 2010, Topics in Cognitive Science,, 1
- Huang, 2012, Proceedings of Association for Computational Linguistics (ACL).
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Association for Computing Machinery (ACM) International Conference Information and Knowledge Management (CIKM),
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2001, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Proceedings of Interspeech,, 2360
- Humphrey, 2012, Proceedings of International Conference on Machine Learning and Application (ICMLA).
- Humphrey, 2012, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Humphrey, 2013, Journal of Intelligent Information Systems,
- Hutchinson, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Hutchinson, 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence,, 1944
- Imseng, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Jaitly, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Jaitly, 2012, Proceedings of Interspeech.
- Jarrett, 2009, Proceedings of International Conference on Computer Vision,, 2146
- Kahou, 2013, Proceedings of International Conference on Multimodal Interaction (ICMI).
- Kang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 8012
- Kashiwagi, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Kavukcuoglu, 2010, Proceedings of Neural Information Processing Systems (NIPS
- Ketabdar, 2010, IEEE Transactions on Audio, Speech, and Language Processing,, 1094
- Kingsbury, 2009, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Kingsbury, 2012, Proceedings of Interspeech.
- Kiros, 2013, Proceedings of Neural Information Processing Systems (NIPS) Deep Learning Workshop.
- Ko, 2013, IEEE Transactions on Audio, Speech, and Language Processing, 1285
- Krizhevsky, 2012, Proceedings of Neural Information Processing Systems (NIPS).
- Kubo, 2012, Proceedings of Interspeech.
- Kurzweil, 2012, How to Create a Mind.
- Lal, 2013, IEEE Transactions on Audio, Speech, and Language Processing,, 2506
- Larochelle, 2008, Proceedings of International Conference on Machine Learning (ICML).
- Le, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Le, 2010, Proceedings of Empirical Methods in Natural Language Processing (EMNLP, 778
- Le, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Le, 2013, IEEE Transactions on Audio, Speech, and Language Processing, 197
- Le, 2011, Proceedings of International Conference on Machine Learning (ICML).
- Le, 2012, Proceedings of International Conference on Machine Learning (ICML).
- LeCun, 2012, Proceedings of European Conference on Computer Vision (ECCV).
- LeCun, 1995, The Handbook of Brain Theory and Neural Networks,, 255
- LeCun, 1998, Proceedings of the IEEE,, 2278
- LeCun, 2007, Proceedings of International Conference on Document Analysis and Recognition (ICDAR).
- Lee, 2004, Proceedings of International Conference on Spoken Language Processing (ICSLP),, 109
- Lee, 2009, Proceedings of International Conference on Machine Learning (ICML).
- Lee, 2011, Communications of the Association for Computing Machinery (ACM),, 95
- Lee, 2010, Proceedings of Neural Information Processing Systems (NIPS
- Lena, 2012, Proceedings of Neural Information Processing Systems (NIPS).
- Li, 2014, IEEE/Association for Computing Machinery (ACM) Transactions on Audio, Speech, and Language Processing, 1
- Li, 2012, Proceedings of IEEE Spoken Language Technology (SLT
- Li, 2013, Proceedings Conference on Affective Computing and Intelligent Interaction (ACII),, 312
- Liao, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Liao, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Lin, 2009, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Lin, 2011, Proceedings of Computer Vision and Pattern Recognition (CVPR
- Ling, 2013, Modeling spectral envelopes using restricted boltzmann machines for statistical parametric speech synthesis, International Conference on Acoustics Speech and Signal Processing (ICASSP),, 7825
- Ling, 2013, Articulatory control of HMM-based parametric speech synthesis using feature-space-switched multiple regression
- Lu, 2013, Joint uncertainty decoding for noise robust subspace gaussian mixture models, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 1791, 10.1109/tasl.2013.2248718 · doi:10.1109/tasl.2013.2248718
- Ma, 2000, Computer, Speech and Language
- Maas, 2013, Rectifier nonlinearities improve neural network acoustic models
- Manning, 2009, Introduction to Information Retrieval.
- J.Markoff, 2012, Scientists see promise in deep-learning programs
- Martens, 2010, Deep learning with hessian-free optimization
- Martens, 2011, Learning recurrent neural networks with hessian-free optimization
- McGraw, 2013, Learning lexicons from speech using a pronunciation mixture model, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 357, 10.1109/tasl.2012.2226158 · DOI
- Mikolov, 2013, Efficient estimation of word representations in vector space
- Mikolov, 2010, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 1045
- Mikolov, 2013, Distributed representations of words and phrases and their compositionality
- Minami, 2002, A recognition method with parametric trajectory synthesized using direct relations between static and dynamic feature vector time series, 957
- Mnih, 2008, A scalable hierarchical distributed language model, 1081
- Mnih, 2013, Learning word embeddings efficiently with noise-contrastive estimation
- Mnih, 2013, laying arari with deep reinforcement learning
- Mohamed, 2009, Deep belief networks for phone recognition
- Morin, 2005, Hierarchical probabilistic neural network language models
- Murphy, 2012, Machine Learning
- Nair, 2009, 3-d object recognition with deep belief nets
- Ngiam, 2011, Learning deep energy models
- Ngiam, 2011, Multimodal deep learning
- Olshausen, 2012, Can ‘deep learning’ offer deep insights about visual representation?
- Ostendorf, 1999, Moving beyond the ‘beads-on-a-string’ model of speech
- Oudre, 2011, Probabilistic template-based chord recognition, IEEE Transactions on Audio, Speech, and Language Processing, 19, 2249, 10.1109/tasl.2010.2098870 · doi:10.1109/tasl.2010.2098870
- Palangi, 2013, Learning input and recurrent weight matrices in echo state networks
- Palangi, 2013, Using deep stacking network to improve structured compressive sensing with multiple measurement vectors
- Pascanu, 2014, How to construct deep recurrent neural networks
200 of 276 shown
Cited by
Items 701–800 of 1,005
Girmatsion, M., Tang, X., Zhang, Q., & Li, P. (2025) · Food Research International · doi:10.1016/j.foodres.2025.116285 · Cited by 52
Caffe con Troll: Shallow Ideas to Speed Up Deep Learning
Hadjis, S., Abuzaid, F., Zhang, C., & Ré, C. (2015) · doi:10.1145/2799562.2799641 · Cited by 56
“Deep Learning using convolution neural networks (CNNs) is a hot topic in machine learning research and is the basis for a staggering number of consumer-facing data-driven applications, including those based on object recognition, voice recognition, and search [5,6,9,16].”
BackgroundChen, K., Liu, S., Chen, B., Wang, H., Jan, E.-E., Hsu, W., & Chen, H. (2015) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2015.2432578 · Cited by 60
“…[37]–[39] that virtually unfolds the feedback loop of RNNLM making its model structure bear a close resemblance to the family of so-called deep neural networks [40] and thereby learn to remember word usage information for several time steps that is packed into the hidden layer of RNNLM [41].”
BackgroundMapping API elements for code migration with vector representations
Nguyen, T. D., Nguyen, A. T., & Nguyen, T. N. (2016) · Proceedings of the 38th International Conference on Software Engineering Companion · doi:10.1145/2889160.2892661 · Cited by 46
Defect Prediction in Android Binary Executables Using Deep Neural Network
Dong, F., Wang, J., Li, Q., Xu, G., & Zhang, S. (2017) · Wireless Personal Communications · doi:10.1007/s11277-017-5069-3 · Cited by 55
“DNN, CNN, RNN are often used to build the supervised-learning models while DBN, regularized autoencoder are used to build the unsupervised-learning models [4].”
BackgroundMethodAutomobile Maintenance Prediction Using Deep Learning with GIS Data
Chen, C., Liu, Y., Sun, X., Cairano‐Gilfedder, C. D., & Titmus, S. (2019) · Procedia CIRP · doi:10.1016/j.procir.2019.03.077 · Cited by 51
Eguchi, R., Ono, N., Morita, A. H., Katsuragi, T., Nakamura, S., Huang, M., Altaf‐Ul‐Amin, M., & Kanaya, S. (2019) · BMC Bioinformatics · doi:10.1186/s12859-019-2963-6 · Cited by 55
“We also compared our method with a neural network with the same chemical fingerprint [35, 36] to evaluate the advantages of the graph representation.”
MethodSanyal, R., Kar, D., & Sarkar, R. (2021) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2021.3071022 · Cited by 52
“The CNN can learn more discriminating features among various classes if number of training samples available per class is more [32].”
BackgroundA Modified YOLOv4 Deep Learning Network for Vision-Based UAV Recognition
Javan, F. D., Samadzadegan, F., Gholamshahi, M., & Mahini, F. A. (2022) · Drones · doi:10.3390/drones6070160 · Cited by 58
Mozaffari, M. H., & Tay, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10575 · Cited by 61
Anwar, S., & Alam, A. (2020) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-020-02282-x · Cited by 50
“Deep Learning, a subset of Machine Learning, aims to move the traditional machine learning techniques towards artificial intelligence [27].”
BackgroundSayeed, A., Eslami, E., Lops, Y., & Choi, Y. (2022) · Atmospheric Environment · doi:10.1016/j.atmosenv.2022.118961 · Cited by 50
Changeable Rate and Novel Quantization for CSI Feedback Based on Deep Learning
Liang, X., Chang, H., Li, H., Gu, X., & Zhang, L. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3182216 · Cited by 59
“Deep learning (DL) has achieved a great success in many fields [11]–[15].”
BackgroundRecurrent nonsymmetric deep auto encoder approach for network intrusion detection system
M, S. Y., & Kalpana, R. (2022) · Measurement Sensors · doi:10.1016/j.measen.2022.100527 · Cited by 53
ALTİN, F. G., Budak, İ., & Özcan, F. (2023) · Sustainable Chemistry and Pharmacy · doi:10.1016/j.scp.2023.101060 · Cited by 50
Applying Recurrent Neural Network to Intrusion Detection with Hessian Free Optimization
Kim, J., & Kim, H. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-31875-2_30 · Cited by 57
A Component-Based Multi-Layer Parallel Network for Airplane Detection in SAR Imagery
He, C., Tu, M., Xiong, D., Tu, F., & Liao, M. (2018) · Remote Sensing · doi:10.3390/rs10071016 · Cited by 50
“With the development of technology, more SAR images are acquired with higher spatial resolution, making it possible to introduce deep learning [11] into SAR image processing.”
BackgroundPRDL: Relative Localization Method of RFID Tags via Phase and RSSI Based on Deep Learning
Shen, L., Zhang, Q., Pang, J., Xu, H., & Li, P. (2019) · IEEE Access · doi:10.1109/access.2019.2895129 · Cited by 50
“In recent years, deep learning, an algorithm that attempts to abstract data with multiple processing layers consisting of complex structures or multiple nonlinear transforms, is continuously combined with practical applications to further improve the accuracy and efficiency of applications [14]–[16].”
BackgroundMethodDeep learning—Using machine learning to study biological vision
Majaj, N. J., & Pelli, D. G. (2018) · Journal of Vision · doi:10.1167/18.13.2 · Cited by 56
“4 In their book, Deep Learning Methods and Applications , Deng and Yu (2014) cite Hinton et al. (2006) and Bengio (2009) as the first to use the term.”
BackgroundMulti-view secondary input collaborative deep learning for lung nodule 3D segmentation
Dong, X., Xu, S., Liu, Y., Wang, A., Saripan, M. I., Li, L., Zhang, X., & Lu, L. (2020) · Cancer Imaging · doi:10.1186/s40644-020-00331-0 · Cited by 56
Funch, O. I., Marhaug, R., Kohtala, S., & Steinert, M. (2020) · Waste Management · doi:10.1016/j.wasman.2020.09.032 · Cited by 50
“Traditional sound recognition often utilizes an HMM, gaussian mixture model, or SVMs (Ananthi and Dhanalakshmi, 2015; Deng and Yu, 2014; Li et al., 2017; McLoughlin et al., 2015; Mesaros et al., 2010; Sharan and Moir, 2016), but several studies have also shown promising results using CNNs (Hershey…”
ResultAutomated Monitoring of Construction Sites of Electric Power Substations Using Deep Learning
Oliveira, B. A. S., Neto, A. P. D. F., Fernandino, R. M. A., Carvalho, R. F., Fernandes, A. L., & Guimarães, F. G. (2021) · IEEE Access · doi:10.1109/access.2021.3054468 · Cited by 56
“Although deep learning was theorized in the 1980s [13], it has only been disseminated in recent years for two reasons: a large amount of data currently available and the advancement of research in the hardware area, increasing existing computational resources [14], [15].”
BackgroundAutomated Segmentation of Martensite-Austenite Islands in Bainitic Steel
Ackermann, M., İren, D., Wesselmecking, S., Shetty, D., & Krupp, U. (2022) · Materials Characterization · doi:10.1016/j.matchar.2022.112091 · Cited by 50
TUMK-ELM: A Fast Unsupervised Heterogeneous Data Learning Approach
Xiang, L., Zhao, G., Li, Q., Hao, W., & Li, F. (2018) · IEEE Access · doi:10.1109/access.2018.2847037 · Cited by 52
“Recently, lots of efforts have been done for unsupervised deep learning [14], which aims to reveal complex relations/patterns/knowledge in huge amount of data [15]–[17].”
BackgroundEstimating workability of concrete with different strength grades based on deep learning
Liu, Y., An, X., & Du, S. (2021) · Measurement · doi:10.1016/j.measurement.2021.110073 · Cited by 51
Advances in Hyperspectral Image Classification Based on Convolutional Neural Networks: A Review
Bera, S., Shrivastava, V. K., & Satapathy, S. C. (2022) · Computer Modeling in Engineering & Sciences · doi:10.32604/cmes.2022.020601 · Cited by 70
Neuromorphic computing's yesterday, today, and tomorrow – an evolutional view
Chen, Y., Li, H. H., Wu, C., Song, C., Li, S. K., Min, C., Cheng, H.-P., Wen, W., & Liu, X. (2017) · Integration · doi:10.1016/j.vlsi.2017.11.001 · Cited by 51
The application of deep learning in communication signal modulation recognition
Lin, Y., Tu, Y., Dou, Z., & Wu, Z. (2017) · IEEE/CIC International Conference on Communications in China (ICCC) · doi:10.1109/iccchina.2017.8330488 · Cited by 51
A survey on developing personalized content services in museums
Kosmopoulos, D., & Styliaras, G. (2018) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2018.05.002 · Cited by 52
“We believe that the unsupervised learning methods like deep learning, (e.g., [202], [109], [114]) can be useful in group profiling for the following reasons: (a) they can cope with large amounts of heterogeneous data like the ones produced by di ff erent sensors and define the optimal feature…”
BackgroundGao, Y., Chang, D., Fang, T., & Fan, Y. (2019) · Journal of Advanced Transportation · doi:10.1155/2019/5764602 · Cited by 49
“However, the prediction made by the proposed LSTM RNN model is obtained through studying and training of the historical dataset, which is extremely essential to provide decision support for the port operation.”
BackgroundInfluentialWang, W., Wang, Z., Su, L., Hu, T., Ren, Q., Gerstoft, P., & Ma, L. (2020) · The Journal of the Acoustical Society of America · doi:10.1121/10.0002911 · Cited by 49
An Experimental Analysis of Deep Learning Architectures for Supervised Speech Enhancement
Nossier, S. A., Wall, J. A., Moniri, M., Glackin, C., & Cannings, N. (2020) · Electronics · doi:10.3390/electronics10010017 · Cited by 49
“CNNs were first made for image-related tasks to be able to work with the huge amount of parameters, but, recently, they have proven to be very effective in audio processing [44].”
BackgroundStockPred: a framework for stock Price prediction
Sharaf, M. M., Hemdan, E. E., El‐Sayed, A., & El-Bahnasawy, N. A. W. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-021-10579-8 · Cited by 49
The role of convolutional neural networks in scanning probe microscopy: a review
Azuri, I., Rosenhek‐Goldian, I., Regev‐Rudzki, N., Fantner, G. E., & Cohen, S. (2021) · Beilstein Journal of Nanotechnology · doi:10.3762/bjnano.12.66 · Cited by 53
Artificial virtuous agents: from theory to machine implementation
Stenseke, J. (2021) · AI & Society · doi:10.1007/s00146-021-01325-7 · Cited by 54
“…increasingly larger networks, which in turn has made machine learning and neural networks the most dominant AI tools of today, reaching human and expert-level performance in areas such as pattern recognition, game playing, translation, and medical diagnosis (Deng and Yu 2014; Senior et al. 2020).”
BackgroundIntroduction to supervised machine learning in clinical epidemiology
Ono, S., & Goto, T. (2022) · Annals of Clinical Epidemiology · doi:10.37737/ace.22009 · Cited by 57
“Deep learning typically refers to an advanced type of neural network that has multiple layers organized in deeply nested network architecture [23–25].”
BackgroundDeep Learning for Accurate Detection of Brute Force attacks on IoT Networks
Otoom, A. F., Eleisah, W., & Abdallah, E. E. (2023) · Procedia Computer Science · doi:10.1016/j.procs.2023.03.038 · Cited by 54
Deep Learning Inferencing with High-performance Hardware Accelerators
Kljucaric, L., & George, A. D. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3594221 · Cited by 53
Živković, M., Žujović, M., & Milošević, J. (2023) · Applied Sciences · doi:10.3390/app131910671 · Cited by 49
“Deep learning (DL) is a subset of ML with key features represented in numerous layers or stages of nonlinear information processing and supervised (SDL) or unsupervised (UDL) feature representation at progressively higher, more abstract layers [58].”
BackgroundApplications of artificial intelligence for membrane separation: A review
Jafari, M., Tzirtzipi, C., & Dominguez, B. C. (2024) · Journal of Water Process Engineering · doi:10.1016/j.jwpe.2024.106532 · Cited by 48
Nonlinear model reduction by deep autoencoder of noise response data
Kashima, K. (2016) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2016.7799153 · Cited by 48
“The other is deep learning, which has been utilized in many fields in recent years [11], [12].”
BackgroundMethodInfluentialGalbusera, F., Bassani, T., Casaroli, G., Gitto, S., Zanchetta, E., Costa, F., & Sconfienza, L. M. (2018) · European Radiology Experimental · doi:10.1186/s41747-018-0060-7 · Cited by 49
“The most notable current uses of deep learning include tasks such as computer vision, pattern recognition of images and classification of complex data, which are increasingly commonly used in sophisticated applications such as robotics, self-driving cars and automated computer programming [1, 2].”
BackgroundDetection of smoking status from retinal images; a Convolutional Neural Network study
Vaghefi, E., Yang, S., Hill, S., Humphrey, G., Walker, N. K., & Squirrell, D. (2019) · Scientific Reports · doi:10.1038/s41598-019-43670-0 · Cited by 53
Min, X., Pengbo, Q., & Zhang, F. (2019) · Journal of Applied Geophysics · doi:10.1016/j.jappgeo.2019.103929 · Cited by 49
Mini Review: Deep Learning for Atrial Segmentation From Late Gadolinium-Enhanced MRIs
Jamart, K., Xiong, Z., Talou, G. D. M., Stiles, M. K., & Zhao, J. (2020) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2020.00086 · Cited by 54
“…of more powerful computational hardware and the growth of clinical databases enabled deep learning, a subset of artificial intelligence (AI) (28–32) capable of automatic feature extraction and learning, to achieve tremendous advances notably in image classification and segmentation (33, 34).”
Detection of Material Extrusion In-Process Failures via Deep Learning
Zhang, Z., Fidan, I., & Allen, M. J. (2020) · Inventions · doi:10.3390/inventions5030025 · Cited by 50
“DL is a class of ML algorithms that uses a cascade of multiple layers of nonlinear processing units for feature extraction and transformation [15].”
BackgroundDeep learning of dispersion engineering in two-dimensional phononic crystals
Miao, X.-B., Dong, H., & Wang, Y. (2021) · Engineering Optimization · doi:10.1080/0305215x.2021.1988587 · Cited by 48
Apple Leaf Disease Identification in Complex Background Based on BAM-Net
Gao, Y., Cao, Z., Cai, W., Gong, G., Zhou, G., & Li, L. (2023) · Agronomy · doi:10.3390/agronomy13051240 · Cited by 53
Autonomous vehicular overtaking maneuver: A survey and taxonomy
Lodhi, S. S., Kumar, N., & Pandey, P. K. (2023) · Vehicular Communications · doi:10.1016/j.vehcom.2023.100623 · Cited by 55
Najafi, A., Nemati, A., Ashrafzadeh, M., & Zolfani, S. H. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106662 · Cited by 47
Image-Based Monitoring of Jellyfish Using Deep Learning Architecture
Kim, H., Koo, J., Kim, D.-H., Jung, S., Shin, J.-U., Lee, S., & Myung, H. (2016) · IEEE Sensors Journal · doi:10.1109/jsen.2016.2517823 · Cited by 47
“And, the deep learning algorithm is reported to be more suitable for complicated real-world classification applications than other machine learning algorithms [6].”
BackgroundMethodQuantum-assisted associative adversarial network: applying quantum annealing in deep learning
Wilson, M., Vandal, T., Hogg, T., & Rieffel, E. G. (2021) · Quantum Machine Intelligence · doi:10.1007/s42484-021-00047-9 · Cited by 52
“[26] L.”
Deriving disease modules from the compressed transcriptional space embedded in a deep autoencoder
Dwivedi, S. K., Tjärnberg, A., Tegner, J. N., & Gustafsson, M. (2020) · Nature Communications · doi:10.1038/s41467-020-14666-6 · Cited by 49
Evaluation of carbonation progress using AIJ model, FEM analysis, and machine learning algorithms
Lee, H.-M., Lee, H., & Suraneni, P. (2020) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2020.119703 · Cited by 49
Mridha, M. F., Prodeep, A. R., Hoque, A. S. M. M., Islam, M. R., Lima, A. A., Kabir, M. M., Hamid, M. A., & Watanobe, Y. (2022) · Journal of Healthcare Engineering · doi:10.1155/2022/5905230 · Cited by 54
“Deep learning uses both organized and disorganized information, like text and images, to train the models [314].”
BackgroundImproving Short Utterance Speaker Recognition by Modeling Speech Unit Classes
Li, L., Wang, D., Zhang, C., & Zheng, T. F. (2016) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2016.2544660 · Cited by 46
“This paper focuses on improving the recognition performance on very short test utterances where the valid speech is of 2 words in maximum, and dealing with the situation where both enrollment and test utterances are short.”
BackgroundDeLight: Adding Energy Dimension To Deep Neural Networks
Rouhani, B. D., Mirhoseini, A., & Koushanfar, F. (2016) · Proceedings of the 2016 International Symposium on Low Power Electronics and Design · doi:10.1145/2934583.2934599 · Cited by 43
“Deep Neural Networks (DNNs) and Convolutional Neural Networks (CNNs) are the two main topologies widely used in deep learning domain [9].”
BackgroundReview of Deep Learning Methods in Mammography, Cardiovascular, and Microscopy Image Analysis
Carneiro, G., Zheng, Y., Xing, F., & Yang, L. (2017) · Advances in computer vision and pattern recognition · doi:10.1007/978-3-319-42999-1_2 · Cited by 51
“The book [71] explains several established deep learning algorithms and provides speculative ideas for future research, the monograph [87] surveys general deep learning techniques and their applications (mainly) in speech processing and computer vision, and the paper [83] reviews several recent deep learning applicati…”
BackgroundVachtsevanos, G., Lee, B., Oh, S., & Balchanos, M. G. (2018) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-018-0881-x · Cited by 51
A Survey of Prediction and Classification Techniques in Multicore Processor Systems
Ababei, C., & Moghaddam, M. G. (2018) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2018.2878699 · Cited by 46
“During this process, a final layer is added to the DNN [82] as shown in Fig.”
InfluentialCPGVA: Code Property Graph based Vulnerability Analysis by Deep Learning
Xiaomeng, W., Zhang, T., Wu, R., Wei, X., & Changyu, H. (2018) · IEEE International Conference on Advanced Infocomm Technology · doi:10.1109/icait.2018.8686548 · Cited by 46
“It uses a cascade of multiple layers of nonlinear processing units for feature extraction and transformation [2].”
MethodRuan, Q., Wang, Z., Zhou, Y., & Lv, D. (2019) · Economic Modelling · doi:10.1016/j.econmod.2019.09.009 · Cited by 50
Kang, J.-S., Kavuri, S., & Lee, M. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2019.2942587 · Cited by 47
BReG-NeXt: Facial Affect Computing Using Adaptive Residual Networks With Bounded Gradient
Hasani, B., Negi, P. S., & Mahoor, M. H. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.2986440 · Cited by 58
“Deep learning has become a hot research topic and has achieved state-of-the-art performance for a variety of applications [17] as well as facial affect estimation.”
BackgroundSpeckle denoising techniques in imaging systems
Kumar, M., Tounsi, Y., Kaur, K., Nassim, A., Santoyo, F. M., & Matoba, O. (2020) · Journal of Optics · doi:10.1088/2040-8986/ab8b7f · Cited by 48
Multi-task deep learning of near infrared spectra for improved grain quality trait predictions
Assadzadeh, S., Walker, C. J., McDonald, L. S., Maharjan, P., & Panozzo, J. (2020) · Journal of Near Infrared Spectroscopy · doi:10.1177/0967033520939318 · Cited by 46
“21,22 Unsupervised (e.g., autoencoder ANNs) 45,46 and semi-supervised learning methods (generative adversarial networks or GANs) 47 also exist but are not pursued in the current work.”
BackgroundEarly Detection of Parkinson Disease using Deep Neural Networks on Gait Dynamics
Aversano, L., Bernardi, M. L., Cimitile, M., & Pecori, R. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207380 · Cited by 49
“Deep Learning is a set of recent machine learning techniques, often used in classification problems[1], allowing one to simulate the information processing of biological nervous systems [7].”
BackgroundHao, L., Huang, B., Jia, B., & Mao, G. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3106902 · Cited by 50
“Recent works focused on using deep learning models [9]–[13] due to their powerful learning ability [14].”
BackgroundAdvantages of Hybrid Deep Learning Frameworks in Applications with Limited Data
(2018) · International Journal of Machine Learning and Computing · doi:10.18178/ijmlc.2018.8.6.744 · Cited by 57
“This result facilitated explosive growth of DNN-based applications in computer vision, bioinformatics, healthcare, fundamental sciences, business and other areas [1], [2], [20].”
BackgroundInfluentialBlusseau, S., Wielhorski, Y., Haddad, Z., & Velasco-Forero, S. (2022) · Composites Part B Engineering · doi:10.1016/j.compositesb.2022.110333 · Cited by 48
Khanolkar, P. M., Vrolijk, A., & Olechowski, A. (2023) · Artificial intelligence for engineering design analysis and manufacturing · doi:10.1017/s0890060423000203 · Cited by 59
“Deep learning techniques such as neural networks and autoencoders have been effective in generating and analyzing large-scale data (Deng and Yu 2013; Lecun et al 2015).”
Alshaikh, K., Almatrafi, O., & Abushark, Y. B. (2023) · IEEE Access · doi:10.1109/access.2023.3348342 · Cited by 47
“Consequently, each layer receives input to analyze and classify it to provide the output that feeds the input of the next layer [14], [15].”
BackgroundIndustry 4.0: review and proposal for implementing a smart factory
Wu, K., Jia, X., & Zheng, M. (2024) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-024-13839-7 · Cited by 54
“However, in real applications, perceiving environments, such as graphics and speech recognition [61], is still the mainstay.”
Guo, Y., Wang, N., Shao, S., Huang, C., Zhang, Z., Li, X., & Wang, Y. (2024) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2024.114804 · Cited by 50
Wang, Y., Zhao, W., Hong, Y., & Zamani, M. (2019) · SIAM Journal on Control and Optimization · doi:10.1137/18m119046x · Cited by 49
Is Deep Learning a Renormalization Group Flow?
Koch, E. D. M., Koch, R. D. M., & Cheng, L. (2020) · IEEE Access · doi:10.1109/access.2020.3000901 · Cited by 54
Shin, D.-H., Ha, E.-G., Kim, T., & Kim, C.-B. (2020) · Soft Computing · doi:10.1007/s00500-020-05199-7 · Cited by 45
Image Reconstruction in Electrical Capacitance Tomography Based on Deep Neural Networks
Deabes, W. A., & Khayyat, K. M. J. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3116164 · Cited by 45
Deep Learning Approaches for Air-Writing Using Single UWB Radar
Hendy, N., Fayek, H. M., & Al‐Hourani, A. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3172727 · Cited by 45
Towards explainable AI for hyperspectral image classification in Edge Computing environments
Lucia, G. D., Lapegna, M., & Romano, D. (2022) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2022.108381 · Cited by 49
The Last State of Artificial Intelligence in Project ManagementPreprint
Davahli, M. R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.12262 · Cited by 58
“One of the main subfields of ML is deep learning, which is about learning and discovering complicated and unseen relationships among data [77].”
BackgroundPrediction of Occupation Stress by Implementing Convolutional Neural Network Techniques
Dalal, S., & Khalaf, O. I. (2021) · Journal of Cases on Information Technology · doi:10.4018/jcit.20210701.oa3 · Cited by 44
Phiri, M., Mulenga, M., Zimba, A., & Eke, C. I. (2023) · Solar Energy · doi:10.1016/j.solener.2023.111803 · Cited by 46
Automated kinship verification and identification through human facial images: a survey
Almuashi, M., Hashim, S. Z. M., Mohamad, D., Alkawaz, M. H., & Ali, A. (2015) · Multimedia Tools and Applications · doi:10.1007/s11042-015-3007-5 · Cited by 44
Auto-Categorization of HS Code Using Background Net Approach
Ding, L., Fan, Z., & Chen, D. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.08.224 · Cited by 44
On building ensembles of stacked denoising auto-encoding classifiers and their further improvement
Alvear-Sandoval, R. F., & Figueiras-Vidal, A. R. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.03.008 · Cited by 49
“There is not room here to give more details, so, the interested reader is referred to excellent tutorials [4,5,25] for more extensive reviews and bibliography, as well as to [26] for a bibliography of applications.”
BackgroundTop-down strategies for hierarchical classification of transposable elements with neural networks
Nakano, F. K., Pinto, W. J. G. S., Pappa, G. L., & Cerri, R. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966165 · Cited by 44
“[35], many bioinformatics applications are extending the state-of-start by using Restricted Boltzmann Machines [36] and Auto-Encoders [36].”
MethodPhilip, J. T., & George, S. T. (2019) · Clinical EEG and Neuroscience · doi:10.1177/1550059419842753 · Cited by 47
On improving CNNs performance: The case of MNIST
Alvear-Sandoval, R. F., Sancho‐Gómez, J., & Figueiras-Vidal, A. R. (2018) · Information Fusion · doi:10.1016/j.inffus.2018.12.005 · Cited by 46
A Deep Learning Approach for Arabic Text Classification
Sundus, K. I., Alhaj, F., & HAMMO, B. H. (2019) · International Conference on New Trends in Computing Sciences (ICTCS) · doi:10.1109/ictcs.2019.8923083 · Cited by 44
“DL was successful in producing excellent results compared with many traditional ML algorithms and human experts [18].”
ResultMini-batch sample selection strategies for deep learning based speech recognition
DOKUZ, Y., & TÜFEKCİ, Z. (2020) · Applied Acoustics · doi:10.1016/j.apacoust.2020.107573 · Cited by 49
Machine-learning-assisted inverse design of scattering enhanced metasurface
Lin, H., Hou, J., jin, J., Wang, Y., Tang, R., Shi, X., Tian, Y., & Xu, W. (2022) · Optics Express · doi:10.1364/oe.448051 · Cited by 46
Unsupervised Spectral–Spatial Semantic Feature Learning for Hyperspectral Image Classification
Xu, H., He, W. P., Zhang, L., & Zhang, H. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3159789 · Cited by 47
SC-DCNN: Highly-Scalable Deep Convolutional Neural Network using Stochastic Computing
Ren, A., Li, Z., Ding, C., Qiu, Q., Wang, Y., Li, J., Qian, X., & Yuan, B. (2017) · ACM SIGOPS Operating Systems Review · doi:10.1145/3093315.3037746 · Cited by 50
Gupta, A., Gehlot, S., Goswami, S., Motwani, S., Gupta, R., Faura, Á. G., Štepec, D., Martinčič, T., Azad, R., Merhof, D., et al. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102677 · Cited by 60
Türk, Ö., Özhan, D., Acar, E., Akıncı, T. Ç., & Yılmaz, M. (2022) · Zeitschrift für Medizinische Physik · doi:10.1016/j.zemedi.2022.11.010 · Cited by 44
“Deep Learning (DL) is an advanced subset of machine learning algorithms and it is a structure designed in a structure where various nonlinear layers and each successive layer use the output of the previous layer as input to extract features better [9].”
BackgroundDeep Neural Networks: A Case Study for Music Genre Classification
Rajanna, A. R., Aryafar, K., Shokoufandeh, A., & Ptucha, R. (2015) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2015.160 · Cited by 49
“In recent years, deep learning architectures [12] such as deep neural networks [9], convolutional deep neural networks [25], deep belief networks [21] and recurrent neural networks [18] have been applied to fields like automatic speech recognition, natural language processing, audio recognition and bioinformatics wher…”
BackgroundPM2.5 Prediction Based on the CEEMDAN Algorithm and a Machine Learning Hybrid Model
Ban, W., & Shen, L. (2022) · Sustainability · doi:10.3390/su142316128 · Cited by 47
A survey of artificial intelligence approaches in blind source separation
Ansari, S., Alatrany, A. S., Alnajjar, K. A., Khater, T., Mahmoud, S. A., Al‐Jumeily, D., & Hussain, A. J. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126895 · Cited by 43
DAE-Mask: a novel deep-learning-based automatic detection model for in-field wheat diseases
Mao, R., Zhang, Y., Wang, Z., Hao, X., Zhu, T., Gao, S., & Hu, X. (2023) · Precision Agriculture · doi:10.1007/s11119-023-10093-x · Cited by 49
“Researchers began to apply these algorithms to diagnosis crop diseases and estimate disease severity levels, such as support vector machine (SVM) (Ahmad et al., 2019), random forests (RF) (Santos et al., 2022), K-means clustering (Nieuwenhuizen et al., 2007), artificial neural network (ANN)…”
Metadata
- Authors
- Deng, L., & Yu, D.
- Affiliations
- Microsoft (United States) (US)
- Venue
- Foundations and Trends® in Signal Processing
- Publisher
- Emerald
- Published
- 2014-06-30
- Volume
- 7
- Issue
- 3-4
- Pages
- 197-387
- ISSN
- 1932-8346 (ISSN-L)
- 1932-8354
- OpenAlex
- W4205947740
- Cited by
- 3,480
- References
- 21
- Citations by year
- 2026: 113 · 2025: 206 · 2024: 298 · 2023: 410 · 2022: 469 · 2021: 453 · 2020: 404 · 2019: 426 · 2018: 304 · 2017: 188 · 2016: 146 · 2015: 57 · 2014: 3
- FWCI
- 117.48
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Foundations and Trends® in Signal Processing (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- deep learning, signal processing, information processing, speech recognition, computer vision, natural language processing, text processing, information retrieval, multimodal information processing, multi-task learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.