Deep Learning: Methods and Applications
Open accessThe DOI matches its Crossref record; 28 of the 168 references it cites were found in a registry or an index, and 140 are not checked yet.
Abstract
This monograph provides an overview of general deep learning methodology and its applications to a variety of signal and information processing tasks. The application areas are chosen with the following three criteria in mind: (1) expertise or knowledge of the authors; (2) the application areas that have already been transformed by the successful use of deep learning technology, such as speech recognition and computer vision; and (3) the application areas that have the potential to be impacted significantly by deep learning and that have been experiencing research growth, including natural language and text processing, information retrieval, and multimodal information processing empowered by multi-task deep learning.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Deep learning is successfully used as a tool for machine learning, where a neural network is capable of automatically learning features.”
From Medical image analysis using convolutional neural networks: a review (2018) · cites this paper as [47]
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Self-citationLearning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239 · cited 6×
“Since 2006, deep structured learning, or more commonly called deep learning or hierarchical learning, has emerged as a new area of machine learning research [20, 163].”
BackgroundMethodInfluentialLearning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542 · cited 1×
“, speech or text), but until recently they had not been widely used partly because they are difficult to train to capture long-term dependencies, giving rise to gradient vanishing or gradient explosion problems which were known in early 1990s [29, 167].”
BackgroundWolpert, D. H. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80023-1 · Cited by 7,951
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878 · cited 1×
“[347] developed the recursive neural tensor network, where each layer is constructed similarly to that of the neural tensor network described in [340] with an illustration shown in Figure 8.”
MethodCaruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636 · cited 1×
“The several architectures discussed so far in this chapter for multimodal processing and learning can be regarded as special cases of more general multi-task learning and transfer learning [22, 47].”
Background
Research works printed but not linked: 276
- Abdel-Hamid, 2013, Proceedings of Interspeech,
- Abdel-Hamid, 2013, Proceedings of Interspeech.
- Abdel-Hamid, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Acero, 2000, Proceedings of Interspeech
- Alain, 2013, Proceedings of International Conference on Learning Representations (ICLR).
- Arisoy, 2012, Proceedings of the Joint Human Language Technology Conference and the North American Chapter of the Association of Computational Linguistics (HLT-NAACL) Workshop.
- Aslan, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Ba, 2013, Proceedings of Neural Information Processing Systems (NIPS
- Baldi, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- E. Battenberg , E.Schmidt, and J.Bello. Deep learning for music, special session at International Conference on Acoustics Speech and Signal Processing (ICASSP) (http://www.icassp2014.org/ special_sections.html#ss8), 2014.
- Batternberg, 2012, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Bell, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Bengio, 2008, Scholarpedia,
- Bengio, 2012, Deep learning of representations for unsupervised and transfer learning, Journal of Machine Learning Research Workshop and Conference Proceedings, 27, 17
- Bengio, 2013, Statistical Language and Speech Processing,, 1
- Bengio, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Bengio, 2000, Proceedings of Neural Information Processing Systems (NIPS
- Bengio, 2003, A neural probabilistic language model, Journal of Machine Learning Research,, 3, 1137
- Bengio, 2006, Proceedings of Neural Information Processing Systems (NIPS
- Bengio, 2013, Proceedings of International Conference on Machine Learning (ICML), 2014.
- Bengio, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Bergstra, 2012, Random search for hyper-parameter optimization, Journal on Machine Learning Research,, 3, 281
- Bilmes, 2010, Dynamic graphical models, IEEE Signal Processing Magazine,, 33, 29
- Bordes, 2013, Machine Learning,
- Bordes, 2011, Proceedings of Association for the Advancement of Artificial Intelligence (AAAI).
- Bottou, 2013, From machine learning to machine reasoning: An essay, Journal of Machine Learning Research,, 14, 3207
- Bottou, 2004, Proceedings of Neural Information Processing Systems (NIPS
- Boulanger-Lewandowski, 2012, Proceedings of International Conference on Machine Learning (ICML).
- Boulanger-Lewandowski, 2013, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Bourlard, 1993, Connectionist Speech Recognition: A Hybrid Approach.
- Breiman, 1996, Stacked regression, Machine Learning,, 24, 49, 10.1023/a:1018046112532 · doi:10.1023/a:1018046112532 · Paper page
- Cardinal, 2013, Large vocabulary speech recognition on parallel architectures, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 2290, 10.1109/tasl.2013.2271591 · doi:10.1109/tasl.2013.2271591
- Chen, 2014, Proceedings of International Conference on Learning Representations.
- Chen, 2012, Proceedings of Interspeech.
- Chengalvarayan, 1997, IEEE Transactions on Speech and Audio Processing, 243
- Chengalvarayan, 1997, IEEE Transactions on Speech and Audio Processing,, 232
- Chengalvarayan, 1998, Speech trajectory discrimination using the minimum classification error learning, IEEE Transactions on Speech and Audio Processing,, 6, 505, 10.1109/89.725317 · doi:10.1109/89.725317
- Cho, 2009, Proceedings of Neural Information Processing Systems (NIPS, 342
- Ciresan, 2012, Proceedings of Neural Information Processing Systems (NIPS
- Ciresan, 2010, Neural Computation
- Ciresan, 2011, Proceedings of International Joint Conference on Neural Networks (IJCNN).
- Ciresan, 2012, Proceedings of Computer Vision and Pattern Recognition (CVPR).
- Ciresan, 2012, Proceedings of International Joint Conference on Neural Networks (IJCNN).
- Coates, 2013, Proceedings of International Conference on Machine Learning (ICML).
- Cohen, 2005, Proceedings of International Joint Conference on Artificial Intelligence (IJCAI),, 671
- Collobert, 2011, Proceedings of Artificial Intelligence and Statistics (AISTATS
- Collobert, 2008, Proceedings of International Conference on Machine Learning (ICML).
- Collobert, 2011, Natural language processing (almost) from scratch, Journal on Machine Learning Research,, 12, 2493
- Dahl, 2010, Phone recognition with the mean-covariance restricted boltzmann machine, Proceedings of Neural Information Processing Systems (NIPS, 23, 469
- Dahl, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dahl, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dahl, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dean, 2012, Proceedings of Neural Information Processing Systems (NIPS
- Demuynck, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Deng, 1993, IEEE Transactions on Speech and Audio Processing, 471
- Deng, 2003, Mathematical Foundations of Speech and Language Processing,, 115
- Deng, 2011, Proceedings of Asian-Pacific Signal & Information Processing Annual Summit and Conference (APSIPA-ASC).
- Deng, 2012, The MNIST database of handwritten digit images for machine learning research, IEEE Signal Processing Magazine,, 29
- Deng, 2013, Neural Information Processing Systems (NIPS) Workshop on Learning Output Representations.
- Deng, 2013, Asian-Pacific Signal & Information Processing Association Transactions on Signal and Information Processing.
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2001, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2014, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 1992, Structural design of a hidden Markov model based speech recognizer using multi-valued phonetic features: Comparison with segmental speech units, Journal of the Acoustical Society of America,, 92, 3058, 10.1121/1.404202 · doi:10.1121/1.404202
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2004, Challenges in adopting speech recognition, Communications of the Association for Computing Machinery (ACM),, 47, 11
- Deng, 2012, Proceedings of Interspeech.
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2003, Speech Processing — A Dynamic and Optimization-Oriented Approach
- Deng, 1996, Transitional speech units and their representation by regressive Markov states: Applications to speech recognition, IEEE Transactions on speech and audio processing,, 4, 301, 10.1109/89.506934 · doi:10.1109/89.506934
- Deng, 2010, Proceedings of Interspeech.
- Deng, 2012, Proceedings of IEEE Workshop on Spoken Language Technologies
- Deng, 2002, Distributed speech processing in mipad’s multimodal user interface, IEEE Transactions on Speech and Audio Processing,, 10, 605, 10.1109/tsa.2002.804538 · doi:10.1109/tsa.2002.804538
- Deng, 2005, Dynamic compensation of HMM variances using the feature enhancement uncertainty computed from a parametric model of speech distortion, IEEE Transactions on Speech and Audio Processing,, 13, 412, 10.1109/tsa.2005.845814 · doi:10.1109/tsa.2005.845814
- Deng, 2007, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2011, Proceedings of Interspeech.
- Deng, 2009, Neural Information Processing Systems (NIPS) Workshop
- Deng, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deselaers, 2009, Proceedings of 4th Workshop on Statistical Machine Translation,, 233
- Dognin, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Erhan, Journal on Machine Learning Research,, 201
- Fernandez, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 6885
- Fine, 1998, Machine Learning, 41
- Frome, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Fu, 2007, Proceedings of Interspeech
- Gales, 2011, Robust Speech Recognition of Uncertain or Missing Data: Theory and Application, 101, 10.1007/978-3-642-21317-5_5 · doi:10.1007/978-3-642-21317-5_5
- Gao, 2010, Proceedings of Conference on Information and Knowledge Management (CIKM).
- Gao, 2013, Proceedings of Neural Information Processing Systems (NIPS) Workshop on Deep Learning
- Gao, 2014, Proceedings of Association for Computational Linguistics (ACL).
- Gao, 2011, Proceedings of Special Interest Group on Information Retrieval (SIGIR).
- Gens, 2012, Neural Information Processing Systems (NIPS),
- Gibson, 2010, Error approximation and minimum phone error acoustic model estimation, IEEE Transactions on Audio, Speech, and Language Processing,, 18, 1269, 10.1109/tasl.2009.2032607 · DOI
- Glorot, 2010, Proceedings of Artificial Intelligence and Statistics (AISTATS).
- Glorot, 2011, Proceedings of Artificial Intelligence and Statistics (AIS-TATS
- Goodfellow, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Graves, 2012, Representation Learning Workshop, International Conference on Machine Learning (ICML),
- Graves, 2006, Proceedings of International Conference on Machine Learning (ICML).
- Graves, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Graves, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Grezl, 2008, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Gutmann, 2012, Noise-contrastive estimation of unnormalized statistical models, with applications to natural image statistics, Journal of Machine Learning Research,, 13, 307
- Hain, 2012, IEEE Transactions on Audio, Speech, and Language Processing,, 486
- Hamel, 2010, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Hawkins, 2004, On Intelligence: How a New Understanding of the Brain will lead to the Creation of Truly Intelligent Machines
- He, 2011, IEEE Signal Processing Magazine,
- He, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- He, 2013, Proceedings of the IEEE.
- Heigold, 2013, Investigations on an EM-style optimization algorithm for discriminative training of HMMs, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 2616, 10.1109/tasl.2013.2280234 · doi:10.1109/tasl.2013.2280234
- Heigold, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Heintz, 2009, Discriminative input stream combination for conditional random field phone recognition, IEEE Transactions on Audio, Speech, and Language Processing,, 17, 1533, 10.1109/tasl.2009.2022204 · doi:10.1109/tasl.2009.2022204
- Henderson, 2013, Proceedings of Special Interest Group on Disclosure and Dialogue (SIGDIAL).
- Hermans, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Hermansky, 2000, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Hinton, 1990, Artificial Intelligence,, 1
- Hinton, 2003, Canadian Psychology,, 10
- Hinton, 2011, A better way to learn features, Communications of the Association for Computing Machinery (ACM),, 54
- Hinton, 2006, Neural Computation,, 1527
- Hinton, 2010, Topics in Cognitive Science,, 1
- Huang, 2012, Proceedings of Association for Computational Linguistics (ACL).
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Association for Computing Machinery (ACM) International Conference Information and Knowledge Management (CIKM),
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2001, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Proceedings of Interspeech,, 2360
- Humphrey, 2012, Proceedings of International Conference on Machine Learning and Application (ICMLA).
- Humphrey, 2012, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Humphrey, 2013, Journal of Intelligent Information Systems,
- Hutchinson, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Hutchinson, 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence,, 1944
- Imseng, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Jaitly, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Jaitly, 2012, Proceedings of Interspeech.
- Jarrett, 2009, Proceedings of International Conference on Computer Vision,, 2146
- Kahou, 2013, Proceedings of International Conference on Multimodal Interaction (ICMI).
- Kang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 8012
- Kashiwagi, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Kavukcuoglu, 2010, Proceedings of Neural Information Processing Systems (NIPS
- Ketabdar, 2010, IEEE Transactions on Audio, Speech, and Language Processing,, 1094
- Kingsbury, 2009, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Kingsbury, 2012, Proceedings of Interspeech.
- Kiros, 2013, Proceedings of Neural Information Processing Systems (NIPS) Deep Learning Workshop.
- Ko, 2013, IEEE Transactions on Audio, Speech, and Language Processing, 1285
- Krizhevsky, 2012, Proceedings of Neural Information Processing Systems (NIPS).
- Kubo, 2012, Proceedings of Interspeech.
- Kurzweil, 2012, How to Create a Mind.
- Lal, 2013, IEEE Transactions on Audio, Speech, and Language Processing,, 2506
- Larochelle, 2008, Proceedings of International Conference on Machine Learning (ICML).
- Le, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Le, 2010, Proceedings of Empirical Methods in Natural Language Processing (EMNLP, 778
- Le, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Le, 2013, IEEE Transactions on Audio, Speech, and Language Processing, 197
- Le, 2011, Proceedings of International Conference on Machine Learning (ICML).
- Le, 2012, Proceedings of International Conference on Machine Learning (ICML).
- LeCun, 2012, Proceedings of European Conference on Computer Vision (ECCV).
- LeCun, 1995, The Handbook of Brain Theory and Neural Networks,, 255
- LeCun, 1998, Proceedings of the IEEE,, 2278
- LeCun, 2007, Proceedings of International Conference on Document Analysis and Recognition (ICDAR).
- Lee, 2004, Proceedings of International Conference on Spoken Language Processing (ICSLP),, 109
- Lee, 2009, Proceedings of International Conference on Machine Learning (ICML).
- Lee, 2011, Communications of the Association for Computing Machinery (ACM),, 95
- Lee, 2010, Proceedings of Neural Information Processing Systems (NIPS
- Lena, 2012, Proceedings of Neural Information Processing Systems (NIPS).
- Li, 2014, IEEE/Association for Computing Machinery (ACM) Transactions on Audio, Speech, and Language Processing, 1
- Li, 2012, Proceedings of IEEE Spoken Language Technology (SLT
- Li, 2013, Proceedings Conference on Affective Computing and Intelligent Interaction (ACII),, 312
- Liao, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Liao, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Lin, 2009, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Lin, 2011, Proceedings of Computer Vision and Pattern Recognition (CVPR
- Ling, 2013, Modeling spectral envelopes using restricted boltzmann machines for statistical parametric speech synthesis, International Conference on Acoustics Speech and Signal Processing (ICASSP),, 7825
- Ling, 2013, Articulatory control of HMM-based parametric speech synthesis using feature-space-switched multiple regression
- Lu, 2013, Joint uncertainty decoding for noise robust subspace gaussian mixture models, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 1791, 10.1109/tasl.2013.2248718 · doi:10.1109/tasl.2013.2248718
- Ma, 2000, Computer, Speech and Language
- Maas, 2013, Rectifier nonlinearities improve neural network acoustic models
- Manning, 2009, Introduction to Information Retrieval.
- J.Markoff, 2012, Scientists see promise in deep-learning programs
- Martens, 2010, Deep learning with hessian-free optimization
- Martens, 2011, Learning recurrent neural networks with hessian-free optimization
- McGraw, 2013, Learning lexicons from speech using a pronunciation mixture model, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 357, 10.1109/tasl.2012.2226158 · DOI
- Mikolov, 2013, Efficient estimation of word representations in vector space
- Mikolov, 2010, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 1045
- Mikolov, 2013, Distributed representations of words and phrases and their compositionality
- Minami, 2002, A recognition method with parametric trajectory synthesized using direct relations between static and dynamic feature vector time series, 957
- Mnih, 2008, A scalable hierarchical distributed language model, 1081
- Mnih, 2013, Learning word embeddings efficiently with noise-contrastive estimation
- Mnih, 2013, laying arari with deep reinforcement learning
- Mohamed, 2009, Deep belief networks for phone recognition
- Morin, 2005, Hierarchical probabilistic neural network language models
- Murphy, 2012, Machine Learning
- Nair, 2009, 3-d object recognition with deep belief nets
- Ngiam, 2011, Learning deep energy models
- Ngiam, 2011, Multimodal deep learning
- Olshausen, 2012, Can ‘deep learning’ offer deep insights about visual representation?
- Ostendorf, 1999, Moving beyond the ‘beads-on-a-string’ model of speech
- Oudre, 2011, Probabilistic template-based chord recognition, IEEE Transactions on Audio, Speech, and Language Processing, 19, 2249, 10.1109/tasl.2010.2098870 · doi:10.1109/tasl.2010.2098870
- Palangi, 2013, Learning input and recurrent weight matrices in echo state networks
- Palangi, 2013, Using deep stacking network to improve structured compressive sensing with multiple measurement vectors
- Pascanu, 2014, How to construct deep recurrent neural networks
200 of 276 shown
Cited by
Items 501–600 of 1,005
A deep architecture for depression detection using posting, behavior, and living environment data
Wu, M. Y., Shen, C.-Y., Wang, E. T., & Chen, A. L. P. (2018) · Journal of Intelligent Information Systems · doi:10.1007/s10844-018-0533-4 · Cited by 85
An evolutionary deep belief network extreme learning-based for breast cancer diagnosis
Ronoud, S., & Asadi, S. (2019) · Soft Computing · doi:10.1007/s00500-019-03856-0 · Cited by 78
“It has been observed that shallow architectures have been effective in solving many simple or finite problems, but their limited capacity in modeling and representation can trigger problems in dealing with more complex real-world applications (Deng and Yu 2014).”
BackgroundDeepLoRa: Learning Accurate Path Loss Model for Long Distance Links in LPWAN
Liu, L., Yao, Y., Cao, Z., & Zhang, M. (2021) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom42981.2021.9488784 · Cited by 91
“Then, we resort to deep learning technique [16]–[18] to model the influence of a specific land-cover distribution on path loss.”
MethodElenchezhian, M. R. P., Vadlamudi, V., Raihan, R., Reifsnider, K., & Reifsnider, E. S. (2021) · Smart Materials and Structures · doi:10.1088/1361-665x/ac099f · Cited by 77
Ma, X., Guo, G., Wu, X., Wu, Q., Liu, F., Zhang, H., Shi, N., & Guan, Y. (2023) · Micromachines · doi:10.3390/mi14050972 · Cited by 77
The Art of Finding the Right Drug Target: Emerging Methods and Strategies
Jia, Z.-C., Yang, X., Wu, Y., Li, M., Das, D., Chen, M., & Wu, J. (2024) · Pharmacological Reviews · doi:10.1124/pharmrev.123.001028 · Cited by 78
Liu, C., Li, H., Li, K., Wu, Y., & Lv, B. (2025) · Energies · doi:10.3390/en18061463 · Cited by 84
Frei, M., & Kruis, F. E. (2019) · Powder Technology · doi:10.1016/j.powtec.2019.10.020 · Cited by 75
“Due to this strategy, CNNs usually apply a drastically increased number of layers in comparison to conventional ANNs, which inspired the term deep learning [24].”
BackgroundPredicting 30-day hospital readmissions using artificial neural networks with medical code embedding
Liu, W., Singh, K., Ryan, A. M., Sukul, D., Mahmoudi, E., Waljee, A. K., Stansbury, C. M., Zhu, J., & Nallamothu, B. K. (2020) · PLoS ONE · doi:10.1371/journal.pone.0221606 · Cited by 79
Diets, nutrients, genes and the microbiome: recent advances in personalised nutrition
Matusheski, N. V., Caffrey, A., Christensen, L., Mezgec, S., Surendran, S., Hjorth, M. F., McNulty, H., Pentieva, K. D., Roager, H. M., Seljak, B. K., et al. (2021) · British Journal Of Nutrition · doi:10.1017/s0007114521000374 · Cited by 83
“Deep learning, or deep neural networks, allows computational models composed of multiple processing layers to learn relevant image features through training on a set of input images(95,96).”
BackgroundDeep preference learning for multiple criteria decision analysis
Martyn, K., & Kadziński, M. (2022) · European Journal of Operational Research · doi:10.1016/j.ejor.2022.06.053 · Cited by 73
Hasanzadeh, A., Hamblin, M. R., Kiani, J., Noori, H., Hardie, J. M., Karimi, M., & Shafiee, H. (2022) · Nano Today · doi:10.1016/j.nantod.2022.101665 · Cited by 74
Traffic matrix prediction and estimation based on deep learning in large-scale IP backbone networks
Nie, L., Jiang, D., Guo, L., & Yu, S. (2016) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2016.10.006 · Cited by 73
“where E (v, h) is termed as the energy function [14].”
BackgroundMethodInfluentialFuzzy deep learning based urban traffic incident detection
Hatri, C. E., & Boumhidi, J. (2017) · Cognitive Systems Research · doi:10.1016/j.cogsys.2017.12.002 · Cited by 73
“It has been applied with success in classification tasks, natural language processing, object detection, traffic data prediction and so on [10-13].”
BackgroundMethodA Deep-Learning-Based Forecasting Ensemble to Predict Missing Data for Remote Sensing Analysis
Das, M., & Ghosh, S. K. (2017) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2017.2760202 · Cited by 73
“…with six other temporal and hybrid models, namely nonlinear auto-regressive neural network (NARNET, using NN toolbox of MATLAB), multilayer per-ceptron (MLP), spatiotemporal ordinary kriging (ST-OK, using “spacetime” package of R-tool), DSN [14], the Deep-STEP_F model, and the Deep-STEP_B model.”
BackgroundMethodRecent advances in the application of deep learning methods to forestry
Wang, Y., Zhang, W., Gao, R. H., Zheng, J., & Wang, X. (2021) · Wood Science and Technology · doi:10.1007/s00226-021-01309-2 · Cited by 72
Deep learning-based approach for detecting COVID-19 in chest X-rays
Şahin, M. E. (2022) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2022.103977 · Cited by 83
“Deep learning is a machine learning technique that makes use of many nonlinear information processing layers and is used for feature extraction, pattern analysis and classification in supervised or unsupervised learning [41].”
MethodEMD and VMD Empowered Deep Learning for Radio Modulation Recognition
Chen, T., Gao, S., Zheng, S., Yu, S., Xuan, Q., Lou, C., & Yang, X. (2022) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2022.3218694 · Cited by 80
“In recent years, deep learning (DL) has become a hot research topic in the field of artificial intelligence (AI), and has achieved excellent results in many fields, such as image recognition, natural language processing, and machine translation [17].”
BackgroundA Review of Neural Networks for Anomaly Detection
Filho, J. E. D. A., Brandão, L. C. P., Fernandes, B., & Maciel, A. M. A. (2022) · IEEE Access · doi:10.1109/access.2022.3216007 · Cited by 88
Tusher, E. H., Ismail, M. A., Rahman, M. A., Alenezi, A. H., & Uddin, M. (2024) · IEEE Access · doi:10.1109/access.2024.3467996 · Cited by 72
“They also explored various applications of these techniques, including computer vision, language modelling, text processing, multimodal learning, and information retrieval [64], [65].”
BackgroundDeep learning in intrusion detection perspective: Overview and further challenges
Kim, K., & Aminanto, M. E. (2017) · International Workshop on Big Data and Information Security (IWBIS) · doi:10.1109/iwbis.2017.8275095 · Cited by 72
“Deng [21] differentiates deep learning into three sub-groups, generative, discriminative and hybrid.”
BackgroundBig Data in Organizations and the Role of Human Resource Management
Scholz, T. M. (2017) · Peter Lang D eBooks · doi:10.3726/b10907 · Cited by 80
Improving sentiment classification using a RoBERTa-based hybrid model
Semary, N. A., Ahmed, W., Amin, K., Pławiak, P., & Hammad, M. (2023) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2023.1292010 · Cited by 71
“Many different applications, including energy and medicine, use Recurrent Neural Network (RNN) -based modeling techniques (Deng and Yu, 2014; Choudhary et al., 2022).”
BackgroundA Survey on Goal-Oriented Semantic Communication: Techniques, Challenges, and Future Directions
Getu, T. M., Kaddoum, G., & Bennis, M. (2024) · IEEE Access · doi:10.1109/access.2024.3381967 · Cited by 96
Deep learning in two-dimensional materials: Characterization, prediction, and design
Meng, X., Qin, C., Liang, X., Zhang, G., Chen, R., Hu, J., Yang, Z., Huo, J., Xiao, L., & Jia, S. (2024) · Frontiers of Physics · doi:10.1007/s11467-024-1394-7 · Cited by 77
Artificial Intelligence of Things for Solar Energy Monitoring and Control
Boucif, O. H., Lahouaou, A. M., Boubiche, D. E., & Toral-Cruz, H. (2025) · Applied Sciences · doi:10.3390/app15116019 · Cited by 81
Unsupervised deep learning reveals prognostically relevant subtypes of glioblastoma
Young, J. D., Cai, C., & Lu, X. (2017) · BMC Bioinformatics · doi:10.1186/s12859-017-1798-2 · Cited by 70
“Although it may be clearer and more explicit to refer to the strategy used in this study as a stacked restricted Boltzmann machines – deep autoencoder (SRBM – DA), we will use the more traditional DBN terminology [1, 13 – 15] for the sake of being consistent with the literature.”
BackgroundMethodInfluentialÁlvarez, J. R., Arroqui, M., Mangudo, P., Toloza, J. M., Jatip, D., Rodríguez, J. M., Teyseyre, A., Sanz, C., Zunino, A., Machado, C. F., et al. (2019) · Agronomy · doi:10.3390/agronomy9020090 · Cited by 71
Distributed additive encryption and quantization for privacy preserving federated deep learning
Zhu, H., Wang, R., Jin, Y., Liang, K., & Ning, J. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.08.062 · Cited by 87
Mathur, A., Zhang, T., Bhattacharya, S., Velickovic, P., Joffe, L., Lane, N. D., Kawsar, F., & Lio, P. (2018) · 2018 17th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · doi:10.1109/ipsn.2018.00048 · Cited by 70
“In this paper, we investigate how deep learning algorithms [15] can be used to build models of context and activity that are significantly more robust to forms of sensor heterogeneity than existing models.”
Deep Challenges Associated with Deep Learning
Sharma, O. (2019) · International Conference on Machine Learning, Big Data, Cloud and Parallel Computing (COM-IT-CON) · doi:10.1109/comitcon.2019.8862453 · Cited by 70
Towards Device-Agnostic Mobile Cough Detection with Convolutional Neural Networks
Barata, F., Kipfer, K., Weber, M., Tinschert, P., Fleisch, E., & Kowatsch, T. (2019) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi.2019.8904554 · Cited by 81
“They are based on artificial neural networks [29] and can be characterized as a model consisting of a cascade of multiple layers of nonlinear information processing [30].”
BackgroundBagherzadeh, S., Maghooli, K., Shalbaf, A., & Maghsoudi, A. (2022) · Cognitive Neurodynamics · doi:10.1007/s11571-021-09756-0 · Cited by 73
“CNN is a specific type of neural networks which widely utilized in biomedical signal processing and classification applications (Saeedi et al. 2020a; Faust et al. 2018; Craik et al. 2019; Deng and Yu 2014).”
BackgroundA Memristor-Based Optimization Framework for Artificial Intelligence Applications
Liu, S., Wang, Y., Fardad, M., & Varshney, P. K. (2018) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2017.2785421 · Cited by 76
“Training a multi-layer neural network requires the implementation of a back-propagation algorithm [23] for synaptic weight update.”
BackgroundExploiting the generative adversarial framework for one-class multi-dimensional fault detection
Plakias, S., & Boutalis, Y. S. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.12.041 · Cited by 70
Na, H., Choi, J.-H., Kim, H.-S., & Kim, T. (2019) · Building and Environment · doi:10.1016/j.buildenv.2019.106216 · Cited by 73
Tkachenko, R., Izonin, I., Vitynskyi, P., Lotoshynska, N., & Pavliuk, O. (2018) · Data · doi:10.3390/data3040046 · Cited by 71
“They are designed primarily for image processing tasks [14].”
BackgroundZhang, X., Zhao, M. Y., & Dong, R. (2020) · Applied Sciences · doi:10.3390/app10031144 · Cited by 81
“Deep learning has developed rapidly and has been successfully applied in many specialties lately [37].”
BackgroundStudy on emotion recognition and companion Chatbot using deep neural network
Lee, M.-C., Chiang, S., Yeh, S., & Wen, T.-F. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-08841-6 · Cited by 81
A DNN-Based Channel Model for Network Planning in Train Control Systems
Wen, T., Xie, G., Cao, Y., & Cai, B. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3093025 · Cited by 69
“…deep convolutional neural networks and recurrent neural networks, have been widely used in many research fields and received remarkable performance [19], such as in speech recognition [20], [21], image classification [22], [23], object detection [24], [25], image semantic segmentation [26], [27],…”
BackgroundA Survey on Cyber Situation-awareness Systems: Framework, Techniques, and Insights
Alavizadeh, H., Jang‐Jaccard, J., Enoch, S. Y., Al-Sahaf, H., Welch, I. S., Camtepe, S. A., & Kim, D. S. (2022) · ACM Computing Surveys · doi:10.1145/3530809 · Cited by 73
“They conducted research for the anomaly intrusion detection scheme using deep learning methods called Deep Belief Network (DBN) [38].”
MethodAlcañiz, J. E. B., Mafé, C. R., Cabañero, C. P., & Ballester, A. C. C. (2023) · Service Business · doi:10.1007/s11628-023-00524-0 · Cited by 73
“We carried out an automatic sentiment analysis using deep learning, a class of ML technique applied to natural language processing (Deng and Yu 2014; Timoshenko and Hauser 2019).”
MethodHow Machine Learning (ML) is Transforming Higher Education: A Systematic Literature Review
Pinto, A. S., Abreu, A., Costa, E., & Paiva, J. (2023) · Journal of Information Systems Engineering and Management · doi:10.55267/iadt.07.13227 · Cited by 49
Evolutionary Algorithms Applied to Antennas and Propagation: A Review of State of the Art
Goudos, S. K., Kalialakis, C., & Mittra, R. (2016) · International Journal of Antennas and Propagation · doi:10.1155/2016/1010459 · Cited by 76
“Deep learning is a type ofmachine learning based on a set of algorithms that attempt tomodel high-level abstractions in data by using a deep graph with multiple processing layers, composed of multiple linear and nonlinear transformations [132–135].”
BackgroundAutomatic Lymphocyte Detection on Gastric Cancer IHC Images Using Deep Learning
Garcia, E., Hermoza, R., Beltrán, C., Cano, L., Castillo, M., & Castaneda, C. (2017) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms.2017.94 · Cited by 69
“In the last few years, it has changed the way of working in signal processing considerably[5].”
BackgroundExecution anomaly detection in large-scale systems through console log analysis
Bao, L., Li, Q., Lu, P., Lu, J., Ruan, T., & Zhang, K. (2018) · Journal of Systems and Software · doi:10.1016/j.jss.2018.05.016 · Cited by 67
A Survey on Collaborative Deep Learning and Privacy-Preserving
Zhang, D., Chen, X., Wang, D., & Shi, J. (2018) · 2018 IEEE Third International Conference on Data Science in Cyberspace (DSC) · doi:10.1109/dsc.2018.00104 · Cited by 63
“In recent years, deep learning proves extremely effective at learning nonlinear features and functions from complex data, and has been widely used in text recognition [1], social networking [2], biomedical [3] and other fields.”
BackgroundCurrency Detection and Recognition Based on Deep Learning
Zhang, Q., & Yan, W. Q. (2018) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2018.8639124 · Cited by 78
“The processing effect of different layers is different [1].”
BackgroundModel Based on Deep Feature Extraction for Diagnosis of Alzheimer’s Disease
Silva, I. R. R., Silva, G. D. S. L. E., de Souza, R. G., dos Santos, W. P., & Fagundes, R. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852138 · Cited by 70
“having the use of a CNN, deep MLP, or autoencoders [11].”
MethodAnalysis of Deep Learning Methods for Healthcare Sector - Medical Imaging Disease Detection
Sahu, H., Kashyap, R., Bhatia, S., Dewangan, B. K., Alkhaldi, N. A., Parisapogu, S. A. B., & Mohan, S. (2023) · Contemporary Mathematics · doi:10.37256/cm.4420232496 · Cited by 71
“An artificial neural network (ANN), a pair or more convolution layers, is the simplest description of a DL architecture that seeks to increase prediction accuracy [ 24 ].”
BackgroundDecentralized Collective Learning for Self-managed Sharing Economies
Pournaras, E., Pilgerstorfer, P., & Asikis, T. (2018) · ACM Transactions on Autonomous and Adaptive Systems · doi:10.1145/3277668 · Cited by 79
Classification of Melanoma Skin Cancer using Convolutional Neural Network
Refianti, R., Mutiara, A. B., & Poetri, R. (2019) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2019.0100353 · Cited by 67
“Deep Learning Deep learning is a machine learning technique that utilizes many layers of nonlinear information processing to perform feature extraction, pattern recognition, and classification [2].”
BackgroundDeep Learning Sensor Fusion in Plant Water Stress Assessment: A Comprehensive Review
Kamarudin, M. H., Ismail, Z. H., & Saidi, N. B. (2021) · Applied Sciences · doi:10.3390/app11041403 · Cited by 78
“The method of learning used can be supervised or unsupervised with feature representation in the form of high-level abstraction [31].”
MethodBayesian neural networks for stock price forecasting before and during COVID-19 pandemic
Chandra, R., & He, Y. (2021) · PLoS ONE · doi:10.1371/journal.pone.0253217 · Cited by 79
“Deep learning refers to a special type neural networks which consists of multiple processing layers and enables high-level abstraction to model data [55].”
BackgroundNeural Architecture Search for 1D CNNs—Different Approaches Tests and Measurements
Cordeiro, J. R., Raimundo, A., Postolache, O. A., & Sebastião, P. J. A. (2021) · Sensors · doi:10.3390/s21237990 · Cited by 76
An Ensemble Framework for Short-Term Load Forecasting Based on TimesNet and TCN
Zuo, C., Wang, J., Liu, M., Deng, S., & Wang, Q. (2023) · Energies · doi:10.3390/en16145330 · Cited by 67
Oyebisi, S. O., & Alomayri, T. S. (2023) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2023.132606 · Cited by 67
Li, Z., Wang, Y., & Wang, K. (2017) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-017-1380-9 · Cited by 70
“The family of deep learning approaches have been growing increasingly richer, encompassing variety of neural networks with multiple processing layers, hierarchical probabilistic models, and kinds of unsupervised or supervised feature learning algorithms (Deng and Yu 2014).”
BackgroundImage annotation: Then and now
Bhagat, P. K., & Choudhary, P. (2018) · Image and Vision Computing · doi:10.1016/j.imavis.2018.09.017 · Cited by 72
A Comprehensive Review on Medical Diagnosis Using Machine Learning
Bhavsar, K. A., Abugabah, A., Singla, J., AlZubi, A. A., Bashir, A. K., & Nikita, N. (2021) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2021.014943 · Cited by 84
“This model learns through multiple levels of representation to find complex relationships among data [20,21].”
BackgroundKutia, S., Chauhdary, S. H., Iwendi, C., Liu, L., Wang, Y., & Bashir, A. K. (2019) · IEEE Access · doi:10.1109/access.2019.2924584 · Cited by 71
“Based on ideas of deep learning [2]–[4], [6], [14], [16], [17], [38], [41] we used the proposed methodology.”
MethodAn image-based system for pavement crack evaluation using transfer learning and wavelet transform
Ranjbar, S., Nejad, F. M., & Zakeri, H. (2020) · International Journal of Pavement Research and Technology · doi:10.1007/s42947-020-0098-9 · Cited by 67
“Deep learning (DL) is one of the ML technique that extract features automatically [23,24].”
BackgroundApplication of Pre-Trained Deep Convolutional Neural Networks for Rice Plant Disease Classification
Shrivastava, V. K., Pradhan, M. K., & Thakur, M. P. (2021) · International Conference on Artificial Intelligence and Smart Energy (ICAIS) · doi:10.1109/icais50930.2021.9395813 · Cited by 73
“It has achieved significant success in various domains such as classification [20][21], natural language processing [22], audio processing [23] and computer vision [24-25] In the remainder of the paper, section 2 gives a description of rice plant dataset, transfer learning and pre-trained deep CNN…”
BackgroundRole of artificial intelligence in early diagnosis and treatment of infectious diseases
Srivastava, V., Kumar, R., Wani, M. Y., Robinson, K. M., & Ahmad, A. (2024) · Scandinavian Journal of Infectious Diseases · doi:10.1080/23744235.2024.2425712 · Cited by 81
“DL is more advanced ML that uses multiple layers to continuously extract higher levels of features from raw or original data [75].”
A Comparison Study of Classifier Algorithms for Cross-Person Physical Activity Recognition
Sáez, Y., Baldominos, A., & Isasi, P. (2016) · Sensors · doi:10.3390/s17010066 · Cited by 77
SAFS: A deep feature selection approach for precision medicine
Nezhad, M. Z., Zhu, D., Li, X., Yang, K., & Levy, P. D. (2016) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2016.7822569 · Cited by 73
Evaluating deep learning models for sentiment classification
Ay, B., Talo, M., Hallaç, İ. R., & Aydın, G. (2018) · Concurrency and Computation Practice and Experience · doi:10.1002/cpe.4783 · Cited by 66
Deep Reinforcement Learning with a Combinatorial Action Space for Predicting Popular Reddit Threads
He, J., Ostendorf, M., He, X., Chen, J., Gao, J., Li, L., & Deng, L. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1189 · Cited by 51
“Recent advances in deep learning (LeCun et al., 2015; Deng and Yu, 2014; Hinton et al., 2012; Krizhevsky et al., 2012; Sordoni et al., 2015) inspired significant progress by combining deep learning with reinforcement learning (Mnih et al., 2015; Silver et al., 2016; Lillicrap et al., 2016; Duan et…”
BackgroundSelf-citationKhan, H. A., Sehatbakhsh, N., Nguyen, L. N., Prvulović, M., & Zajic, A. G. (2019) · Journal of Hardware and Systems Security · doi:10.1007/s41635-019-00074-w · Cited by 74
Deep Texture Features for Robust Face Spoofing Detection
de Souza, G. B., Santos, D. F. D. S., Pires, R. G., Marana, A. N., & Papa, J. P. (2017) · IEEE Transactions on Circuits & Systems II Express Briefs · doi:10.1109/tcsii.2017.2764460 · Cited by 65
“Besides convolutional and sampling operations, layers with neurons completely connected can be included at the top of the network for classification [12]–[14].”
BackgroundDzieżyc, M., Gjoreski, M., Kazienko, P., Saganowski, S., & Gams, M. (2020) · Sensors · doi:10.3390/s20226535 · Cited by 73
“DL represents a class of ML algorithms that use a cascade of multiple layers of nonlinear processing units, which are typically neurons [33].”
BackgroundDigital nanophotonics: the highway to the integration of subwavelength‐scale photonics
Huang, J., Ma, H., Chen, D., Yuan, H., Zhang, J., Li, Z., Han, J., Wu, J., & Yang, J. (2020) · Nanophotonics · doi:10.1515/nanoph-2020-0494 · Cited by 67
Haq, A. U., Li, J., Agbley, B. L. Y., Mawuli, C. B., Ali, Z., Nazir, S., & Din, S. U. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118045 · Cited by 73
Weng, S.-S., & Chen, H.-C. (2020) · Sustainability · doi:10.3390/su12020625 · Cited by 69
Turner, O. C., Aeffner, F., Bangari, D. S., High, W., Knight, B., Forest, T., Cossic, B., Himmel, L. E., Rudmann, D. G., Bawa, B., et al. (2020) · Toxicologic Pathology · doi:10.1177/0192623319881401 · Cited by 64
“This is done in the form of encoded domain-specific insights or proportions, which guide the creation of the learned representation.(28,31,33,42) The DL approach involves deriving an appropriate feature space only from the data itself.”
MethodAfandizadeh, S., Abdolahi, S., & Mirzahossein, H. (2024) · Journal of Advanced Transportation · doi:10.1155/2024/9981657 · Cited by 64
Performance evaluation of unsupervised techniques in cyber-attack anomaly detection
Meira, J., Andrade, R., Praça, I., Carneiro, J., Bolón‐Canedo, V., Alonso‐Betanzos, A., & Marreiros, G. (2019) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-019-01417-9 · Cited by 71
“An Autoencoder is a neural network that is part of a sub-area of machine learning called Deep learning [sets of algorithms with several layers of processing which are used to model high-level abstractions of data (Deng et al. 2014)].”
MethodLi, Q., Sun, X., Dong, J., Song, S., Zhang, T., Liu, D., Zhang, H., & Han, S. (2019) · ICES Journal of Marine Science · doi:10.1093/icesjms/fsz171 · Cited by 64
Integrated design of emulsified cosmetic products: A review
Calvo, F., Gómez, J. M., Ricardez‐Sandoval, L., & Álvarez, Ó. (2020) · Process Safety and Environmental Protection · doi:10.1016/j.cherd.2020.07.014 · Cited by 64
Alexakos, C. T., Karnavas, Y. L., Drakaki, M., & Tziafettas, I. A. (2021) · Machine Learning and Knowledge Extraction · doi:10.3390/make3010011 · Cited by 66
“Their increased processing capabilities, the huge amount of data used for training and the recent advances in machine learning and signal processing are the main reasons for being held in high regard by researchers [14,15].”
BackgroundContent-based medical image retrieval system for lung diseases using deep CNNs
Agrawal, S., Chowdhary, A., Agarwala, S., Mayya, V., & Kamath, S. S. (2022) · International Journal of Information Technology · doi:10.1007/s41870-022-01007-7 · Cited by 64
“Deep learning-based algorithms learn many levels of representations to model complex data interactions [14].”
BackgroundTrust Management in Social Internet of Things (SIoT): A Survey
Alam, S., Zardari, S., Noor, S., Ahmed, S., & Mouratidis, H. (2022) · IEEE Access · doi:10.1109/access.2022.3213699 · Cited by 68
“Deep learning is the calculation of hierarchical representations of observable data, where higher-level factors are described from lower-level factors [74].”
BackgroundGenerating risk response measures for subway construction by fusion of knowledge and deep learning
Zhou, H. M., Tang, S., Huang, W. T., & Zhao, X. (2023) · Automation in Construction · doi:10.1016/j.autcon.2023.104951 · Cited by 67
Urban noise recognition with convolutional neural network
Cao, J., Cao, M., Wang, J., Yin, C., Wang, D., & Vidal, P. (2018) · Multimedia Tools and Applications · doi:10.1007/s11042-018-6295-8 · Cited by 69
iHear Food: Eating Detection Using Commodity Bluetooth Headsets
Gao, Y., Zhang, N., Wang, H., Ding, X., Ye, X., Chen, G., & Cao, Y. (2016) · 2016 IEEE First International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE) · doi:10.1109/chase.2016.14 · Cited by 63
“The second approach we propose is based on Deep Learning (DL) algorithms, which are now key elements in achieving state-ofthe-art inference performance in a variety of applications of learning [12], and the detection accuracy drastically improved to 77-94% in free-living environments.”
MethodEnd‐to‐End Deep Learning Methodology for Real‐Time Traffic Network Management
Hashemi, H., & Abdelghany, K. (2018) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12376 · Cited by 59
Applications of Machine Learning to Friction Stir Welding Process Optimization
Nasir, T., Asmael, M., Zeeshan, Q., & Solyalı, D. (2020) · Jurnal Kejuruteraan · doi:10.17576/jkukm-2020-32(2)-01 · Cited by 69
“The application of deep learning is available in all industries from automated driven to medical devices (Deng, 2014).”
BackgroundLouis, C. M., Erwin, A., Handayani, N., Polim, A. A., Boediono, A., & Sini, I. R. (2021) · Journal of Assisted Reproduction and Genetics · doi:10.1007/s10815-021-02123-2 · Cited by 69
“Deep Learning (DL) is a concept evolved from Machine Learning (ML) technology within the AI superset, whose development has vastly improved the scopes of machine learning and artificial intelligence-related technology [19].”
BackgroundAutomated structural bolt looseness detection using deep learning‐based prediction model
Yuan, C., Wang, S.-Y., Qi, Y., & Kong, Q. (2021) · Structural Control and Health Monitoring · doi:10.1002/stc.2899 · Cited by 67
“41 But a reliable acoustic indicator to quantify bolt preloads is yet to be developed as feature engineering guided by manpower might introduce randomness and specificity into the model, deteriorating its generalization abilities.”
BackgroundCao, Y., Sun, Z., Li, L., & Mo, W. (2022) · Symmetry · doi:10.3390/sym14081604 · Cited by 67
“Sentiment Analysis (SA) is the process of classifying opinions and mining subjective texts with emotional overtones using natural language processing and text mining techniques [1].”
BackgroundApplications of artificial intelligence in the field of air pollution: A bibliometric analysis
Guo, Q., Ren, M., Wu, S., Sun, Y., Wang, J., Wang, Q., Ma, Y., Song, X., & Chen, Y. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.933665 · Cited by 75
“Deep learning is based on machine learning algorithms, using multiple layers to progressively extract higher-level features from the raw input (36).”
Chest pathology identification using deep feature selection with non-medical training
Bar, Y., Diamant, I., Wolf, L., Lieberman, S., Konen, E., & Greenspan, H. K. (2016) · Computer Methods in Biomechanics and Biomedical Engineering Imaging & Visualization · doi:10.1080/21681163.2016.1138324 · Cited by 74
Tan, J., NourEldeen, N., Mao, K., Shi, J., Li, Z.-L., Xu, T., & Yuan, Z. (2019) · Sensors · doi:10.3390/s19132987 · Cited by 63
“[31].”
MethodDeep belief network-based support vector regression method for traffic flow forecasting
Xu, H., & Jiang, C. (2019) · Neural Computing and Applications · doi:10.1007/s00521-019-04339-x · Cited by 63
“In recent years, deep learning [11, 12] has received a lot of attention from researchers and business people as a new machine learning method.”
BackgroundMultimodal super-resolution reconstruction of infrared and visible images via deep learning
Wang, B., Zou, Y. L., Zhang, L., Li, Y., Chen, Q., & Zuo, C. (2022) · Optics and Lasers in Engineering · doi:10.1016/j.optlaseng.2022.107078 · Cited by 66
An Empirical Evaluation of Deep Learning for Network Anomaly Detection
Malaiya, R. K., Kwon, D., Kim, J., Suh, S. C., Kim, H., & Kim, I. (2018) · 2018 International Conference on Computing, Networking and Communications (ICNC) · doi:10.1109/iccnc.2018.8390278 · Cited by 62
“In fact, deep learning has widely been considered for a diverse range of applications including image processing, natural language processing, computer vision, and so forth [12], [13].”
BackgroundArtificial Intelligence in Process Engineering
Thon, C., Finke, B., Kwade, A., & Schilde, C. (2021) · Advanced Intelligent Systems · doi:10.1002/aisy.202000261 · Cited by 67
Predicting Road Crash Severity Using Classifier Models and Crash Hotspots
Islam, M. K., Reza, I., Gazder, U., Akter, R., Arifuzzaman, M., & Rahman, M. M. (2022) · Applied Sciences · doi:10.3390/app122211354 · Cited by 62
“It examines many layers of non-linear information, both supervised and un-supervised, to interpret or categorize patterns [49].”
Opinion Leaders for Information Diffusion Using Graph Neural Network in Online Social Networks
Jain, L., Katarya, R., & Sachdeva, S. (2023) · ACM Transactions on the Web · doi:10.1145/3580516 · Cited by 73
“Web stern deep learning archetypes such as Artificial neural network (ANN), Recurrent Neural Network, Convolution Neural Network(CNN), Autoencoders, Long-Short-Term-Memory(LSTM) and many more [3].”
BackgroundJaison, A., Mohan, A., & Lee, Y. (2024) · Materials Science and Engineering R Reports · doi:10.1016/j.mser.2024.100880 · Cited by 64
Metadata
- Authors
- Deng, L., & Yu, D.
- Affiliations
- Microsoft (United States) (US)
- Venue
- Foundations and Trends® in Signal Processing
- Publisher
- Emerald
- Published
- 2014-06-30
- Volume
- 7
- Issue
- 3-4
- Pages
- 197-387
- ISSN
- 1932-8346 (ISSN-L)
- 1932-8354
- OpenAlex
- W4205947740
- Cited by
- 3,480
- References
- 21
- Citations by year
- 2026: 113 · 2025: 206 · 2024: 298 · 2023: 410 · 2022: 469 · 2021: 453 · 2020: 404 · 2019: 426 · 2018: 304 · 2017: 188 · 2016: 146 · 2015: 57 · 2014: 3
- FWCI
- 117.48
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Foundations and Trends® in Signal Processing (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- deep learning, signal processing, information processing, speech recognition, computer vision, natural language processing, text processing, information retrieval, multimodal information processing, multi-task learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.