Deep Learning: Methods and Applications
Open accessThe DOI matches its Crossref record; 28 of the 168 references it cites were found in a registry or an index, and 140 are not checked yet.
Abstract
This monograph provides an overview of general deep learning methodology and its applications to a variety of signal and information processing tasks. The application areas are chosen with the following three criteria in mind: (1) expertise or knowledge of the authors; (2) the application areas that have already been transformed by the successful use of deep learning technology, such as speech recognition and computer vision; and (3) the application areas that have the potential to be impacted significantly by deep learning and that have been experiencing research growth, including natural language and text processing, information retrieval, and multimodal information processing empowered by multi-task deep learning.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Deep learning is successfully used as a tool for machine learning, where a neural network is capable of automatically learning features.”
From Medical image analysis using convolutional neural networks: a review (2018) · cites this paper as [47]
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Self-citationLearning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239 · cited 6×
“Since 2006, deep structured learning, or more commonly called deep learning or hierarchical learning, has emerged as a new area of machine learning research [20, 163].”
BackgroundMethodInfluentialLearning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542 · cited 1×
“, speech or text), but until recently they had not been widely used partly because they are difficult to train to capture long-term dependencies, giving rise to gradient vanishing or gradient explosion problems which were known in early 1990s [29, 167].”
BackgroundWolpert, D. H. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80023-1 · Cited by 7,951
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878 · cited 1×
“[347] developed the recursive neural tensor network, where each layer is constructed similarly to that of the neural tensor network described in [340] with an illustration shown in Figure 8.”
MethodCaruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636 · cited 1×
“The several architectures discussed so far in this chapter for multimodal processing and learning can be regarded as special cases of more general multi-task learning and transfer learning [22, 47].”
Background
Research works printed but not linked: 276
- Abdel-Hamid, 2013, Proceedings of Interspeech,
- Abdel-Hamid, 2013, Proceedings of Interspeech.
- Abdel-Hamid, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Acero, 2000, Proceedings of Interspeech
- Alain, 2013, Proceedings of International Conference on Learning Representations (ICLR).
- Arisoy, 2012, Proceedings of the Joint Human Language Technology Conference and the North American Chapter of the Association of Computational Linguistics (HLT-NAACL) Workshop.
- Aslan, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Ba, 2013, Proceedings of Neural Information Processing Systems (NIPS
- Baldi, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- E. Battenberg , E.Schmidt, and J.Bello. Deep learning for music, special session at International Conference on Acoustics Speech and Signal Processing (ICASSP) (http://www.icassp2014.org/ special_sections.html#ss8), 2014.
- Batternberg, 2012, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Bell, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Bengio, 2008, Scholarpedia,
- Bengio, 2012, Deep learning of representations for unsupervised and transfer learning, Journal of Machine Learning Research Workshop and Conference Proceedings, 27, 17
- Bengio, 2013, Statistical Language and Speech Processing,, 1
- Bengio, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Bengio, 2000, Proceedings of Neural Information Processing Systems (NIPS
- Bengio, 2003, A neural probabilistic language model, Journal of Machine Learning Research,, 3, 1137
- Bengio, 2006, Proceedings of Neural Information Processing Systems (NIPS
- Bengio, 2013, Proceedings of International Conference on Machine Learning (ICML), 2014.
- Bengio, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Bergstra, 2012, Random search for hyper-parameter optimization, Journal on Machine Learning Research,, 3, 281
- Bilmes, 2010, Dynamic graphical models, IEEE Signal Processing Magazine,, 33, 29
- Bordes, 2013, Machine Learning,
- Bordes, 2011, Proceedings of Association for the Advancement of Artificial Intelligence (AAAI).
- Bottou, 2013, From machine learning to machine reasoning: An essay, Journal of Machine Learning Research,, 14, 3207
- Bottou, 2004, Proceedings of Neural Information Processing Systems (NIPS
- Boulanger-Lewandowski, 2012, Proceedings of International Conference on Machine Learning (ICML).
- Boulanger-Lewandowski, 2013, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Bourlard, 1993, Connectionist Speech Recognition: A Hybrid Approach.
- Breiman, 1996, Stacked regression, Machine Learning,, 24, 49, 10.1023/a:1018046112532 · doi:10.1023/a:1018046112532 · Paper page
- Cardinal, 2013, Large vocabulary speech recognition on parallel architectures, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 2290, 10.1109/tasl.2013.2271591 · doi:10.1109/tasl.2013.2271591
- Chen, 2014, Proceedings of International Conference on Learning Representations.
- Chen, 2012, Proceedings of Interspeech.
- Chengalvarayan, 1997, IEEE Transactions on Speech and Audio Processing, 243
- Chengalvarayan, 1997, IEEE Transactions on Speech and Audio Processing,, 232
- Chengalvarayan, 1998, Speech trajectory discrimination using the minimum classification error learning, IEEE Transactions on Speech and Audio Processing,, 6, 505, 10.1109/89.725317 · doi:10.1109/89.725317
- Cho, 2009, Proceedings of Neural Information Processing Systems (NIPS, 342
- Ciresan, 2012, Proceedings of Neural Information Processing Systems (NIPS
- Ciresan, 2010, Neural Computation
- Ciresan, 2011, Proceedings of International Joint Conference on Neural Networks (IJCNN).
- Ciresan, 2012, Proceedings of Computer Vision and Pattern Recognition (CVPR).
- Ciresan, 2012, Proceedings of International Joint Conference on Neural Networks (IJCNN).
- Coates, 2013, Proceedings of International Conference on Machine Learning (ICML).
- Cohen, 2005, Proceedings of International Joint Conference on Artificial Intelligence (IJCAI),, 671
- Collobert, 2011, Proceedings of Artificial Intelligence and Statistics (AISTATS
- Collobert, 2008, Proceedings of International Conference on Machine Learning (ICML).
- Collobert, 2011, Natural language processing (almost) from scratch, Journal on Machine Learning Research,, 12, 2493
- Dahl, 2010, Phone recognition with the mean-covariance restricted boltzmann machine, Proceedings of Neural Information Processing Systems (NIPS, 23, 469
- Dahl, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dahl, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dahl, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dean, 2012, Proceedings of Neural Information Processing Systems (NIPS
- Demuynck, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Deng, 1993, IEEE Transactions on Speech and Audio Processing, 471
- Deng, 2003, Mathematical Foundations of Speech and Language Processing,, 115
- Deng, 2011, Proceedings of Asian-Pacific Signal & Information Processing Annual Summit and Conference (APSIPA-ASC).
- Deng, 2012, The MNIST database of handwritten digit images for machine learning research, IEEE Signal Processing Magazine,, 29
- Deng, 2013, Neural Information Processing Systems (NIPS) Workshop on Learning Output Representations.
- Deng, 2013, Asian-Pacific Signal & Information Processing Association Transactions on Signal and Information Processing.
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2001, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2014, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 1992, Structural design of a hidden Markov model based speech recognizer using multi-valued phonetic features: Comparison with segmental speech units, Journal of the Acoustical Society of America,, 92, 3058, 10.1121/1.404202 · doi:10.1121/1.404202
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2004, Challenges in adopting speech recognition, Communications of the Association for Computing Machinery (ACM),, 47, 11
- Deng, 2012, Proceedings of Interspeech.
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2003, Speech Processing — A Dynamic and Optimization-Oriented Approach
- Deng, 1996, Transitional speech units and their representation by regressive Markov states: Applications to speech recognition, IEEE Transactions on speech and audio processing,, 4, 301, 10.1109/89.506934 · doi:10.1109/89.506934
- Deng, 2010, Proceedings of Interspeech.
- Deng, 2012, Proceedings of IEEE Workshop on Spoken Language Technologies
- Deng, 2002, Distributed speech processing in mipad’s multimodal user interface, IEEE Transactions on Speech and Audio Processing,, 10, 605, 10.1109/tsa.2002.804538 · doi:10.1109/tsa.2002.804538
- Deng, 2005, Dynamic compensation of HMM variances using the feature enhancement uncertainty computed from a parametric model of speech distortion, IEEE Transactions on Speech and Audio Processing,, 13, 412, 10.1109/tsa.2005.845814 · doi:10.1109/tsa.2005.845814
- Deng, 2007, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2011, Proceedings of Interspeech.
- Deng, 2009, Neural Information Processing Systems (NIPS) Workshop
- Deng, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deselaers, 2009, Proceedings of 4th Workshop on Statistical Machine Translation,, 233
- Dognin, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Erhan, Journal on Machine Learning Research,, 201
- Fernandez, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 6885
- Fine, 1998, Machine Learning, 41
- Frome, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Fu, 2007, Proceedings of Interspeech
- Gales, 2011, Robust Speech Recognition of Uncertain or Missing Data: Theory and Application, 101, 10.1007/978-3-642-21317-5_5 · doi:10.1007/978-3-642-21317-5_5
- Gao, 2010, Proceedings of Conference on Information and Knowledge Management (CIKM).
- Gao, 2013, Proceedings of Neural Information Processing Systems (NIPS) Workshop on Deep Learning
- Gao, 2014, Proceedings of Association for Computational Linguistics (ACL).
- Gao, 2011, Proceedings of Special Interest Group on Information Retrieval (SIGIR).
- Gens, 2012, Neural Information Processing Systems (NIPS),
- Gibson, 2010, Error approximation and minimum phone error acoustic model estimation, IEEE Transactions on Audio, Speech, and Language Processing,, 18, 1269, 10.1109/tasl.2009.2032607 · DOI
- Glorot, 2010, Proceedings of Artificial Intelligence and Statistics (AISTATS).
- Glorot, 2011, Proceedings of Artificial Intelligence and Statistics (AIS-TATS
- Goodfellow, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Graves, 2012, Representation Learning Workshop, International Conference on Machine Learning (ICML),
- Graves, 2006, Proceedings of International Conference on Machine Learning (ICML).
- Graves, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Graves, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Grezl, 2008, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Gutmann, 2012, Noise-contrastive estimation of unnormalized statistical models, with applications to natural image statistics, Journal of Machine Learning Research,, 13, 307
- Hain, 2012, IEEE Transactions on Audio, Speech, and Language Processing,, 486
- Hamel, 2010, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Hawkins, 2004, On Intelligence: How a New Understanding of the Brain will lead to the Creation of Truly Intelligent Machines
- He, 2011, IEEE Signal Processing Magazine,
- He, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- He, 2013, Proceedings of the IEEE.
- Heigold, 2013, Investigations on an EM-style optimization algorithm for discriminative training of HMMs, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 2616, 10.1109/tasl.2013.2280234 · doi:10.1109/tasl.2013.2280234
- Heigold, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Heintz, 2009, Discriminative input stream combination for conditional random field phone recognition, IEEE Transactions on Audio, Speech, and Language Processing,, 17, 1533, 10.1109/tasl.2009.2022204 · doi:10.1109/tasl.2009.2022204
- Henderson, 2013, Proceedings of Special Interest Group on Disclosure and Dialogue (SIGDIAL).
- Hermans, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Hermansky, 2000, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Hinton, 1990, Artificial Intelligence,, 1
- Hinton, 2003, Canadian Psychology,, 10
- Hinton, 2011, A better way to learn features, Communications of the Association for Computing Machinery (ACM),, 54
- Hinton, 2006, Neural Computation,, 1527
- Hinton, 2010, Topics in Cognitive Science,, 1
- Huang, 2012, Proceedings of Association for Computational Linguistics (ACL).
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Association for Computing Machinery (ACM) International Conference Information and Knowledge Management (CIKM),
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2001, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Proceedings of Interspeech,, 2360
- Humphrey, 2012, Proceedings of International Conference on Machine Learning and Application (ICMLA).
- Humphrey, 2012, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Humphrey, 2013, Journal of Intelligent Information Systems,
- Hutchinson, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Hutchinson, 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence,, 1944
- Imseng, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Jaitly, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Jaitly, 2012, Proceedings of Interspeech.
- Jarrett, 2009, Proceedings of International Conference on Computer Vision,, 2146
- Kahou, 2013, Proceedings of International Conference on Multimodal Interaction (ICMI).
- Kang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 8012
- Kashiwagi, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Kavukcuoglu, 2010, Proceedings of Neural Information Processing Systems (NIPS
- Ketabdar, 2010, IEEE Transactions on Audio, Speech, and Language Processing,, 1094
- Kingsbury, 2009, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Kingsbury, 2012, Proceedings of Interspeech.
- Kiros, 2013, Proceedings of Neural Information Processing Systems (NIPS) Deep Learning Workshop.
- Ko, 2013, IEEE Transactions on Audio, Speech, and Language Processing, 1285
- Krizhevsky, 2012, Proceedings of Neural Information Processing Systems (NIPS).
- Kubo, 2012, Proceedings of Interspeech.
- Kurzweil, 2012, How to Create a Mind.
- Lal, 2013, IEEE Transactions on Audio, Speech, and Language Processing,, 2506
- Larochelle, 2008, Proceedings of International Conference on Machine Learning (ICML).
- Le, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Le, 2010, Proceedings of Empirical Methods in Natural Language Processing (EMNLP, 778
- Le, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Le, 2013, IEEE Transactions on Audio, Speech, and Language Processing, 197
- Le, 2011, Proceedings of International Conference on Machine Learning (ICML).
- Le, 2012, Proceedings of International Conference on Machine Learning (ICML).
- LeCun, 2012, Proceedings of European Conference on Computer Vision (ECCV).
- LeCun, 1995, The Handbook of Brain Theory and Neural Networks,, 255
- LeCun, 1998, Proceedings of the IEEE,, 2278
- LeCun, 2007, Proceedings of International Conference on Document Analysis and Recognition (ICDAR).
- Lee, 2004, Proceedings of International Conference on Spoken Language Processing (ICSLP),, 109
- Lee, 2009, Proceedings of International Conference on Machine Learning (ICML).
- Lee, 2011, Communications of the Association for Computing Machinery (ACM),, 95
- Lee, 2010, Proceedings of Neural Information Processing Systems (NIPS
- Lena, 2012, Proceedings of Neural Information Processing Systems (NIPS).
- Li, 2014, IEEE/Association for Computing Machinery (ACM) Transactions on Audio, Speech, and Language Processing, 1
- Li, 2012, Proceedings of IEEE Spoken Language Technology (SLT
- Li, 2013, Proceedings Conference on Affective Computing and Intelligent Interaction (ACII),, 312
- Liao, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Liao, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Lin, 2009, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Lin, 2011, Proceedings of Computer Vision and Pattern Recognition (CVPR
- Ling, 2013, Modeling spectral envelopes using restricted boltzmann machines for statistical parametric speech synthesis, International Conference on Acoustics Speech and Signal Processing (ICASSP),, 7825
- Ling, 2013, Articulatory control of HMM-based parametric speech synthesis using feature-space-switched multiple regression
- Lu, 2013, Joint uncertainty decoding for noise robust subspace gaussian mixture models, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 1791, 10.1109/tasl.2013.2248718 · doi:10.1109/tasl.2013.2248718
- Ma, 2000, Computer, Speech and Language
- Maas, 2013, Rectifier nonlinearities improve neural network acoustic models
- Manning, 2009, Introduction to Information Retrieval.
- J.Markoff, 2012, Scientists see promise in deep-learning programs
- Martens, 2010, Deep learning with hessian-free optimization
- Martens, 2011, Learning recurrent neural networks with hessian-free optimization
- McGraw, 2013, Learning lexicons from speech using a pronunciation mixture model, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 357, 10.1109/tasl.2012.2226158 · DOI
- Mikolov, 2013, Efficient estimation of word representations in vector space
- Mikolov, 2010, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 1045
- Mikolov, 2013, Distributed representations of words and phrases and their compositionality
- Minami, 2002, A recognition method with parametric trajectory synthesized using direct relations between static and dynamic feature vector time series, 957
- Mnih, 2008, A scalable hierarchical distributed language model, 1081
- Mnih, 2013, Learning word embeddings efficiently with noise-contrastive estimation
- Mnih, 2013, laying arari with deep reinforcement learning
- Mohamed, 2009, Deep belief networks for phone recognition
- Morin, 2005, Hierarchical probabilistic neural network language models
- Murphy, 2012, Machine Learning
- Nair, 2009, 3-d object recognition with deep belief nets
- Ngiam, 2011, Learning deep energy models
- Ngiam, 2011, Multimodal deep learning
- Olshausen, 2012, Can ‘deep learning’ offer deep insights about visual representation?
- Ostendorf, 1999, Moving beyond the ‘beads-on-a-string’ model of speech
- Oudre, 2011, Probabilistic template-based chord recognition, IEEE Transactions on Audio, Speech, and Language Processing, 19, 2249, 10.1109/tasl.2010.2098870 · doi:10.1109/tasl.2010.2098870
- Palangi, 2013, Learning input and recurrent weight matrices in echo state networks
- Palangi, 2013, Using deep stacking network to improve structured compressive sensing with multiple measurement vectors
- Pascanu, 2014, How to construct deep recurrent neural networks
200 of 276 shown
Cited by
Items 101–200 of 1,005
TinyML Meets IoT: A Comprehensive Survey
Dutta, D. L., & Bharali, S. (2021) · Internet of Things · doi:10.1016/j.iot.2021.100461 · Cited by 328
3D Human pose estimation: A review of the literature and analysis of covariates
Sarafianos, N., Boteanu, B., Ionescu, B., & Kakadiaris, I. A. (2016) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2016.09.002 · Cited by 323
“Depending on the method used and how the architecture is set-up, it finds applications in both unsupervised and supervised learning as well as hybrid approaches [86].”
MethodDropout Prediction in MOOCs: Using Deep Learning for Personalized Intervention
Xing, W., & Du, D. (2019) · Journal of Educational Computing Research · doi:10.1177/0735633118757015 · Cited by 321
Auto-Encoders in Deep Learning—A Review with New Perspectives
Chen, S., & Guo, W. (2023) · Mathematics · doi:10.3390/math11081777 · Cited by 318
An Introduction to Neural Information Retrieval
Mitra, B., & Craswell, N. (2018) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000061 · Cited by 317
Machine Learning-based traffic prediction models for Intelligent Transportation Systems
Boukerche, A., & Wang, J. (2020) · Computer Networks · doi:10.1016/j.comnet.2020.107530 · Cited by 317
Artificial intelligence in diagnostic pathology
Shafi, S., & Parwani, A. V. (2023) · Diagnostic Pathology · doi:10.1186/s13000-023-01375-z · Cited by 315
“The hidden layers can recreate newer visualizations of the image and with appropriate number of repeats which can identify representations allow for the differentiation between interesting features [24, 25].”
BackgroundMei, S., Ji, J., Geng, Y., Zhang, Z., Li, X., & Du, Q. (2019) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2908756 · Cited by 315
“Autoencoder (AE) is an artificial neural network used for learning a valid encoding of data in an unsupervised manner [26], [43].”
MethodSharma, H., Zerbe, N., Klempert, I., Hellwich, O., & Hufnagl, P. (2017) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2017.06.001 · Cited by 312
Literature review: efficient deep neural networks techniques for medical image analysis
Abdou, M. A. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-06960-9 · Cited by 312
DeepEar: robust smartphone audio sensing in unconstrained acoustic environments using deep learning
Lane, N. D., Georgiev, P., & Qendro, L. (2015) · Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2750858.2804262 · Cited by 310
“In recent years, a new direction in the modeling of data has emerged known as deep learning [25].”
BackgroundInfluentialPrivacy-Preserving Byzantine-Robust Federated Learning via Blockchain Systems
Miao, Y., Liu, Z., Li, H., Choo, K.-K. R., & Deng, R. H. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3196274 · Cited by 303
Diabetic Retinopathy Fundus Image Classification and Lesions Localization System Using Deep Learning
Alyoubi, W. L., Abulkhair, M. F., & Shalash, W. M. (2021) · Sensors · doi:10.3390/s21113704 · Cited by 303
“DL techniques does not need to extract the hand-crafted features while it requires extensive data for training [5].”
BackgroundPerformance Comparison and Current Challenges of Using Machine Learning Techniques in Cybersecurity
Shaukat, K., Luo, S., Varadharajan, V., Hameed, I., Chen, S., Liu, D., & Li, J. (2020) · Energies · doi:10.3390/en13102509 · Cited by 303
“There are two main models for deep learning approaches: generative models and deep discriminative models [70].”
BackgroundA silicon photonic–electronic neural network for fibre nonlinearity compensation
Huang, C., Fujisawa, S., de Lima, T. F., Tait, A. N., Blow, E. C., Tian, Y., Bilodeau, S., Jha, A., Yaman, F., Peng, H.-T., et al. (2021) · Nature Electronics · doi:10.1038/s41928-021-00661-2 · Cited by 303
“Triplet T represents the nonlinearities added on the x-polarization signals, which is caused by the nonlinear interactions among the signals at the same polarization (that is, HnH∗m+nHm) and orthogonal polarizations (VnV∗m+nHm), as shown in equation (2).”
ResultDou, J., Yunus, A. P., Merghadi, A., Shirzadi, A., Nguyen, H., Hussain, Y., Avtar, R., Chen, Y., Pham, B. T., & Yamagishi, H. (2020) · Science of The Total Environment · doi:10.1016/j.scitotenv.2020.137320 · Cited by 300
Review on deep learning applications in frequency analysis and control of modern power system
Zhang, Y., Shi, X., Zhang, H., Cao, Y., & Terzija, V. (2022) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2021.107744 · Cited by 295
A Data-Driven Soft Sensor Modeling Method Based on Deep Learning and its Application
Yan, W., Tang, D., & Lin, Y. (2017) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2016.2622668 · Cited by 294
“Deep learning is considered a remarkable revolution in ANN architecture and training [13].”
BackgroundA Survey of Deep Learning-Based Human Activity Recognition in Radar
Li, X., He, Y., & Jing, X. (2019) · Remote Sensing · doi:10.3390/rs11091068 · Cited by 290
“With its excellent feature learning ability from massive data, DL has not only promoted the development of visual object recognition, speech processing, natural language processing, etc. [33], but also made HAR more intelligent and versatile.”
BackgroundMachine vision intelligence for product defect inspection based on deep learning and Hough transform
Wang, J., Fu, P., & Gao, R. X. (2019) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2019.03.002 · Cited by 288
Haut, J. M., Paoletti, M. E., Plaza, J., Li, J., & Plaza, A. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2838665 · Cited by 288
“In particular, DNNs [34], [35] have recently shown a great potential to yield high performance in image classification tasks [36]–[38].”
BackgroundAutomatic breast ultrasound image segmentation: a survey
Xian, M., Zhang, Y., Cheng, H. D., Xu, F., Zhang, B., & Ding, J. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.02.012 · Cited by 284
“Learning-based approaches thrive in BUS image segmentation in the last decade and we believe new deep learning techniques [162] such as deep convolutional neural networks (CNNs) and recurrent neural network (RNN) will make great progress in segmenting BUS images in the near future.”
BackgroundA comprehensive review of deep learning in colon cancer
Pacal, I., Karaboga, D., Basturk, A., Akay, B., & Nalbantoglu, U. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104003 · Cited by 283
Can Deep Learning Revolutionize Mobile Sensing?
Lane, N. D., & Georgiev, P. (2015) · Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications · doi:10.1145/2699343.2699349 · Cited by 282
“…combination with a series of radical advances (e.g., [16]) in how such networks can be utilized and trained, forms the foundation of deep learning [13]; a new area in machine learning that has recently revolutionized many domains of signal and information processing – not only speech and object…”
BackgroundMulti-bearing remaining useful life collaborative prediction: A deep learning approach
Ren, L., Cui, J., Sun, Y., & Cheng, X. (2017) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2017.02.013 · Cited by 280
Coupled oscillators for computing: A review and perspective
Csaba, G., & Porod, W. (2020) · Applied Physics Reviews · doi:10.1063/1.5120412 · Cited by 279
End-to-End Deep Learning Model for Corn Leaf Disease Classification
Amin, H., Darwish, A., Hassanien, A. E., & Soliman, M. (2022) · IEEE Access · doi:10.1109/access.2022.3159678 · Cited by 273
“Deep learning utilizes deep neural networks to perform feature extraction, pattern analysis, and data classification [7].”
MethodA Survey on Deep Learning for Human Activity Recognition
Gu, F., Chung, M.-H., Chignell, M., Valaee, S., Zhou, B., & Liu, X. (2022) · ACM Computing Surveys · doi:10.1145/3472290 · Cited by 272
“Deep hybrid models combine a generative model and a discriminative model where the outcome of the generative model is often used as the input to the discriminative model for classification or regression [52].”
MethodMining opinions from instructor evaluation reviews: a deep learning approach
Onan, A. (2020) · Computer Applications in Engineering Education · doi:10.1002/cae.22179 · Cited by 270
Guo, L., Lei, Y., Li, N., Yan, T., & Li, N. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.02.083 · Cited by 270
Li, S., Xu, L., Jing, Y., Yin, H., Li, X., & Guan, X. (2021) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2021.102640 · Cited by 267
Fundamentals of speech recognition
Li, J., Deng, L., Haeb-Umbach, R., & Gong, Y. (2016) · Robust Automatic Speech Recognition · doi:10.1016/b978-0-12-802398-3.00002-7 · Cited by 266
Self-citationA deep learning method for classifying mammographic breast density categories
Mohamed, A. A., Berg, W. A., Peng, H., Luo, Y., Jankowitz, R. C., & Wu, S. (2018) · Medical Physics · doi:10.1002/mp.12683 · Cited by 266
“18 Deep learning coupled with big training data has shown promising capability in many artificial intelligence applications 19,20 and, more recently, biomedical imaging analysis.”
BackgroundDigital pathology and computational image analysis in nephropathology
Barisoni, L., Lafata, K. J., Hewitt, S. M., Madabhushi, A., & Balis, U. G. J. (2020) · Nature Reviews Nephrology · doi:10.1038/s41581-020-0321-6 · Cited by 264
IoT-Based Prognostics and Systems Health Management for Industrial Applications
Kwon, D., Hodkiewicz, M. R., Fan, J., Shibutani, T., & Pecht, M. G. (2016) · IEEE Access · doi:10.1109/access.2016.2587754 · Cited by 263
“One of the most promising developments has been in learning sophisticated networks and auto-encoders via deep learning methods [84].”
BackgroundOptimized Structure of the Traffic Flow Forecasting Model With a Deep Learning Approach
Yang, H.-F., Dillon, T. S., & Chen, Y.-P. P. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2574840 · Cited by 263
“2) Design Factor ii: For the activation functions of the autoencoders, f (·) and g(·), the most commonly used transfer functions for deep structures are Sigmoid, Tanh, LogSig, and SoftSign [4], [34].”
MethodA Novel Combined Prediction Scheme Based on CNN and LSTM for Urban PM2.5 Concentration
Qin, D., Yu, J., Zou, G., Yong, R., Zhao, Q., & Zhang, B. (2019) · IEEE Access · doi:10.1109/access.2019.2897028 · Cited by 262
Machine learning in cybersecurity: a comprehensive survey
Dasgupta, D., Akhtar, Z., & Sen, S. (2022) · The Journal of Defense Modeling and Simulation: Applications, Methodology, Technology · doi:10.1177/1548512920951275 · Cited by 259
Wheel Defect Detection With Machine Learning
Krummenacher, G., Ong, C. S., Koller, S., Kobayashi, S., & Buhmann, J. M. (2018) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2017.2720721 · Cited by 258
“These models have gained considerable popularity in recent years, mostly due to their success in image classification and segmentation tasks [19], [20], in speech recognition [21] and quite recently in reinforcement learning for playing Go [22].”
BackgroundSpectral–Spatial Classification of Hyperspectral Image Based on Deep Auto-Encoder
Ma, X., Wang, H., & Geng, J. (2016) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2016.2517204 · Cited by 258
“However, all these features are hand-craft, which take advantage of human ingenuity and prior knowledge [35], [36].”
BackgroundOnan, A. (2019) · IEEE Access · doi:10.1109/access.2019.2945911 · Cited by 257
Edge Intelligence in Intelligent Transportation Systems: A Survey
Gong, T., Zhu, L., Yu, F. R., & Tang, T. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3275741 · Cited by 256
Lygouras, E., Santavas, N., Taitzoglou, A., Tarchanidis, K., Mitropoulos, A., & Gasteratos, A. (2019) · Sensors · doi:10.3390/s19163542 · Cited by 253
“The superior performance of deep learning techniques in detecting and classifying objects in images has led to their widespread adoption in a wide variety of applications [15].”
BackgroundBehl, A., Jayawardena, N., Pereira, V., Islam, N., Giudice, M. D., & Choudrie, J. (2022) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2021.121445 · Cited by 253
Zhang, S., Yang, Y., Chen, C., Zhang, X., Leng, Q., & Zhao, X. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121692 · Cited by 251
A Transfer Learning approach for AI-based classification of brain tumors
Mehrotra, R., Ansari, M. A., Agrawal, R., & Anand, R. S. (2020) · Machine Learning with Applications · doi:10.1016/j.mlwa.2020.100003 · Cited by 251
Gong, W., Chen, H., Zhang, Z., Zhang, M., Wang, R., Guan, C., & Wang, Q. (2019) · Sensors · doi:10.3390/s19071693 · Cited by 251
“Due to its good adaptability to the scaling, tilting, and translation of images, it is great widely applied in image recognition and other similar problems [24,26,32,33,36].”
BackgroundMethodAgbehadji, I. E., Awuzie, B. O., Ngowi, A. B., & Millham, R. C. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17155330 · Cited by 248
“Alternatively, DL is a class of machine learning algorithms that exploits several layers of representation to find a complex and inherent relationship in data [38].”
BackgroundPławiak, P., & Acharya, U. R. (2020) · Neural Computing and Applications · doi:10.1007/s00521-018-03980-2 · Cited by 248
“Stage III —the focus was on further developing ML methods by designing, optimizing and testing a more complex deep genetic (three layers, 53 classifiers) ensemble of classifiers combining the advantages of EL [21, 37, 38, 47, 62, 72], EC [14, 28] and DL [11, 16, 17, 27, 32, 39, 63].”
MethodRetractedA Comprehensive Survey for Intelligent Spam Email Detection
Karim, A., Azam, S., Shanmugam, B., Kannoorpatti, K., & Alazab, M. (2019) · IEEE Access · doi:10.1109/access.2019.2954791 · Cited by 246
“The output of each of these layers is fed into the next consecutive layer as input and these layers (often processing different levels of abstraction) construct a hierarchy of concepts [28], [120].”
BackgroundDeepSigns: An End-to-End Watermarking Framework for Ownership Protection of Deep Neural Networks
Darvish Rouhani, B., Chen, H., & Koushanfar, F. (2019) · Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3297858.3304051 · Cited by 244
“It is well-known that there is no unique solution to DL problems [2, 3, 37].”
BackgroundSamala, R. K., Chan, H.-P., Hadjiiski, L. M., Helvie, M. A., Cha, K. H., & Richter, C. D. (2017) · Physics in Medicine & Biology · doi:10.1088/1361-6560/aa93d4 · Cited by 232
A novel passenger flow prediction model using deep learning methods
Liu, L., & Chen, R.-C. (2017) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2017.08.001 · Cited by 230
Temporal Convolutional Networks for Anomaly Detection in Time Series
He, Y., & Zhao, J. (2019) · Journal of Physics: Conference Series · doi:10.1088/1742-6596/1213/4/042050 · Cited by 229
“One main reason for the success of deep learning is its ability to extract high-level feature automatically from structural data [1].”
BackgroundAlzheimer’s Diseases Detection by Using Deep Learning Algorithms: A Mini-Review
Al-Shoukry, S., Rassem, T. H., & Makbol, N. M. (2020) · IEEE Access · doi:10.1109/access.2020.2989396 · Cited by 227
Sensors, Features, and Machine Learning for Oil Spill Detection and Monitoring: A Review
Al-Ruzouq, R., Gibril, M. B. A., Shanableh, A., Kais, A., Hamed, O., Al-Mansoori, S., & Khalil, M. A. (2020) · Remote Sensing · doi:10.3390/rs12203338 · Cited by 226
Li, B., Lowell, V. L., Wang, C., & Li, X. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100266 · Cited by 120
Air Pollution Prediction Using Long Short-Term Memory (LSTM) and Deep Autoencoder (DAE) Models
Xayasouk, T., Lee, H., & Lee, G. (2020) · Sustainability · doi:10.3390/su12062570 · Cited by 223
“…applications such as translation, Deep learning has been widely adopted in academic and practical applications such as translation, speech recognition, language processing, and image classification [5,6] (Figure 2). speech recognition, language processing, and image classification [5,6] (Figure 2).”
BackgroundHartling, S., Sagan, V., Sidike, P., Maimaitijiang, M., & Carron, J. (2019) · Sensors · doi:10.3390/s19061284 · Cited by 223
“Similar to the function of the deep architecture of the human brain, deep learning algorithms formulate learning models that construct natural relationships between input and output data through deep architecture comprised of multiple layers of nonlinear transformation operations [20].”
BackgroundDeep Learning Based Methods for Breast Cancer Diagnosis: A Systematic Review and Future Direction
Nasser, M., & Yusof, U. K. (2023) · Diagnostics · doi:10.3390/diagnostics13010161 · Cited by 222
“These models have been applied and proved to be successful in several areas, including natural language processing [27], recommender systems [28], computer vision [29], medical imaging [30], etc.”
BackgroundBishara, D., Xie, Y., Liu, W. K., & Li, S. (2023) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-022-09795-8 · Cited by 222
“In particular, shallow learning algorithms need manual feature engineering, which requires extensive knowledge, and it may lead to inaccuracies [40, 41].”
BackgroundHandling data irregularities in classification: Foundations, trends, and future challenges
Das, S., Datta, S., & Chaudhuri, B. B. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.03.008 · Cited by 216
Phan, N., Wang, Y., Wu, X., & Dou, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10165 · Cited by 215
“In general, deep learning is about learning multiple levels of representation and abstraction that help to make sense of data such as images, sound, and text (Deng and Yu 2014).”
BackgroundTransfer learning for speech and language processing
Wang, D., & Zheng, T. F. (2015) · 2015 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA) · doi:10.1109/apsipa.2015.7415532 · Cited by 213
“aining/inference algorithms. Typical deep models include deep belief networks (DBNs) [44], deep Boltzmann machines (DBMs) [45], deep auto encoders (DAEs) [46], [47], deep neural networks (DNNs) [48], [41] and deep recurrent neural networks (RNNs) [49]. The success of deep models is largely attributed to their capabili…”
BackgroundAccelerated deep neural networks for enhanced Intrusion Detection System
Potluri, S., & Diedrich, C. (2016) · 2016 IEEE 21st International Conference on Emerging Technologies and Factory Automation (ETFA) · doi:10.1109/etfa.2016.7733515 · Cited by 212
“Recently, these deep learning architectures have demonstrated impressive and sometimes human competitive results in many applications [42].”
BackgroundMachine learning for synergistic network pharmacology: a comprehensive overview
Noor, F., Asif, M., Ashfaq, U. A., Qasim, M., & Tahir ul Qamar, M. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbad120 · Cited by 211
A Survey of CNN-Based Network Intrusion Detection
Mohammadpour, L., Ling, T. C., Liew, C. S., & Aryanfar, A. (2022) · Applied Sciences · doi:10.3390/app12168162 · Cited by 210
Deep Learning dan Penerapannya dalam Pembelajaran
Raup, A., Ridwan, W., Khoeriyah, Y., Supiana, S., & Zaqiah, Q. Y. (2022) · JIIP - Jurnal Ilmiah Ilmu Pendidikan · doi:10.54371/jiip.v5i9.805 · Cited by 210
Review of Vibration-Based Structural Health Monitoring Using Deep Learning
Toh, G., & Park, J. (2020) · Applied Sciences · doi:10.3390/app10051680 · Cited by 207
Zhong, G., Wang, L.-N., Ling, X., & Dong, J. (2016) · The Journal of Finance and Data Science · doi:10.1016/j.jfds.2017.05.001 · Cited by 207
Advances in Facial Expression Recognition: A Survey of Methods, Benchmarks, Models, and Datasets
Kopalidis, T., Solachidis, V., Vretos, N., & Daras, P. (2024) · Information · doi:10.3390/info15030135 · Cited by 247
Patch-based system for Classification of Breast Histology images using deep learning
Roy, K., Banik, D., Bhattacharjee, D., & Nasipuri, M. (2019) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2018.11.003 · Cited by 205
Deep Learning for Hand Gesture Recognition on Skeletal Data
Devineau, G., Moutarde, F., Xi, W., & Yang, J. (2018) · 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) · doi:10.1109/fg.2018.00025 · Cited by 203
“Deep Learning, also known as Hierarchical Learning, is a subclass of Machine Learning where algorithms f use a cascade of non-linear computational units f i (layers) for feature extraction and transformation: [10].”
MethodLi, X., Jiang, H., Niu, M., & Wang, R. (2020) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2020.106752 · Cited by 203
Sparse Deep Stacking Network for Fault Diagnosis of Motor
Sun, C., Ma, M., Zhao, Z., & Chen, X. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2819674 · Cited by 202
“DSN are convex [24], which will leads to an optimal closedform solution.”
BackgroundOn Definition of Deep Learning
Zhang, W., Yang, G., Lin, Y., Ji, C., & Gupta, M. M. (2018) · World Automation Congress (WAC) · doi:10.23919/wac.2018.8430387 · Cited by 246
“Definition 4: According to [3], [20], “deep learning is a class of machine learning algorithms that: (1) use a cascade of multiple layers of nonlinear processing units for feature extraction and transformation.”
BackgroundArtificial intelligence as an emerging technology in the current care of neurological disorders
Patel, U. K., Anwar, A., Saleem, S., Malik, P., Rasul, B., Patel, K., Yao, R., Seshadri, A., Yousufuddin, M., & Arumaithurai, K. (2021) · Journal of Neurology · doi:10.1007/s00415-019-09518-3 · Cited by 197
“Similarly, ‘deep learning’ is described as a class of artificial neural networks that learn in a supervised and unsupervised manner [5] (Fig.”
BackgroundApplications of deep learning for phishing detection: a systematic literature review
Catal, C., Giray, G., Tekinerdoğan, B., Kumar, S., & Shukla, S. (2022) · Knowledge and Information Systems · doi:10.1007/s10115-022-01672-x · Cited by 223
“RNN belongs to the Neural Network (NN) category, in which the previous stage’s output is used as input in the current stage [19].”
MethodExplainable artificial intelligence in Alzheimer’s disease classification: a systematic review
Viswan, V., Shaffi, N., Mahmud, M., Subramanian, K., & Hajamohideen, F. (2024) · Cognitive Computation · doi:10.1007/s12559-023-10192-x · Cited by 195
“Furthermore, applications of DL are found in biomedicine [96], biology [96], and speech recognition, synthesising and audio processing in [97].”
Deep learning analysis on microscopic imaging in materials science
Ge, M., Su, F., Zhao, Z., & Su, D. (2020) · Materials Today Nano · doi:10.1016/j.mtnano.2020.100087 · Cited by 195
Skin lesion segmentation in clinical images using deep learning
Jafari, M. H., Karimi, N., Nasr-Esfahani, E., Samavi, S., Soroushmehr, S. M. R., Ward, K., & Najarian, K. (2016) · 2016 23rd International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr.2016.7899656 · Cited by 195
Wu, Y.-T., Zhang, C.-J., Mol, B. W., Kawai, A., Li, C., Chen, L., Wang, Y., Sheng, J.-Z., Fan, J.-X., Shi, Y., et al. (2021) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/clinem/dgaa899 · Cited by 194
“For the DNN classifier, a sequential model with 2 densely connected hidden layers and a single continuous output layer was devised (more details are shown in the Supplementary text [18]).”
MethodInfluentialFeature Extraction By Using Deep Learning: A Survey
Dara, S., & Tumma, P. (2018) · 2018 Second International Conference on Electronics, Communication and Aerospace Technology (ICECA) · doi:10.1109/iceca.2018.8474912 · Cited by 193
“It is mainly associated with Dimensionality Reduction [1].”
BackgroundMachine translation using deep learning: An overview
Singh, S. P., Kumar, A., Darbari, H., Singh, L., Rastogi, A., & Jain, S. (2017) · 2017 International Conference on Computer, Communications and Electronics (Comptelix) · doi:10.1109/comptelix.2017.8003957 · Cited by 192
Semantic text classification: A survey of past and recent advances
Altınel, B., & Ganiz, M. C. (2018) · Information Processing & Management · doi:10.1016/j.ipm.2018.08.001 · Cited by 192
Why Deep Learning Works: A Manifold Disentanglement Perspective
Brahma, P. P., Wu, D., & She, Y. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2496947 · Cited by 190
Shen, H., Jiang, Y., Li, T., Cheng, Q., Zeng, C., & Zhang, L. (2020) · Remote Sensing of Environment · doi:10.1016/j.rse.2020.111692 · Cited by 190
Object detection in real time based on improved single shot multi-box detector algorithm
Kumar, A., Zhang, Z. J., & Lyu, H. (2020) · EURASIP Journal on Wireless Communications and Networking · doi:10.1186/s13638-020-01826-x · Cited by 188
“Due to the recent advance of deep learning technology [4], especially after the appearance of the deep convolution neural network (CNN) technology, object detection algorithms have made a breakthrough development.”
BackgroundA comprehensive review of AI based intrusion detection system
Sowmya, T., & Mary Anita, E. A. (2023) · Measurement: Sensors · doi:10.1016/j.measen.2023.100827 · Cited by 187
Sentiment analysis using deep learning approaches: an overview
Habimana, O., Li, Y., Li, R., Gu, X., & Yu, G. (2020) · Science China Information Sciences · doi:10.1007/s11432-018-9941-6 · Cited by 186
FloatPIM: in-memory acceleration of deep neural network training with high precision
Imani, M., Gupta, S., Kim, Y., & Rosing, T. (2019) · Proceedings of the 46th International Symposium on Computer Architecture · doi:10.1145/3307650.3322237 · Cited by 186
“Artificial neural networks, in particular deep learning [3, 4], have wide range of applications in diverse areas including: object detection [5], self driving car, and translation [6].”
Machine Learning: A Review of the Algorithms and Its Applications
Dhall, D., Kaur, R., & Juneja, M. (2020) · Lecture Notes in Electrical Engineering · doi:10.1007/978-3-030-29407-6_5 · Cited by 185
Applying machine learning and natural language processing to detect phishing email
Alhogail, A., & Alsabih, A. (2021) · Computers & Security · doi:10.1016/j.cose.2021.102414 · Cited by 182
Saha, S., Gan, Z., Cheng, L., Gao, J., Kafka, O. L., Xie, X., Li, H., Tajdari, M., Kim, H. A., & Liu, W. K. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113452 · Cited by 182
Dimuro, G. P., Fernández, J., Bedregal, B., Mesiar, R., Sanz, J. A., Lucca, G., & Bustince, H. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.10.005 · Cited by 181
Multi-environment Genomic Prediction of Plant Traits Using Deep Learners With Dense Architecture
Montesinos-López, A., Montesinos-López, O. A., Gianola, D., Crossa, J., & Hernández-Suárez, C. M. (2018) · G3 Genes|Genomes|Genetics · doi:10.1534/g3.118.200740 · Cited by 180
“The prediction performance of DL methods has proved to be similar or better than that of traditional methods in many areas like health care, image processing, natural language processing, speech recognition, military target recognition, marketing, investment portfolio management, financial fraud detection, stock marke…”
MethodDeep Convolutional Neural Networks for Predominant Instrument Recognition in Polyphonic Music
Han, Y., Kim, J., & Lee, K. (2017) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2016.2632307 · Cited by 179
“Finally, we conclude the paper in section VI.”
BackgroundYaghoubi, E., Yaghoubi, E., Khamees, A., Razmi, D., & Lu, T. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.108789 · Cited by 179
Target-Sensitive Memory Networks for Aspect Sentiment Classification
Wang, S., Mazumder, S., Liu, B., Zhou, M., & Chang, Y. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1088 · Cited by 179
“Due to their impressive results in many NLP tasks (Deng et al., 2014), neural networks have been applied to ASC (see the survey (Zhang et al., 2018)).”
BackgroundAn Attention Pooling Based Representation Learning Method for Speech Emotion Recognition
Li, P., Song, Y., McLoughlin, I., Guo, W., & Dai, L. (2018) · Interspeech 2018 · doi:10.21437/interspeech.2018-1242 · Cited by 179
“Motivated by the success of deep learning techniques in various application domains, such as large scale image and speech recognition [4, 5], several Deep Neural Network (DNN) or Convolutional Neural Network (CNN) based SER methods have recently been proposed [6, 7, 8, 9, 10, 11, 12].”
Metadata
- Authors
- Deng, L., & Yu, D.
- Affiliations
- Microsoft (United States) (US)
- Venue
- Foundations and Trends® in Signal Processing
- Publisher
- Emerald
- Published
- 2014-06-30
- Volume
- 7
- Issue
- 3-4
- Pages
- 197-387
- ISSN
- 1932-8346 (ISSN-L)
- 1932-8354
- OpenAlex
- W4205947740
- Cited by
- 3,480
- References
- 21
- Citations by year
- 2026: 113 · 2025: 206 · 2024: 298 · 2023: 410 · 2022: 469 · 2021: 453 · 2020: 404 · 2019: 426 · 2018: 304 · 2017: 188 · 2016: 146 · 2015: 57 · 2014: 3
- FWCI
- 117.48
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Foundations and Trends® in Signal Processing (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- deep learning, signal processing, information processing, speech recognition, computer vision, natural language processing, text processing, information retrieval, multimodal information processing, multi-task learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.