Deep Learning: Methods and Applications
Open accessThe DOI matches its Crossref record; 28 of the 168 references it cites were found in a registry or an index, and 140 are not checked yet.
Abstract
This monograph provides an overview of general deep learning methodology and its applications to a variety of signal and information processing tasks. The application areas are chosen with the following three criteria in mind: (1) expertise or knowledge of the authors; (2) the application areas that have already been transformed by the successful use of deep learning technology, such as speech recognition and computer vision; and (3) the application areas that have the potential to be impacted significantly by deep learning and that have been experiencing research growth, including natural language and text processing, information retrieval, and multimodal information processing empowered by multi-task deep learning.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Deep learning is successfully used as a tool for machine learning, where a neural network is capable of automatically learning features.”
From Medical image analysis using convolutional neural networks: a review (2018) · cites this paper as [47]
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Self-citationLearning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239 · cited 6×
“Since 2006, deep structured learning, or more commonly called deep learning or hierarchical learning, has emerged as a new area of machine learning research [20, 163].”
BackgroundMethodInfluentialLearning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542 · cited 1×
“, speech or text), but until recently they had not been widely used partly because they are difficult to train to capture long-term dependencies, giving rise to gradient vanishing or gradient explosion problems which were known in early 1990s [29, 167].”
BackgroundWolpert, D. H. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80023-1 · Cited by 7,951
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878 · cited 1×
“[347] developed the recursive neural tensor network, where each layer is constructed similarly to that of the neural tensor network described in [340] with an illustration shown in Figure 8.”
MethodCaruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636 · cited 1×
“The several architectures discussed so far in this chapter for multimodal processing and learning can be regarded as special cases of more general multi-task learning and transfer learning [22, 47].”
Background
Research works printed but not linked: 276
- Abdel-Hamid, 2013, Proceedings of Interspeech,
- Abdel-Hamid, 2013, Proceedings of Interspeech.
- Abdel-Hamid, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Acero, 2000, Proceedings of Interspeech
- Alain, 2013, Proceedings of International Conference on Learning Representations (ICLR).
- Arisoy, 2012, Proceedings of the Joint Human Language Technology Conference and the North American Chapter of the Association of Computational Linguistics (HLT-NAACL) Workshop.
- Aslan, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Ba, 2013, Proceedings of Neural Information Processing Systems (NIPS
- Baldi, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- E. Battenberg , E.Schmidt, and J.Bello. Deep learning for music, special session at International Conference on Acoustics Speech and Signal Processing (ICASSP) (http://www.icassp2014.org/ special_sections.html#ss8), 2014.
- Batternberg, 2012, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Bell, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Bengio, 2008, Scholarpedia,
- Bengio, 2012, Deep learning of representations for unsupervised and transfer learning, Journal of Machine Learning Research Workshop and Conference Proceedings, 27, 17
- Bengio, 2013, Statistical Language and Speech Processing,, 1
- Bengio, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Bengio, 2000, Proceedings of Neural Information Processing Systems (NIPS
- Bengio, 2003, A neural probabilistic language model, Journal of Machine Learning Research,, 3, 1137
- Bengio, 2006, Proceedings of Neural Information Processing Systems (NIPS
- Bengio, 2013, Proceedings of International Conference on Machine Learning (ICML), 2014.
- Bengio, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Bergstra, 2012, Random search for hyper-parameter optimization, Journal on Machine Learning Research,, 3, 281
- Bilmes, 2010, Dynamic graphical models, IEEE Signal Processing Magazine,, 33, 29
- Bordes, 2013, Machine Learning,
- Bordes, 2011, Proceedings of Association for the Advancement of Artificial Intelligence (AAAI).
- Bottou, 2013, From machine learning to machine reasoning: An essay, Journal of Machine Learning Research,, 14, 3207
- Bottou, 2004, Proceedings of Neural Information Processing Systems (NIPS
- Boulanger-Lewandowski, 2012, Proceedings of International Conference on Machine Learning (ICML).
- Boulanger-Lewandowski, 2013, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Bourlard, 1993, Connectionist Speech Recognition: A Hybrid Approach.
- Breiman, 1996, Stacked regression, Machine Learning,, 24, 49, 10.1023/a:1018046112532 · doi:10.1023/a:1018046112532 · Paper page
- Cardinal, 2013, Large vocabulary speech recognition on parallel architectures, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 2290, 10.1109/tasl.2013.2271591 · doi:10.1109/tasl.2013.2271591
- Chen, 2014, Proceedings of International Conference on Learning Representations.
- Chen, 2012, Proceedings of Interspeech.
- Chengalvarayan, 1997, IEEE Transactions on Speech and Audio Processing, 243
- Chengalvarayan, 1997, IEEE Transactions on Speech and Audio Processing,, 232
- Chengalvarayan, 1998, Speech trajectory discrimination using the minimum classification error learning, IEEE Transactions on Speech and Audio Processing,, 6, 505, 10.1109/89.725317 · doi:10.1109/89.725317
- Cho, 2009, Proceedings of Neural Information Processing Systems (NIPS, 342
- Ciresan, 2012, Proceedings of Neural Information Processing Systems (NIPS
- Ciresan, 2010, Neural Computation
- Ciresan, 2011, Proceedings of International Joint Conference on Neural Networks (IJCNN).
- Ciresan, 2012, Proceedings of Computer Vision and Pattern Recognition (CVPR).
- Ciresan, 2012, Proceedings of International Joint Conference on Neural Networks (IJCNN).
- Coates, 2013, Proceedings of International Conference on Machine Learning (ICML).
- Cohen, 2005, Proceedings of International Joint Conference on Artificial Intelligence (IJCAI),, 671
- Collobert, 2011, Proceedings of Artificial Intelligence and Statistics (AISTATS
- Collobert, 2008, Proceedings of International Conference on Machine Learning (ICML).
- Collobert, 2011, Natural language processing (almost) from scratch, Journal on Machine Learning Research,, 12, 2493
- Dahl, 2010, Phone recognition with the mean-covariance restricted boltzmann machine, Proceedings of Neural Information Processing Systems (NIPS, 23, 469
- Dahl, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dahl, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dahl, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dean, 2012, Proceedings of Neural Information Processing Systems (NIPS
- Demuynck, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Deng, 1993, IEEE Transactions on Speech and Audio Processing, 471
- Deng, 2003, Mathematical Foundations of Speech and Language Processing,, 115
- Deng, 2011, Proceedings of Asian-Pacific Signal & Information Processing Annual Summit and Conference (APSIPA-ASC).
- Deng, 2012, The MNIST database of handwritten digit images for machine learning research, IEEE Signal Processing Magazine,, 29
- Deng, 2013, Neural Information Processing Systems (NIPS) Workshop on Learning Output Representations.
- Deng, 2013, Asian-Pacific Signal & Information Processing Association Transactions on Signal and Information Processing.
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2001, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2014, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 1992, Structural design of a hidden Markov model based speech recognizer using multi-valued phonetic features: Comparison with segmental speech units, Journal of the Acoustical Society of America,, 92, 3058, 10.1121/1.404202 · doi:10.1121/1.404202
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2004, Challenges in adopting speech recognition, Communications of the Association for Computing Machinery (ACM),, 47, 11
- Deng, 2012, Proceedings of Interspeech.
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2003, Speech Processing — A Dynamic and Optimization-Oriented Approach
- Deng, 1996, Transitional speech units and their representation by regressive Markov states: Applications to speech recognition, IEEE Transactions on speech and audio processing,, 4, 301, 10.1109/89.506934 · doi:10.1109/89.506934
- Deng, 2010, Proceedings of Interspeech.
- Deng, 2012, Proceedings of IEEE Workshop on Spoken Language Technologies
- Deng, 2002, Distributed speech processing in mipad’s multimodal user interface, IEEE Transactions on Speech and Audio Processing,, 10, 605, 10.1109/tsa.2002.804538 · doi:10.1109/tsa.2002.804538
- Deng, 2005, Dynamic compensation of HMM variances using the feature enhancement uncertainty computed from a parametric model of speech distortion, IEEE Transactions on Speech and Audio Processing,, 13, 412, 10.1109/tsa.2005.845814 · doi:10.1109/tsa.2005.845814
- Deng, 2007, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2011, Proceedings of Interspeech.
- Deng, 2009, Neural Information Processing Systems (NIPS) Workshop
- Deng, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deselaers, 2009, Proceedings of 4th Workshop on Statistical Machine Translation,, 233
- Dognin, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Erhan, Journal on Machine Learning Research,, 201
- Fernandez, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 6885
- Fine, 1998, Machine Learning, 41
- Frome, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Fu, 2007, Proceedings of Interspeech
- Gales, 2011, Robust Speech Recognition of Uncertain or Missing Data: Theory and Application, 101, 10.1007/978-3-642-21317-5_5 · doi:10.1007/978-3-642-21317-5_5
- Gao, 2010, Proceedings of Conference on Information and Knowledge Management (CIKM).
- Gao, 2013, Proceedings of Neural Information Processing Systems (NIPS) Workshop on Deep Learning
- Gao, 2014, Proceedings of Association for Computational Linguistics (ACL).
- Gao, 2011, Proceedings of Special Interest Group on Information Retrieval (SIGIR).
- Gens, 2012, Neural Information Processing Systems (NIPS),
- Gibson, 2010, Error approximation and minimum phone error acoustic model estimation, IEEE Transactions on Audio, Speech, and Language Processing,, 18, 1269, 10.1109/tasl.2009.2032607 · DOI
- Glorot, 2010, Proceedings of Artificial Intelligence and Statistics (AISTATS).
- Glorot, 2011, Proceedings of Artificial Intelligence and Statistics (AIS-TATS
- Goodfellow, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Graves, 2012, Representation Learning Workshop, International Conference on Machine Learning (ICML),
- Graves, 2006, Proceedings of International Conference on Machine Learning (ICML).
- Graves, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Graves, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Grezl, 2008, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Gutmann, 2012, Noise-contrastive estimation of unnormalized statistical models, with applications to natural image statistics, Journal of Machine Learning Research,, 13, 307
- Hain, 2012, IEEE Transactions on Audio, Speech, and Language Processing,, 486
- Hamel, 2010, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Hawkins, 2004, On Intelligence: How a New Understanding of the Brain will lead to the Creation of Truly Intelligent Machines
- He, 2011, IEEE Signal Processing Magazine,
- He, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- He, 2013, Proceedings of the IEEE.
- Heigold, 2013, Investigations on an EM-style optimization algorithm for discriminative training of HMMs, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 2616, 10.1109/tasl.2013.2280234 · doi:10.1109/tasl.2013.2280234
- Heigold, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Heintz, 2009, Discriminative input stream combination for conditional random field phone recognition, IEEE Transactions on Audio, Speech, and Language Processing,, 17, 1533, 10.1109/tasl.2009.2022204 · doi:10.1109/tasl.2009.2022204
- Henderson, 2013, Proceedings of Special Interest Group on Disclosure and Dialogue (SIGDIAL).
- Hermans, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Hermansky, 2000, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Hinton, 1990, Artificial Intelligence,, 1
- Hinton, 2003, Canadian Psychology,, 10
- Hinton, 2011, A better way to learn features, Communications of the Association for Computing Machinery (ACM),, 54
- Hinton, 2006, Neural Computation,, 1527
- Hinton, 2010, Topics in Cognitive Science,, 1
- Huang, 2012, Proceedings of Association for Computational Linguistics (ACL).
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Association for Computing Machinery (ACM) International Conference Information and Knowledge Management (CIKM),
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2001, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Proceedings of Interspeech,, 2360
- Humphrey, 2012, Proceedings of International Conference on Machine Learning and Application (ICMLA).
- Humphrey, 2012, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Humphrey, 2013, Journal of Intelligent Information Systems,
- Hutchinson, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Hutchinson, 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence,, 1944
- Imseng, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Jaitly, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Jaitly, 2012, Proceedings of Interspeech.
- Jarrett, 2009, Proceedings of International Conference on Computer Vision,, 2146
- Kahou, 2013, Proceedings of International Conference on Multimodal Interaction (ICMI).
- Kang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 8012
- Kashiwagi, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Kavukcuoglu, 2010, Proceedings of Neural Information Processing Systems (NIPS
- Ketabdar, 2010, IEEE Transactions on Audio, Speech, and Language Processing,, 1094
- Kingsbury, 2009, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Kingsbury, 2012, Proceedings of Interspeech.
- Kiros, 2013, Proceedings of Neural Information Processing Systems (NIPS) Deep Learning Workshop.
- Ko, 2013, IEEE Transactions on Audio, Speech, and Language Processing, 1285
- Krizhevsky, 2012, Proceedings of Neural Information Processing Systems (NIPS).
- Kubo, 2012, Proceedings of Interspeech.
- Kurzweil, 2012, How to Create a Mind.
- Lal, 2013, IEEE Transactions on Audio, Speech, and Language Processing,, 2506
- Larochelle, 2008, Proceedings of International Conference on Machine Learning (ICML).
- Le, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Le, 2010, Proceedings of Empirical Methods in Natural Language Processing (EMNLP, 778
- Le, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Le, 2013, IEEE Transactions on Audio, Speech, and Language Processing, 197
- Le, 2011, Proceedings of International Conference on Machine Learning (ICML).
- Le, 2012, Proceedings of International Conference on Machine Learning (ICML).
- LeCun, 2012, Proceedings of European Conference on Computer Vision (ECCV).
- LeCun, 1995, The Handbook of Brain Theory and Neural Networks,, 255
- LeCun, 1998, Proceedings of the IEEE,, 2278
- LeCun, 2007, Proceedings of International Conference on Document Analysis and Recognition (ICDAR).
- Lee, 2004, Proceedings of International Conference on Spoken Language Processing (ICSLP),, 109
- Lee, 2009, Proceedings of International Conference on Machine Learning (ICML).
- Lee, 2011, Communications of the Association for Computing Machinery (ACM),, 95
- Lee, 2010, Proceedings of Neural Information Processing Systems (NIPS
- Lena, 2012, Proceedings of Neural Information Processing Systems (NIPS).
- Li, 2014, IEEE/Association for Computing Machinery (ACM) Transactions on Audio, Speech, and Language Processing, 1
- Li, 2012, Proceedings of IEEE Spoken Language Technology (SLT
- Li, 2013, Proceedings Conference on Affective Computing and Intelligent Interaction (ACII),, 312
- Liao, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Liao, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Lin, 2009, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Lin, 2011, Proceedings of Computer Vision and Pattern Recognition (CVPR
- Ling, 2013, Modeling spectral envelopes using restricted boltzmann machines for statistical parametric speech synthesis, International Conference on Acoustics Speech and Signal Processing (ICASSP),, 7825
- Ling, 2013, Articulatory control of HMM-based parametric speech synthesis using feature-space-switched multiple regression
- Lu, 2013, Joint uncertainty decoding for noise robust subspace gaussian mixture models, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 1791, 10.1109/tasl.2013.2248718 · doi:10.1109/tasl.2013.2248718
- Ma, 2000, Computer, Speech and Language
- Maas, 2013, Rectifier nonlinearities improve neural network acoustic models
- Manning, 2009, Introduction to Information Retrieval.
- J.Markoff, 2012, Scientists see promise in deep-learning programs
- Martens, 2010, Deep learning with hessian-free optimization
- Martens, 2011, Learning recurrent neural networks with hessian-free optimization
- McGraw, 2013, Learning lexicons from speech using a pronunciation mixture model, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 357, 10.1109/tasl.2012.2226158 · DOI
- Mikolov, 2013, Efficient estimation of word representations in vector space
- Mikolov, 2010, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 1045
- Mikolov, 2013, Distributed representations of words and phrases and their compositionality
- Minami, 2002, A recognition method with parametric trajectory synthesized using direct relations between static and dynamic feature vector time series, 957
- Mnih, 2008, A scalable hierarchical distributed language model, 1081
- Mnih, 2013, Learning word embeddings efficiently with noise-contrastive estimation
- Mnih, 2013, laying arari with deep reinforcement learning
- Mohamed, 2009, Deep belief networks for phone recognition
- Morin, 2005, Hierarchical probabilistic neural network language models
- Murphy, 2012, Machine Learning
- Nair, 2009, 3-d object recognition with deep belief nets
- Ngiam, 2011, Learning deep energy models
- Ngiam, 2011, Multimodal deep learning
- Olshausen, 2012, Can ‘deep learning’ offer deep insights about visual representation?
- Ostendorf, 1999, Moving beyond the ‘beads-on-a-string’ model of speech
- Oudre, 2011, Probabilistic template-based chord recognition, IEEE Transactions on Audio, Speech, and Language Processing, 19, 2249, 10.1109/tasl.2010.2098870 · doi:10.1109/tasl.2010.2098870
- Palangi, 2013, Learning input and recurrent weight matrices in echo state networks
- Palangi, 2013, Using deep stacking network to improve structured compressive sensing with multiple measurement vectors
- Pascanu, 2014, How to construct deep recurrent neural networks
200 of 276 shown
Cited by
Items 601–700 of 1,005
Music Artist Classification with Convolutional Recurrent Neural Networks
Nasrullah, Z., & Zhao, Y. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8851988 · Cited by 62
“Current research with auditory data focuses on areas such as sound event detection, speech transcription or speech generation [9], [16], [17] and, leveraging deep learning, massive performance gains have been achieved in these areas.”
BackgroundFrequency of Giardia lamblia infection in children with recurrent abdominal pain.
Younas, M., Shah, S., & Talaat, A. (2008) · PubMed · Cited by 62
CNN Transfer Learning for Automatic Image-Based Classification of Crop Disease
Wang, J., Chen, L., Zhang, J., Yuan, Y., Li, M., & Zeng, W. (2018) · Communications in computer and information science · doi:10.1007/978-981-13-1702-6_32 · Cited by 61
Deep Signal Recovery with One-bit Quantization
Khobahi, S., Naimipour, N., Soltanalian, M., & Eldar, Y. C. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683876 · Cited by 67
“…generated by the human population and machines, in conjunction with the new optimization and learning methods, have paved the way for deep neural networks (DNNs) and machine learning-based models to prove their effectiveness in many engineering areas (see, e.g., [9–11] and the references therein).”
Attenuation of marine seismic interference noise employing a customized U‐Net
Sun, J., Slang, S., Elboth, T., Greiner, T. L., McDonald, S., & Gelius, L. (2019) · Geophysical Prospecting · doi:10.1111/1365-2478.12893 · Cited by 61
“Deep learning is a class of ML algorithms that use multiple layers to progressively extract higher-level features from raw input (Deng and Yu 2014).”
BackgroundDeep spectral CNN for laser induced breakdown spectroscopy
Castorena, J., Oyen, D., Ollila, A., Legett, C., & Lanza, N. (2021) · Spectrochimica Acta Part B Atomic Spectroscopy · doi:10.1016/j.sab.2021.106125 · Cited by 68
“Such findings have paved the way towards state of the art methods for many signal processing applications including but not limited to speech, audio, vision and graphs [10], and we aim here towards bringing such benefits to LIBS.”
Fan, P., Ruddlesden, M., Wang, Y., Zhao, L., Lü, C., & Su, L. (2021) · Laser & Photonics Review · doi:10.1002/lpor.202000348 · Cited by 67
Evaluation of VGG-16 and VGG-19 Deep Learning Architecture for Classifying Dementia People
Bagaskara, A., & Suryanegara, M. (2021) · International Conference of Computer and Informatics Engineering (IC2IE) · doi:10.1109/ic2ie53219.2021.9649132 · Cited by 75
Analyzing flow-based anomaly intrusion detection using Replicator Neural Networks
Cordero, C. G., Hauke, S., Mühlhäuser, M., & Fischer, M. (2016) · Conference on Privacy, Security and Trust · doi:10.1109/pst.2016.7906980 · Cited by 71
“Instead of PCA, however, we use an unsupervised anomaly detection technique which uses RNNs. RNNs are neural networks and particular instances of autoencoders [4] originally proposed as a compression technique [7].”
MethodA deep convolutional neural network approach for astrocyte detection
Suleymanova, I., Balassa, T., Tripathi, S., Molnár, C., Saarma, M., Sidorova, Y. A., & Horváth, P. (2018) · Scientific Reports · doi:10.1038/s41598-018-31284-x · Cited by 62
Aydoğan, M., & Karcı, A. (2019) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2019.123288 · Cited by 73
Automated detection of weather fronts using a deep learning neural network
Biard, J. C., & Kunkel, K. E. (2019) · Advances in statistical climatology, meteorology and oceanography · doi:10.5194/ascmo-5-147-2019 · Cited by 65
Sentiment Analysis of Novel Review Using Long Short-Term Memory Method
Nurrohmat, M. A., & Sn, A. (2019) · IJCCS (Indonesian Journal of Computing and Cybernetics Systems) · doi:10.22146/ijccs.41236 · Cited by 60
“Deep learning is one technique in machine learning that utilizes many layers of nonlinear information processing to perform feature extraction, pattern recognition, and classification [8].”
MethodDiabetic Retinopathy Detection Using Machine Learning
Parthasharathi, G. U., Kumar, K., Premnivas, R., & Jasmine, K. (2022) · Journal of Innovative Image Processing · doi:10.36548/jiip.2022.1.003 · Cited by 66
Robustness, Stability, and Fidelity of Explanations for a Deep Skin Cancer Classification Model
Saarela, M., & Geogieva, L. (2022) · Applied Sciences · doi:10.3390/app12199545 · Cited by 66
“In comparison to traditional or “shallow” neural networks, deep networks use multiple layers to progressively extract higher-level features from the raw input [32,33].”
BackgroundArtificial intelligence and machine learning in pain research: a data scientometric analysis
Lötsch, J., Ultsch, A., Mayer, B., & Kringel, D. (2022) · PAIN Reports · doi:10.1097/pr9.0000000000001044 · Cited by 66
“Apart from regression analysis, different types of classifiers were most commonly used in supervised analysis of pain-related data, with “deep learning” (for an overview, refer to 14 ) being the most frequently mentioned.”
Essalat, M., Abolhosseini, M., Le, T. H., Moshtaghion, S. M., & Kanavi, M. R. (2022) · Scientific Reports · doi:10.1038/s41598-023-35085-9 · Cited by 60
Hamdi, M., Mestiri, S., & Arbi, A. (2024) · Journal of risk and financial management · doi:10.3390/jrfm17040132 · Cited by 69
“For more details about deep learning approaches refer to the studies of Deng and Yu (2014) and LeCun et al. (2015).”
MethodDeep neural networks for automatic detection of screams and shouted speech in subway trains
Laffitte, P., Sodoyer, D., Tatkeu, C., & Laurent Girin, B. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472921 · Cited by 60
“In the present study, we use RBMs stacked into DBNs, and turned into DNNs, as described in detail in [23].”
MethodOptimization of convolutional neural network using microcanonical annealing algorithm
Ayumi, V., Rere, L. M. R., Fanany, M. I., & Arymurthy, A. M. (2016) · International Conference on Advanced Computer Science and Information Systems · doi:10.1109/icacsis.2016.7872787 · Cited by 73
Towards a Top-down Policy Engineering Framework for Attribute-based Access Control
Narouei, M., Khanpour, H., Takabi, H., Parde, N., & Nielsen, R. D. (2017) · ACM Symposium on Access Control Models and Technologies (SACMAT) · doi:10.1145/3078861.3078874 · Cited by 73
“Deep learning (also known as deep structured learning, hierarchical learning or deep machine learning) is a learning method that attempts to model high level abstractions in data using a deep network [8].”
BackgroundBig Sensed Data Meets Deep Learning for Smarter Health Care in Smart Cities
Obinikpo, A., & Kantarci, B. (2017) · Journal of Sensor and Actuator Networks · doi:10.3390/jsan6040026 · Cited by 57
“These layers enable the definition of hierarchical knowledge that derives from simpler knowledge [35].”
BackgroundHunting Malicious TLS Certificates with Deep Neural Networks
Torroledo, I., Camacho, L. D., & Bahnsen, A. C. (2018) · ACM Workshop on Artificial Intelligence and Security (AISec) · doi:10.1145/3270101.3270105 · Cited by 60
“Based on neural network theory, deep neural networks are an extension of traditional theory that incorporate more complex and longer models in order to improve feature extraction and transformation of the inputted data to increase model performance [10].”
MethodA multi-level fusion based decision support system for academic collaborator recommendation
Pradhan, T., & Pal, S. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.105784 · Cited by 62
A C-BiLSTM Approach to Classify Construction Accident Reports
Zhang, J., Zi, L., Hou, Y., Deng, J. D., Jiang, W., & Wang, M. (2020) · Applied Sciences · doi:10.3390/app10175754 · Cited by 60
“DL is a class of machine learning algorithms that uses multiple layers to progressively extract higher-level features from the raw input [27].”
BackgroundLearning-Based Mobile Edge Computing Resource Management to Support Public Blockchain Networks
Asheralieva, A., & Niyato, D. T. (2019) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2019.2959772 · Cited by 62
“The proof of Lemma 6 is given in Appendix G. Note that the proposed algorithm belongs to the family of unsupervised deep Q-learning [40], [41], [42], [43] techniques.”
BackgroundMethodInfluentialAPT attack detection based on flow network analysis techniques using deep learning
Xuan, C. D., Dao, M. H., & Nguyen, H. D. (2020) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-200694 · Cited by 75
Albahli, S., & Albattah, W. (2020) · Journal of X-Ray Science and Technology · doi:10.3233/xst-200720 · Cited by 59
“One definition by [4] is a subfield of machine learning which is employed to extract and transform features as well as performing pattern analysis and classification, by processing non-linear information.”
BackgroundPradhan, A., Kim, Y.-T., Shrestha, S., Huynh, T., & Nguyen, B. (2020) · Environmental science and pollution research international · doi:10.1007/s11356-020-10646-x · Cited by 53
An extremely simple macroscale electronic skin realized by deep machine learning
Sohn, K., Chung, J., Cho, M.-Y., Timilsina, S., Park, W. B., Pyo, M., Shin, N., Sohn, K., & Kim, J. S. (2017) · Scientific Reports · doi:10.1038/s41598-017-11663-6 · Cited by 62
Warrick, P. A., & Homsi, M. N. (2018) · Physiological Measurement · doi:10.1088/1361-6579/aad386 · Cited by 61
Aslam, M., Xue, C., Chen, Y., Zhang, A., Liu, M., Wang, K., & Cui, D. (2021) · Scientific Reports · doi:10.1038/s41598-021-83184-2 · Cited by 63
Sertkaya, M. E., Ergen, B., & Toğaçar, M. (2019) · International Conference Electronics · doi:10.1109/electronics.2019.8765579 · Cited by 58
“Therefore, this diversity of deep learning is used in particular for classification, recognition, detection [20].”
BackgroundSmart ring resonator–based sensor for multicomponent chemical analysis via machine learning
Li, Z., Zhang, H., Nguyễn, B. T. T., Luo, S., Liu, P. Y., Zou, J., Shi, Y., Cai, H. N., Yang, Z., Jin, Y., et al. (2020) · Photonics Research · doi:10.1364/prj.411825 · Cited by 61
Lithological Mapping Based on Fully Convolutional Network and Multi-Source Geological Data
Wang, Z., Zuo, R., & Liu, H. (2021) · Remote Sensing · doi:10.3390/rs13234860 · Cited by 63
“Deep learning algorithms are dominant in dealing with high-dimensional datasets for classification and prediction through multi-layer network learning [15].”
BackgroundECG-Based Driver’s Stress Detection Using Deep Transfer Learning and Fuzzy Logic Approaches
Amin, M., Ullah, K., Asif, M., Waheed, A., Haq, S. U., Zareei, M., & Biswal, R. R. (2022) · IEEE Access · doi:10.1109/access.2022.3158658 · Cited by 58
“Different non-linear techniques used in these approaches had not been able to accomplish the robust analysis of such complex signals [29].”
BackgroundMethodInfluentialQayyum, W., Ehtisham, R., Bahrami, A., Camp, C. V., Mir, J., & Ahmad, A. (2023) · Materials · doi:10.3390/ma16020826 · Cited by 61
“DL makes use of several layers of non-linear information processing [5].”
Wang, N., Liu, H., Li, Y., Zhou, W., & Ding, M. (2023) · Plants · doi:10.3390/plants12183328 · Cited by 65
“As a vital branch of machine learning, DL has been widely applied in image recognition and natural language processing [27,28].”
BackgroundVisualizing the knowledge mapping of artificial intelligence in education: A systematic review
Qin, Q., & Zhang, S. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-13076-1 · Cited by 68
“…algorithm in the 1970s (Chakravarthy, 2019) to the widespread recognition of backpropagation neural networks in the 1980s (Hinton & Salakhutdinov, 2006), and further to the emergence of deep learning (DL) in the 2000s (Deng & Yu, 2014), with advancements in GAI continuing to the present day.”
Deep Learning-Based Goal Recognition in Open-Ended Digital Games
Min, W., Ha, E. Y., Rowe, J., Mott, B., & Lester, J. C. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v10i1.12717 · Cited by 72
Deep Transferable Compound Representation across Domains and Tasks for Low Data Drug Discovery
Abbasi, K., Poso, A., Ghasemi, J. B., Amanlou, M., & Masoudi‐Nejad, A. (2019) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.9b00626 · Cited by 61
Rehman, S. U., Javed, A. R., Khan, M. U., Awan, M. N., Farukh, A., & Hussien, A. A. (2020) · Enterprise Information Systems · doi:10.1080/17517575.2020.1852316 · Cited by 59
“Deep learning is a branch of artificial intelligence that (Deng et al. 2014) uses several hidden layers of neuron architecture to extract significant information as features from the unrefined input sample.”
BackgroundSign Language Gloss Translation using Deep Learning Models
Amin, M. A., Hefny, H., & Mohammed, A. (2021) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2021.0121178 · Cited by 77
“In contrast to traditional methods, machine and deep learning have shown great success in several application domains for years [18], [19], [20].”
ResultRen, M., Vu, H. Q., Li, G., & Law, R. (2020) · Journal of Hospitality Marketing & Management · doi:10.1080/19368623.2020.1765226 · Cited by 68
Radhakrishnan, M., Karthik, R., Choudhury, K., Won, D., & Manoharan, T. A. (2021) · Traitement du signal · doi:10.18280/ts.380332 · Cited by 60
“Deep learning, a sub-class of machine learning, uses several non-linear layers of information processing for supervised or unsupervised extraction of features, transformation, pattern analysis, and classification [28].”
BackgroundMemory visualization for gated recurrent neural networks in speech recognition
Tang, Z., Shi, Y., Wang, D., Feng, Y., & Zhang, S. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7952654 · Cited by 55
“Deep learning has gained brilliant success in a wide spectrum of research areas including automatic speech recognition (ASR) [1].”
BackgroundInfluentialA Joint Introduction to Natural Language Processing and to Deep Learning
Deng, L., & Liu, Y. (2018) · Springer eBooks · doi:10.1007/978-981-10-5209-5_1 · Cited by 73
Self-citationA survey on image data analysis through clustering techniques for real world applications
Wazarkar, S., & Keshavamurthy, B. N. (2018) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2018.07.009 · Cited by 62
Prediction and Inference of Flow Duration Curves Using Multioutput Neural Networks
Worland, S. C., Steinschneider, S., Asquith, W. H., Knight, R. R., & Wieczorek, M. (2019) · Water Resources Research · doi:10.1029/2018wr024463 · Cited by 57
Machine Learning Coupled Multi‐Scale Modeling for Redox Flow Batteries
Bao, J., Murugesan, V., Kamp, C. J., Shao, Y., Yan, L., & Wang, W. (2019) · Advanced Theory and Simulations · doi:10.1002/adts.201900167 · Cited by 62
Wu, J., Xu, L., Wu, F., Kong, Y., Senhadji, L., & Shu, H. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.02.053 · Cited by 60
Short Term Electric Load Forecasting Based on Data Transformation and Statistical Machine Learning
Andriopoulos, N., Magklaras, A., Birbas, A. N., Papalexopoulos, A. D., Valouxis, C., Daskalaki, S., Birbas, M., Housos, E., & Papaioannou, G. P. (2020) · Applied Sciences · doi:10.3390/app11010158 · Cited by 60
Inversion of magnetic data using deep neural networks
Hu, Z., Liu, S., Hu, X., Fu, L., Qu, J., Wang, H., & Chen, Q. (2021) · Physics of The Earth and Planetary Interiors · doi:10.1016/j.pepi.2021.106653 · Cited by 56
Deep Learning-Based Classification of News Texts Using Doc2Vec Model
Dogru, H. B., Tilki, S., Jamıl, A., & Hameed, A. A. (2021) · International Conference on Artificial Intelligence and Data Analytics (CAIDA) · doi:10.1109/caida51941.2021.9425290 · Cited by 56
“Deep Learning [21] is a set of methods consisting of artificial neural networks based on deep architecture, the number of hidden layers is increased and a feature of the problem is learned in each layer.”
MethodThe Development and Application of Machine Learning in Atmospheric Environment Studies
Zheng, L., Lin, R., Wang, X., & Chen, W. (2021) · Remote Sensing · doi:10.3390/rs13234839 · Cited by 60
Predicting asthma control deterioration in children
Luo, G., Stone, B. L., Fassl, B. A., Maloney, C. G., Gesteland, P. H., Yerram, S. R., & Nkoy, F. L. (2015) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-015-0208-9 · Cited by 56
“Advanced predictive models were built using the top six classification algorithms recognized in the machine learning and data mining literature [38, 39]: support vector machine, random forest, multiboost with decision stumps, naive Bayes, k-nearest neighbor, and deep learning.”
MethodDeep LSTM based Feature Mapping for Query Classification
Shi, Y., Yao, K., Tian, L., & Jiang, D. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1176 · Cited by 63
“Deep neural networks (Bengio, 2009; Deng and Yu, 2014; Hinton et al., 2006) dominates natural language processing (Socher, 2012; Collobert et al.”
BackgroundPARTICLE SWARM OPTIMIZATION (PSO) FOR TRAINING OPTIMIZATION ON CONVOLUTIONAL NEURAL NETWORK (CNN)
Syulistyo, A. R., Purnomo, D. M. J., Rachmadi, M. F., & Wibowo, A. (2016) · Jurnal Ilmu Komputer dan Informasi · doi:10.21609/jiki.v9i1.366 · Cited by 56
“From a wide variety descriptions that exist, deep learning generally has two aspects [2].”
BackgroundUnderstanding convolutional neural networks using a minimal model for handwritten digit recognition
Teow, M. Y. W. (2017) · IEEE International Conference on Automatic Control and Intelligent Systems (I2CACIS) · doi:10.1109/i2cacis.2017.8239052 · Cited by 65
“Recently, CNNs have constituted as a useful tool for developing commercial computer vision applications to recognise image objects, identify human faces in picture, road signs recognition for self-drive cars, handwritten characters recognition, video surveillance, and other visual tasks [14].”
BackgroundMethodInfluentialHigh-Speed Imaging Meets Single-Cell Analysis
Mikami, H., Lei, C., Nitta, N., Sugimura, T., Ito, T., Ozeki, Y., & Goda, K. (2018) · Chem · doi:10.1016/j.chempr.2018.06.011 · Cited by 62
A Survey on Data‐Driven 3D Shape Descriptors
Rostami, R., Bashiri, F. S., Rostami, B., & Yu, Z. (2018) · Computer Graphics Forum · doi:10.1111/cgf.13536 · Cited by 63
Push-pull competition between bottom-up and top-down auditory attention to natural soundscapes
Huang, N. J., & Elhilali, M. (2020) · eLife · doi:10.7554/elife.52984 · Cited by 58
“Classifica- tion was performed using a 3-layer feed-forward back-propagation neural network with sigmoid and relu activations for the first and second layers respectively and a softmax for the final layer (Deng, 2013; Goodfellow et al., 2016).”
MethodNadeem, S. A., Hoffman, E. A., Sieren, J. C., Comellas, A. P., Bhatt, S. P., Barjaktarević, I., Abtin, F. G., & Saha, P. K. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.3029013 · Cited by 63
“…years, deep learning (DL) approaches have become popular in computer vision and image processing and have demonstrated unique strengths in extracting optimum knowledge embedded in data and put it into a process without requiring any application specific rules or process level design [31]–[34].”
BackgroundAhmed, S., Kim, B. C., Lee, K. H., Jung, H. Y., & Initiative, A. D. N. (2020) · PLoS ONE · doi:10.1371/journal.pone.0242712 · Cited by 62
“The classification accuracy of CNNs is subject to the discriminating features among the available classes [43].”
BackgroundTowards Effective Detection of Recent DDoS Attacks: A Deep Learning Approach
Lopes, I. O., Zou, D., Ruambo, F. A., Akbar, S., & Yuan, B. (2021) · Security and Communication Networks · doi:10.1155/2021/5710028 · Cited by 66
“Multiple layers allow a deep learning model to automatically discover complex correlations and mapping from the input to output data [25].”
BackgroundArabic Handwritten Characters Recognition Using Convolutional Neural Network
AlJarrah, M. N., Zyout, M., & Duwairi, R. (2021) · International Conference on Information and Communication Systems (ICICS) · doi:10.1109/icics52457.2021.9464596 · Cited by 55
Saha, S., Roy, J., Hembram, T. K., Pradhan, B., Dikshit, A., Maulud, K. N. A., & Alamri, A. M. (2021) · Water · doi:10.3390/w13192664 · Cited by 56
Recent advances of machine vision technology in fish classification
Li, D., Wang, Q., Li, X., Niu, M., Wang, H., & Liu, C. (2022) · ICES Journal of Marine Science · doi:10.1093/icesjms/fsab264 · Cited by 60
Current trends in chromatographic prediction using artificial intelligence and machine learning
Singh, Y. R., Shah, D. B., Kulkarni, M., Patel, S. R., Maheshwari, D., Shah, J. S., & Shah, S. (2023) · Analytical Methods · doi:10.1039/d3ay00362k · Cited by 65
Stacked Autoencoders for the P300 Component Detection
Vařeka, L., & Mautner, P. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00302 · Cited by 55
“Furthermore, to the authors’ best knowledge, there are very few papers that study deep neural networks for EEG/ERP data (Deng and Yu, 2013).”
BackgroundA Hybrid Deep ResNet and Inception Model for Hyperspectral Image Classification
Alotaibi, B., & Alotaibi, M. (2020) · PFG – Journal of Photogrammetry Remote Sensing and Geoinformation Science · doi:10.1007/s41064-020-00124-x · Cited by 68
Srivastava, G. K., Chauhan, A., Jangid, M., & Chaurasia, S. (2022) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2022.103848 · Cited by 56
“Deep learning approaches have gained popularity in recent years as a consequence of their capacity to learn without assistance and develop highly efficient solutions that have never been seen before [7].”
Neto, E. C. P., Baum, D. M., de Almeida, J. R., Camargo, J. B., & Cugnasca, P. S. (2023) · Aerospace · doi:10.3390/aerospace10040358 · Cited by 54
Farhangi, H., Mozafari, V., Roosta, H. R., Shirani, H., & Farhangi, M. (2023) · Scientific Reports · doi:10.1038/s41598-023-33855-z · Cited by 54
Wrist-Based Electrodermal Activity Monitoring for Stress Detection Using Federated Learning
Almadhor, A. S., Sampedro, G. A., Abisado, M., Abbas, S., Kim, Y., Khan, M. A., Baili, J., & Cha, J. (2023) · Sensors · doi:10.3390/s23083984 · Cited by 65
Advanced Data Exploitation in Speech Analysis: An overview
Zhang, Z., Cummins, N., & Schuller, B. W. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2699358 · Cited by 58
“Because of the advancement of deep-learning technologies [6], [7], this need for data has become more compelling than ever.”
BackgroundInfluentialEditors' Choice—Artificial Intelligence Based Mobile Application for Water Quality Monitoring
Gunda, N. S. K., Gautam, S. H., & Mitra, S. K. (2019) · Journal of The Electrochemical Society · doi:10.1149/2.0081909jes · Cited by 54
Wang, Y., Xu, C., Zhang, S., Li, Y., Wang, Z., Zhu, Y., & Yuan, J. (2019) · Scientific Reports · doi:10.1038/s41598-019-44469-9 · Cited by 54
Deep convolutional neural network in medical image processing
Mohapatra, S., Swarnkar, T., & Das, J. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-823014-5.00006-5 · Cited by 62
Chu, H.-H., Deng, L., Yuan, H., Long, L., & Guo, J. (2023) · Automation in Construction · doi:10.1016/j.autcon.2023.105194 · Cited by 55
Self-citationCredit scoring using machine learning and deep Learning-Based models
Mestiri, S. (2024) · Data Science in Finance and Economics · doi:10.3934/dsfe.2024009 · Cited by 62
“For more details about the deep learning approach, we can refer to the studies of Deng and Yu (2014) and Le Cun et al., (2015).”
ResultExplicating the transformative role of artificial intelligence in designing targeted nanomedicine
Akhtar, M., Nehal, N., Gull, A., Parveen, R., Khan, S. I., Khan, S. M., & Ali, J. (2025) · Expert Opinion on Drug Delivery · doi:10.1080/17425247.2025.2502022 · Cited by 60
Alidoost, F., & Arefi, H. (2018) · PFG – Journal of Photogrammetry Remote Sensing and Geoinformation Science · doi:10.1007/s41064-018-0060-5 · Cited by 63
“It is based on hierarchical learning representations of data using a deep structure composed of different hidden layers (Bengio 2009; Deng and Yu 2014; Schmidhuber 2015).”
BackgroundDeep convolutional neural network architecture design as a bi-level optimization problem
Louati, H., Bechikh, S., Louati, A., Hung, C., & Saïd, L. B. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.01.094 · Cited by 59
An evaluation of deep neural network models for music classification using spectrograms
Li, J., Han, L., Li, X., Zhu, J., Yuan, B., & Gou, Z. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-020-10465-9 · Cited by 61
Lin, Z., & Guo, W. (2021) · Remote Sensing · doi:10.3390/rs13142822 · Cited by 57
“Deep learning tasks require abundant training images [16,57], especially for complex object detection tasks such as cotton plant detection and counting.”
BackgroundRemote Health Monitoring Systems for Elderly People: A Survey
Ahmed, S., Irfan, S., Kiran, N., Masood, N., Anjum, N., & Ramzan, N. (2023) · Sensors · doi:10.3390/s23167095 · Cited by 52
EPE-NAS: Efficient Performance Estimation Without Training for Neural Architecture Search
Lopes, V., Alirezazadeh, S., & Alexandre, L. A. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86383-8_44 · Cited by 75
“In the past years, deep learning algorithms have been extensively researched, and efficiently applied to various tasks with excellent results [1], [2], especially those related to computer vision [3].”
Inteligência artificial: avanços e tendências
Cozman, F. G., Plonski, G. A., & Neri, H. (2021) · Universidade de São Paulo. Instituto de Estudos Avançados eBooks · doi:10.11606/9786587773131 · Cited by 98
Cheng, L., Karkhanis, P., Gökbağ, B., Liu, Y., & Li, L. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1008885 · Cited by 52
Convolutional neural networks for sleep stage scoring on a two-channel EEG signal
Fernández-Blanco, E., Rivero, D., & Pazos, A. (2019) · Soft Computing · doi:10.1007/s00500-019-04174-1 · Cited by 64
Prediction carbon dioxide solubility in ionic liquids based on deep learning
Deng, T., Liu, F.-H., & Jia, G. (2019) · Molecular Physics · doi:10.1080/00268976.2019.1652367 · Cited by 55
Zhang, S., Han, F., Liang, Z., Tan, J., Cao, W., Gao, Y., Pomeroy, M. J., Ng, K., & Hou, W. (2019) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2019.101645 · Cited by 58
“…machine deep learning (DL) algorithm based artificial intelligence (AI) has been a hot trend to assist experts to ease the burden of their jobs with reasonably good or better performance in all fields (Ngiam et al., 2011; Mnih et al., 2013; Deng and Yu, 2014; Schmidhuber, 2015; LeCun et al., 2015).”
BackgroundWang, Y., Chardonnet, J.-R., & Merienne, F. (2019) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr.2019.8798213 · Cited by 61
A deep learning-based framework for lung cancer survival analysis with biomarker interpretation
Cui, L., Li, H., Hui, W., Chen, S., Yang, L., Kang, Y., Bo, Q., & Feng, J. H. (2020) · BMC Bioinformatics · doi:10.1186/s12859-020-3431-z · Cited by 59
Deep Neural Network and Long Short-Term Memory for Electric Power Load Forecasting
Son, N., Yang, S.-H., & Na, J. (2020) · Applied Sciences · doi:10.3390/app10186489 · Cited by 52
Objek Deteksi Makanan Khas Palembang Menggunakan Algoritma YOLO (You Only Look Once)
Rahma, L., Syaputra, H., Mirza, A. H., & Purnamasari, S. D. (2021) · Jurnal Nasional Ilmu Komputer · doi:10.47747/jurnalnik.v2i3.534 · Cited by 52
An enhanced shuttleworth-wallace model for simulation of evapotranspiration and its components
Chen, H., Jiang, A. Z., Huang, J. J., Li, H., McBean, E. A., Singh, V. P., Zhang, J., Lan, Z., Gao, J., & Zhou, Z. (2021) · Agricultural and Forest Meteorology · doi:10.1016/j.agrformet.2021.108769 · Cited by 52
Attack Classification Analysis of IoT Network via Deep Learning Approach
Tama, B. A., & Rhee, K.-H. (2017) · Research Briefs on Information and Communication Technology Evolution · doi:10.56801/rebicte.v3i.54 · Cited by 65
“Machine (RBM), a type of neural network [24] [5].”
BackgroundCross-Domain Contrastive Learning for Hyperspectral Image Classification
Guan, P., & Lam, E. Y. M. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3176637 · Cited by 58
“It learns a latent representation by trying to reconstruct the original input data completely [36].”
Background
Metadata
- Authors
- Deng, L., & Yu, D.
- Affiliations
- Microsoft (United States) (US)
- Venue
- Foundations and Trends® in Signal Processing
- Publisher
- Emerald
- Published
- 2014-06-30
- Volume
- 7
- Issue
- 3-4
- Pages
- 197-387
- ISSN
- 1932-8346 (ISSN-L)
- 1932-8354
- OpenAlex
- W4205947740
- Cited by
- 3,480
- References
- 21
- Citations by year
- 2026: 113 · 2025: 206 · 2024: 298 · 2023: 410 · 2022: 469 · 2021: 453 · 2020: 404 · 2019: 426 · 2018: 304 · 2017: 188 · 2016: 146 · 2015: 57 · 2014: 3
- FWCI
- 117.48
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Foundations and Trends® in Signal Processing (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- deep learning, signal processing, information processing, speech recognition, computer vision, natural language processing, text processing, information retrieval, multimodal information processing, multi-task learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.