Deep Learning: Methods and Applications
Open accessThe DOI matches its Crossref record; 28 of the 168 references it cites were found in a registry or an index, and 140 are not checked yet.
Abstract
This monograph provides an overview of general deep learning methodology and its applications to a variety of signal and information processing tasks. The application areas are chosen with the following three criteria in mind: (1) expertise or knowledge of the authors; (2) the application areas that have already been transformed by the successful use of deep learning technology, such as speech recognition and computer vision; and (3) the application areas that have the potential to be impacted significantly by deep learning and that have been experiencing research growth, including natural language and text processing, information retrieval, and multimodal information processing empowered by multi-task deep learning.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Deep learning is successfully used as a tool for machine learning, where a neural network is capable of automatically learning features.”
From Medical image analysis using convolutional neural networks: a review (2018) · cites this paper as [47]
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Self-citationLearning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239 · cited 6×
“Since 2006, deep structured learning, or more commonly called deep learning or hierarchical learning, has emerged as a new area of machine learning research [20, 163].”
BackgroundMethodInfluentialLearning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542 · cited 1×
“, speech or text), but until recently they had not been widely used partly because they are difficult to train to capture long-term dependencies, giving rise to gradient vanishing or gradient explosion problems which were known in early 1990s [29, 167].”
BackgroundWolpert, D. H. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80023-1 · Cited by 7,951
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878 · cited 1×
“[347] developed the recursive neural tensor network, where each layer is constructed similarly to that of the neural tensor network described in [340] with an illustration shown in Figure 8.”
MethodCaruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636 · cited 1×
“The several architectures discussed so far in this chapter for multimodal processing and learning can be regarded as special cases of more general multi-task learning and transfer learning [22, 47].”
Background
Research works printed but not linked: 276
- Abdel-Hamid, 2013, Proceedings of Interspeech,
- Abdel-Hamid, 2013, Proceedings of Interspeech.
- Abdel-Hamid, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Acero, 2000, Proceedings of Interspeech
- Alain, 2013, Proceedings of International Conference on Learning Representations (ICLR).
- Arisoy, 2012, Proceedings of the Joint Human Language Technology Conference and the North American Chapter of the Association of Computational Linguistics (HLT-NAACL) Workshop.
- Aslan, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Ba, 2013, Proceedings of Neural Information Processing Systems (NIPS
- Baldi, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- E. Battenberg , E.Schmidt, and J.Bello. Deep learning for music, special session at International Conference on Acoustics Speech and Signal Processing (ICASSP) (http://www.icassp2014.org/ special_sections.html#ss8), 2014.
- Batternberg, 2012, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Bell, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Bengio, 2008, Scholarpedia,
- Bengio, 2012, Deep learning of representations for unsupervised and transfer learning, Journal of Machine Learning Research Workshop and Conference Proceedings, 27, 17
- Bengio, 2013, Statistical Language and Speech Processing,, 1
- Bengio, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Bengio, 2000, Proceedings of Neural Information Processing Systems (NIPS
- Bengio, 2003, A neural probabilistic language model, Journal of Machine Learning Research,, 3, 1137
- Bengio, 2006, Proceedings of Neural Information Processing Systems (NIPS
- Bengio, 2013, Proceedings of International Conference on Machine Learning (ICML), 2014.
- Bengio, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Bergstra, 2012, Random search for hyper-parameter optimization, Journal on Machine Learning Research,, 3, 281
- Bilmes, 2010, Dynamic graphical models, IEEE Signal Processing Magazine,, 33, 29
- Bordes, 2013, Machine Learning,
- Bordes, 2011, Proceedings of Association for the Advancement of Artificial Intelligence (AAAI).
- Bottou, 2013, From machine learning to machine reasoning: An essay, Journal of Machine Learning Research,, 14, 3207
- Bottou, 2004, Proceedings of Neural Information Processing Systems (NIPS
- Boulanger-Lewandowski, 2012, Proceedings of International Conference on Machine Learning (ICML).
- Boulanger-Lewandowski, 2013, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Bourlard, 1993, Connectionist Speech Recognition: A Hybrid Approach.
- Breiman, 1996, Stacked regression, Machine Learning,, 24, 49, 10.1023/a:1018046112532 · doi:10.1023/a:1018046112532 · Paper page
- Cardinal, 2013, Large vocabulary speech recognition on parallel architectures, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 2290, 10.1109/tasl.2013.2271591 · doi:10.1109/tasl.2013.2271591
- Chen, 2014, Proceedings of International Conference on Learning Representations.
- Chen, 2012, Proceedings of Interspeech.
- Chengalvarayan, 1997, IEEE Transactions on Speech and Audio Processing, 243
- Chengalvarayan, 1997, IEEE Transactions on Speech and Audio Processing,, 232
- Chengalvarayan, 1998, Speech trajectory discrimination using the minimum classification error learning, IEEE Transactions on Speech and Audio Processing,, 6, 505, 10.1109/89.725317 · doi:10.1109/89.725317
- Cho, 2009, Proceedings of Neural Information Processing Systems (NIPS, 342
- Ciresan, 2012, Proceedings of Neural Information Processing Systems (NIPS
- Ciresan, 2010, Neural Computation
- Ciresan, 2011, Proceedings of International Joint Conference on Neural Networks (IJCNN).
- Ciresan, 2012, Proceedings of Computer Vision and Pattern Recognition (CVPR).
- Ciresan, 2012, Proceedings of International Joint Conference on Neural Networks (IJCNN).
- Coates, 2013, Proceedings of International Conference on Machine Learning (ICML).
- Cohen, 2005, Proceedings of International Joint Conference on Artificial Intelligence (IJCAI),, 671
- Collobert, 2011, Proceedings of Artificial Intelligence and Statistics (AISTATS
- Collobert, 2008, Proceedings of International Conference on Machine Learning (ICML).
- Collobert, 2011, Natural language processing (almost) from scratch, Journal on Machine Learning Research,, 12, 2493
- Dahl, 2010, Phone recognition with the mean-covariance restricted boltzmann machine, Proceedings of Neural Information Processing Systems (NIPS, 23, 469
- Dahl, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dahl, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dahl, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Dean, 2012, Proceedings of Neural Information Processing Systems (NIPS
- Demuynck, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Deng, 1993, IEEE Transactions on Speech and Audio Processing, 471
- Deng, 2003, Mathematical Foundations of Speech and Language Processing,, 115
- Deng, 2011, Proceedings of Asian-Pacific Signal & Information Processing Annual Summit and Conference (APSIPA-ASC).
- Deng, 2012, The MNIST database of handwritten digit images for machine learning research, IEEE Signal Processing Magazine,, 29
- Deng, 2013, Neural Information Processing Systems (NIPS) Workshop on Learning Output Representations.
- Deng, 2013, Asian-Pacific Signal & Information Processing Association Transactions on Signal and Information Processing.
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2001, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2014, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 1992, Structural design of a hidden Markov model based speech recognizer using multi-valued phonetic features: Comparison with segmental speech units, Journal of the Acoustical Society of America,, 92, 3058, 10.1121/1.404202 · doi:10.1121/1.404202
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2004, Challenges in adopting speech recognition, Communications of the Association for Computing Machinery (ACM),, 47, 11
- Deng, 2012, Proceedings of Interspeech.
- Deng, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2003, Speech Processing — A Dynamic and Optimization-Oriented Approach
- Deng, 1996, Transitional speech units and their representation by regressive Markov states: Applications to speech recognition, IEEE Transactions on speech and audio processing,, 4, 301, 10.1109/89.506934 · doi:10.1109/89.506934
- Deng, 2010, Proceedings of Interspeech.
- Deng, 2012, Proceedings of IEEE Workshop on Spoken Language Technologies
- Deng, 2002, Distributed speech processing in mipad’s multimodal user interface, IEEE Transactions on Speech and Audio Processing,, 10, 605, 10.1109/tsa.2002.804538 · doi:10.1109/tsa.2002.804538
- Deng, 2005, Dynamic compensation of HMM variances using the feature enhancement uncertainty computed from a parametric model of speech distortion, IEEE Transactions on Speech and Audio Processing,, 13, 412, 10.1109/tsa.2005.845814 · doi:10.1109/tsa.2005.845814
- Deng, 2007, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deng, 2011, Proceedings of Interspeech.
- Deng, 2009, Neural Information Processing Systems (NIPS) Workshop
- Deng, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Deselaers, 2009, Proceedings of 4th Workshop on Statistical Machine Translation,, 233
- Dognin, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Erhan, Journal on Machine Learning Research,, 201
- Fernandez, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 6885
- Fine, 1998, Machine Learning, 41
- Frome, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Fu, 2007, Proceedings of Interspeech
- Gales, 2011, Robust Speech Recognition of Uncertain or Missing Data: Theory and Application, 101, 10.1007/978-3-642-21317-5_5 · doi:10.1007/978-3-642-21317-5_5
- Gao, 2010, Proceedings of Conference on Information and Knowledge Management (CIKM).
- Gao, 2013, Proceedings of Neural Information Processing Systems (NIPS) Workshop on Deep Learning
- Gao, 2014, Proceedings of Association for Computational Linguistics (ACL).
- Gao, 2011, Proceedings of Special Interest Group on Information Retrieval (SIGIR).
- Gens, 2012, Neural Information Processing Systems (NIPS),
- Gibson, 2010, Error approximation and minimum phone error acoustic model estimation, IEEE Transactions on Audio, Speech, and Language Processing,, 18, 1269, 10.1109/tasl.2009.2032607 · DOI
- Glorot, 2010, Proceedings of Artificial Intelligence and Statistics (AISTATS).
- Glorot, 2011, Proceedings of Artificial Intelligence and Statistics (AIS-TATS
- Goodfellow, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Graves, 2012, Representation Learning Workshop, International Conference on Machine Learning (ICML),
- Graves, 2006, Proceedings of International Conference on Machine Learning (ICML).
- Graves, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Graves, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Grezl, 2008, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Gutmann, 2012, Noise-contrastive estimation of unnormalized statistical models, with applications to natural image statistics, Journal of Machine Learning Research,, 13, 307
- Hain, 2012, IEEE Transactions on Audio, Speech, and Language Processing,, 486
- Hamel, 2010, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Hawkins, 2004, On Intelligence: How a New Understanding of the Brain will lead to the Creation of Truly Intelligent Machines
- He, 2011, IEEE Signal Processing Magazine,
- He, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- He, 2013, Proceedings of the IEEE.
- Heigold, 2013, Investigations on an EM-style optimization algorithm for discriminative training of HMMs, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 2616, 10.1109/tasl.2013.2280234 · doi:10.1109/tasl.2013.2280234
- Heigold, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Heintz, 2009, Discriminative input stream combination for conditional random field phone recognition, IEEE Transactions on Audio, Speech, and Language Processing,, 17, 1533, 10.1109/tasl.2009.2022204 · doi:10.1109/tasl.2009.2022204
- Henderson, 2013, Proceedings of Special Interest Group on Disclosure and Dialogue (SIGDIAL).
- Hermans, 2013, Proceedings of Neural Information Processing Systems (NIPS).
- Hermansky, 2000, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Hinton, 1990, Artificial Intelligence,, 1
- Hinton, 2003, Canadian Psychology,, 10
- Hinton, 2011, A better way to learn features, Communications of the Association for Computing Machinery (ACM),, 54
- Hinton, 2006, Neural Computation,, 1527
- Hinton, 2010, Topics in Cognitive Science,, 1
- Huang, 2012, Proceedings of Association for Computational Linguistics (ACL).
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Association for Computing Machinery (ACM) International Conference Information and Knowledge Management (CIKM),
- Huang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2001, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Huang, 2013, Proceedings of Interspeech,, 2360
- Humphrey, 2012, Proceedings of International Conference on Machine Learning and Application (ICMLA).
- Humphrey, 2012, Proceedings of International Symposium on Music Information Retrieval (ISMIR).
- Humphrey, 2013, Journal of Intelligent Information Systems,
- Hutchinson, 2012, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Hutchinson, 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence,, 1944
- Imseng, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Jaitly, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Jaitly, 2012, Proceedings of Interspeech.
- Jarrett, 2009, Proceedings of International Conference on Computer Vision,, 2146
- Kahou, 2013, Proceedings of International Conference on Multimodal Interaction (ICMI).
- Kang, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 8012
- Kashiwagi, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Kavukcuoglu, 2010, Proceedings of Neural Information Processing Systems (NIPS
- Ketabdar, 2010, IEEE Transactions on Audio, Speech, and Language Processing,, 1094
- Kingsbury, 2009, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Kingsbury, 2012, Proceedings of Interspeech.
- Kiros, 2013, Proceedings of Neural Information Processing Systems (NIPS) Deep Learning Workshop.
- Ko, 2013, IEEE Transactions on Audio, Speech, and Language Processing, 1285
- Krizhevsky, 2012, Proceedings of Neural Information Processing Systems (NIPS).
- Kubo, 2012, Proceedings of Interspeech.
- Kurzweil, 2012, How to Create a Mind.
- Lal, 2013, IEEE Transactions on Audio, Speech, and Language Processing,, 2506
- Larochelle, 2008, Proceedings of International Conference on Machine Learning (ICML).
- Le, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Le, 2010, Proceedings of Empirical Methods in Natural Language Processing (EMNLP, 778
- Le, 2011, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Le, 2013, IEEE Transactions on Audio, Speech, and Language Processing, 197
- Le, 2011, Proceedings of International Conference on Machine Learning (ICML).
- Le, 2012, Proceedings of International Conference on Machine Learning (ICML).
- LeCun, 2012, Proceedings of European Conference on Computer Vision (ECCV).
- LeCun, 1995, The Handbook of Brain Theory and Neural Networks,, 255
- LeCun, 1998, Proceedings of the IEEE,, 2278
- LeCun, 2007, Proceedings of International Conference on Document Analysis and Recognition (ICDAR).
- Lee, 2004, Proceedings of International Conference on Spoken Language Processing (ICSLP),, 109
- Lee, 2009, Proceedings of International Conference on Machine Learning (ICML).
- Lee, 2011, Communications of the Association for Computing Machinery (ACM),, 95
- Lee, 2010, Proceedings of Neural Information Processing Systems (NIPS
- Lena, 2012, Proceedings of Neural Information Processing Systems (NIPS).
- Li, 2014, IEEE/Association for Computing Machinery (ACM) Transactions on Audio, Speech, and Language Processing, 1
- Li, 2012, Proceedings of IEEE Spoken Language Technology (SLT
- Li, 2013, Proceedings Conference on Affective Computing and Intelligent Interaction (ACII),, 312
- Liao, 2013, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Liao, 2013, Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU).
- Lin, 2009, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP).
- Lin, 2011, Proceedings of Computer Vision and Pattern Recognition (CVPR
- Ling, 2013, Modeling spectral envelopes using restricted boltzmann machines for statistical parametric speech synthesis, International Conference on Acoustics Speech and Signal Processing (ICASSP),, 7825
- Ling, 2013, Articulatory control of HMM-based parametric speech synthesis using feature-space-switched multiple regression
- Lu, 2013, Joint uncertainty decoding for noise robust subspace gaussian mixture models, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 1791, 10.1109/tasl.2013.2248718 · doi:10.1109/tasl.2013.2248718
- Ma, 2000, Computer, Speech and Language
- Maas, 2013, Rectifier nonlinearities improve neural network acoustic models
- Manning, 2009, Introduction to Information Retrieval.
- J.Markoff, 2012, Scientists see promise in deep-learning programs
- Martens, 2010, Deep learning with hessian-free optimization
- Martens, 2011, Learning recurrent neural networks with hessian-free optimization
- McGraw, 2013, Learning lexicons from speech using a pronunciation mixture model, IEEE Transactions on Audio, Speech, and Language Processing,, 21, 357, 10.1109/tasl.2012.2226158 · DOI
- Mikolov, 2013, Efficient estimation of word representations in vector space
- Mikolov, 2010, Proceedings of International Conference on Acoustics Speech and Signal Processing (ICASSP),, 1045
- Mikolov, 2013, Distributed representations of words and phrases and their compositionality
- Minami, 2002, A recognition method with parametric trajectory synthesized using direct relations between static and dynamic feature vector time series, 957
- Mnih, 2008, A scalable hierarchical distributed language model, 1081
- Mnih, 2013, Learning word embeddings efficiently with noise-contrastive estimation
- Mnih, 2013, laying arari with deep reinforcement learning
- Mohamed, 2009, Deep belief networks for phone recognition
- Morin, 2005, Hierarchical probabilistic neural network language models
- Murphy, 2012, Machine Learning
- Nair, 2009, 3-d object recognition with deep belief nets
- Ngiam, 2011, Learning deep energy models
- Ngiam, 2011, Multimodal deep learning
- Olshausen, 2012, Can ‘deep learning’ offer deep insights about visual representation?
- Ostendorf, 1999, Moving beyond the ‘beads-on-a-string’ model of speech
- Oudre, 2011, Probabilistic template-based chord recognition, IEEE Transactions on Audio, Speech, and Language Processing, 19, 2249, 10.1109/tasl.2010.2098870 · doi:10.1109/tasl.2010.2098870
- Palangi, 2013, Learning input and recurrent weight matrices in echo state networks
- Palangi, 2013, Using deep stacking network to improve structured compressive sensing with multiple measurement vectors
- Pascanu, 2014, How to construct deep recurrent neural networks
200 of 276 shown
Cited by
Items 201–300 of 1,005
An effective ensemble deep learning framework for text classification
Mohammed, A., & Kora, R. (2021) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2021.11.001 · Cited by 205
An overview of deep learning in medical imaging
Anaya-Isaza, A., Mera-Jiménez, L., & Zequera, M. L. (2021) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2021.100723 · Cited by 197
Data management for production quality deep learning models: Challenges and solutions
Munappy, A. R., Bosch, J., Olsson, H. H., Arpteg, A., & Brinne, B. (2022) · Journal of Systems and Software · doi:10.1016/j.jss.2022.111359 · Cited by 177
Deep learning: Applications, architectures, models, tools, and frameworks: A comprehensive survey
Gheisari, M., Ebrahimzadeh, F., Rahimi, M., Moazzamigodarzi, M., Liu, Y., Dutta Pramanik, P. K., Heravi, M. A., Mehbodniya, A., Ghaderzadeh, M., Feylizadeh, M. R., et al. (2023) · CAAI Transactions on Intelligence Technology · doi:10.1049/cit2.12180 · Cited by 177
Deep Learning in Medical Ultrasound Image Analysis: A Review
Wang, Y., Ge, X., Ma, H., Qi, S., Zhang, G., & Yao, Y. (2021) · IEEE Access · doi:10.1109/access.2021.3071301 · Cited by 194
“In recent years, deep learning has made breakthroughs in computer vision, speech recognition, natural language processing, and bioinformatics [6], which is hailed as one of the top ten technological breakthroughs in 2013 [7].”
BackgroundGeospatial data to images: a deep-learning framework for traffic forecasting
Jiang, W., & Zhang, L. (2019) · Tsinghua Science and Technology · doi:10.26599/tst.2018.9010033 · Cited by 176
“The essence of deep learning is to compute hierarchical features or representations of the observational data, where the higher-level features or factors are defined from the lower-level ones[38].”
BackgroundPławiak, P., Abdar, M., & Rajendra Acharya, U. (2019) · Applied Soft Computing · doi:10.1016/j.asoc.2019.105740 · Cited by 176
Alkadi, O., Moustafa, N., & Turnbull, B. (2020) · IEEE Access · doi:10.1109/access.2020.2999715 · Cited by 217
“These techniques allow systems to automatically learn feature representations needed for detection or classification from large unlabelled raw data [94].”
BackgroundDeep Learning on Underwater Marine Object Detection: A Survey
Moniruzzaman, M., Islam, S. M. S., Bennamoun, M., & Lavery, P. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-70353-4_13 · Cited by 174
“, deep learning transforms input data through more layers than shallow learning algorithms [19].”
BackgroundStructural neuroimaging as clinical predictor: A review of machine learning applications
Mateos-Pérez, J. M., Dadar, M., Lacalle-Aurioles, M., Iturria-Medina, Y., Zeighami, Y., & Evans, A. C. (2018) · NeuroImage: Clinical · doi:10.1016/j.nicl.2018.08.019 · Cited by 174
Type 2 diabetes data classification using stacked autoencoders in deep neural networks
Kannadasan, K., Edla, D. R., & Kuppili, V. (2019) · Clinical Epidemiology and Global Health · doi:10.1016/j.cegh.2018.12.004 · Cited by 173
Alaskar, H., Hussain, A., Al-Aseem, N., Liatsis, P., & Al-Jumeily, D. (2019) · Sensors · doi:10.3390/s19061265 · Cited by 173
“Deep learning has proven to be a powerful machine learning tool and has demonstrated its ability in automated diagnosis of diseases [2,3,9].”
Convolutional Neural Network in Medical Image Analysis: A Review
Kshatri, S. S., & Singh, D. (2023) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-023-09898-w · Cited by 172
“Leung et al. described several models for 3D reconstruction with radiography, including Boundary Detection Algorithm, Generalized Fuzzy Operator, Contour Deformable Model, and Region-Based Technique [21].”
BackgroundMethodA review of building occupancy measurement systems
Sun, K., Zhao, Q., & Zou, J. (2020) · Energy and Buildings · doi:10.1016/j.enbuild.2020.109965 · Cited by 172
Grekousis, G. (2019) · Computers, Environment and Urban Systems · doi:10.1016/j.compenvurbsys.2018.10.008 · Cited by 171
Sajjad, M., Ullah, F. U. M., Ullah, M., Christodoulou, G., Alaya Cheikh, F., Hijji, M., Muhammad, K., & Rodrigues, J. J. P. C. (2023) · Alexandria Engineering Journal · doi:10.1016/j.aej.2023.01.017 · Cited by 170
Forecasting evapotranspiration in different climates using ensembles of recurrent neural networks
Granata, F., & Di Nunno, F. (2021) · Agricultural Water Management · doi:10.1016/j.agwat.2021.107040 · Cited by 168
Salh, A., Audah, L., Shah, N. S. M., Alhammadi, A., Abdullah, Q., Kim, Y. H., Al-Gailani, S. A., Hamzah, S. A., Esmail, B. A. F., & Almohammedi, A. A. (2021) · IEEE Access · doi:10.1109/access.2021.3069707 · Cited by 181
Shi, Q., Liu, M., Marinoni, A., & Liu, X. (2023) · Earth system science data · doi:10.5194/essd-15-555-2023 · Cited by 171
“This condition reduces the efficiency of researchers, and hinders the fair comparison between UGS extraction methods, not to mention providing reliable basic data for large-scale UGS mapping.”
BackgroundA deep learning approach for fault diagnosis of induction motors in manufacturing
Shao, S.-Y., Sun, W.-J., Yan, R.-Q., Wang, P., & Gao, R. X. (2017) · Chinese Journal of Mechanical Engineering · doi:10.1007/s10033-017-0189-y · Cited by 167
Deep learning for Arabic NLP: A survey
Al-Ayyoub, M., Nuseir, A., Alsmearat, K., Jararweh, Y., & Gupta, B. (2018) · Journal of Computational Science · doi:10.1016/j.jocs.2017.11.011 · Cited by 167
Deep Model for Dropout Prediction in MOOCs
Wang, W., Yu, H., & Miao, C. (2017) · Proceedings of the 2nd International Conference on Crowd Science and Engineering · doi:10.1145/3126973.3126990 · Cited by 155
“Deep learning [2, 8, 11] is a subfield of machine learning.”
BackgroundShao, B., Li, X., & Bian, G. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113764 · Cited by 180
Recent Advances in Deep Learning: An Overview
Minar, M. R., & Naher, J. (2018) · arXiv (Cornell University) · doi:10.13140/rg.2.2.24831.10403 · Cited by 111
“Restricted Boltzmann Machines (RBM) are special type of Markov random field containing one layer of stochastic hidden units i.e. latent variables and one layer of observable variables (Deng and Yu (2014), Goodfellow et al. (2016)).”
BackgroundMethodInfluentialSmart Farming Becomes Even Smarter With Deep Learning—A Bibliographical Analysis
Ünal, Z. (2020) · IEEE Access · doi:10.1109/access.2020.3000175 · Cited by 180
“With deep learning, it became possible to process these data [8, p. 205].”
BackgroundMethodMa, X., Lin, Y., Nie, Z., & Ma, H. (2020) · Measurement · doi:10.1016/j.measurement.2020.107811 · Cited by 165
Linking Morphology of Porous Media to Their Macroscopic Permeability by Deep Learning
Kamrava, S., Tahmasebi, P., & Sahimi, M. (2020) · Transport in Porous Media · doi:10.1007/s11242-019-01352-5 · Cited by 165
Application of soft computing techniques to multiphase flow measurement: A review
Yan, Y., Wang, L., Wang, T., Wang, X., Hu, Y., & Duan, Q. (2018) · Flow Measurement and Instrumentation · doi:10.1016/j.flowmeasinst.2018.02.017 · Cited by 165
“Deep learning has been successfully applied in the fields of computer vision, speech recognition and social network filtering [64].”
Machine Learning in Real-Time Internet of Things (IoT) Systems: A Survey
Bian, J., Arafat, A. A., Xiong, H., Li, J., Li, L., Chen, H., Wang, J., Dou, D., & Guo, Z. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3161050 · Cited by 202
“One most employed class of ML algorithms exploits neural network architecture and stack several layers of the neural network well-known as Deep Learning, or Deep Neural Network (DNN) [64]–[66].”
MethodDeep learning for financial sentiment analysis on finance news providers
Day, M.-Y., & Lee, C.-C. (2016) · IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1109/asonam.2016.7752381 · Cited by 199
“[12, 13] The learning theory of the neurons of deep neural network is learned from input(x), through features to learn weighting, then after weighting we can get a better output(y).”
BackgroundA Review on Gas Turbine Gas-Path Diagnostics: State-of-the-Art Methods, Challenges and Opportunities
Fentaye, A. D., Baheta, A. T., Gilani, S. I., & Kyprianidis, K. G. (2019) · Aerospace · doi:10.3390/aerospace6070083 · Cited by 164
“Deep learning (DL) is a sub-field of machine learning (ML) that is used to learn feature hierarchies of data through many layers of non-linear information processing [174].”
BackgroundMohammed, B. A., Senan, E. M., Rassem, T. H., Makbol, N. M., Alanazi, A. A., Al-Mekhlafi, Z. G., Almurayziq, T. S., & Ghaleb, F. A. (2021) · Electronics · doi:10.3390/electronics10222860 · Cited by 164
Bellet, A., Habrard, A., & Sebban, M. (2015) · Synthesis lectures on artificial intelligence and machine learning · doi:10.2200/s00626ed1v01y201501aim030 · Cited by 185
Ensembles of Patch-Based Classifiers for Diagnosis of Alzheimer Diseases
Ahmed, S., Choi, K. Y., Lee, J. J., KIM, B. C., Kwon, G.-R., Lee, K. H., & Jung, H. Y. (2019) · IEEE Access · doi:10.1109/access.2019.2920011 · Cited by 151
“Classification accuracy is subject to the discriminating features among the available classes [29].”
BackgroundUsing artificial intelligence to document the hidden RNA virosphere
Hou, X., He, Y., Fang, P., Mei, S.-Q., Xu, Z., Wu, W.-C., Tian, J.-H., Zhang, S., Zeng, Z.-Y., Gou, Q.-Y., et al. (2024) · Cell · doi:10.1016/j.cell.2024.09.027 · Cited by 162
Machine learning applied to road safety modeling: A systematic literature review
Silva, P. B., Andrade, M., & Ferreira, S. (2020) · Journal of Traffic and Transportation Engineering (English Edition) · doi:10.1016/j.jtte.2020.07.004 · Cited by 162
Chiu, M., Huang, J.-H., Gupta, S., & Akman, G. (2021) · Computers in Industry · doi:10.1016/j.compind.2021.103421 · Cited by 184
LETRIST: Locally Encoded Transform Feature Histogram for Rotation-Invariant Texture Classification
Song, T., Li, H., Meng, F., Wu, Q., & Cai, J. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2017.2671899 · Cited by 161
“networks [25] to compute invariant image representations,”
Hassanpour, A., Moradikia, M., Adeli, H., Khayami, S. R., & Shamsinejadbabaki, P. (2019) · Expert Systems · doi:10.1111/exsy.12494 · Cited by 161
“DL architectures are divided into discriminative, generative, and hybrid (Deng and Yu, 2014; Salakhutdinov, 2015; Schmidhuber, 2015).”
BackgroundA Survey on Deep Learning in Big Data
Gheisari, M., Wang, G., & Bhuiyan, M. Z. A. (2017) · 22017 IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC) · doi:10.1109/cse-euc.2017.215 · Cited by 130
“Index load time is a challenge now same as space consumption [19].”
Background3D-CNN based discrimination of schizophrenia using resting-state fMRI
Qureshi, M. N. I., Oh, J., & Lee, B. (2019) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2019.06.003 · Cited by 160
In situ detection of welding defects: a review
Madhvacharyula, A. S., Pavan, A. V. S., Gorthi, S., Chitral, S., Venkaiah, N., & Kiran, D. V. (2022) · Welding in the World · doi:10.1007/s40194-021-01229-6 · Cited by 174
Mumuni, A., & Mumuni, F. (2025) · Journal of Information and Intelligence · doi:10.1016/j.jiixd.2024.01.002 · Cited by 159
“With modern deep learning models based on neural network frameworks [27], [28], data processing tasks are usually implemented within the machine learning framework and trained end-to-end (Figure 6).”
BackgroundLin, M., Yang, G., & Zhang, H. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3226418 · Cited by 159
“Fortunately, recent advances in deep learning technology [11] have emerged as a promising new solution to the CD problem.”
BackgroundExploring API Embedding for API Usages and Applications
Nguyen, T. D., Nguyen, A. T., Phan, H. D., & Nguyen, T. N. (2017) · 2017 IEEE/ACM 39th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2017.47 · Cited by 159
“First, it has been shown that in the Word2Vec vector space for texts, the nearby vectors are the projected locations of the words that have been used in the similar contexts consisting of similar surrounding words [13].”
BackgroundArtificial intelligence in the water domain: Opportunities for responsible use
Doorn, N. (2021) · Science of The Total Environment · doi:10.1016/j.scitotenv.2020.142561 · Cited by 142
“A special class of ML techniques involves deep learning, which refers to algorithms that use multiple layers to progressively extract higher-level features from raw input; this makes them particularly suitable for learning from unstructured and unlabeled data (Deng and Yu 2013).”
Backpropagation-free training of deep physical neural networks
Momeni, A., Rahmani, B., Malléjac, M., del Hougne, P., & Fleury, R. (2023) · Science · doi:10.1126/science.adi8474 · Cited by 215
Kakogeorgiou, I., & Karantzalos, K. (2021) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2021.102520 · Cited by 158
“Deep neural networks have achieved remarkable success in real-world applications in various engineering fields (Deng and Yu, 2014) as well as in remote sensing (RS) (Ma et al., 2019), (Cheng et al., 2018), (Zhang et al., 2020), (Hamylton et al., 2020).”
BackgroundUnlocking the potential of deep learning for marine ecology: overview, applications, and outlook
Goodwin, M., Halvorsen, K. T., Jiao, L., Knausgård, K. M., Martin, A. H., Moyano, M., Oomen, R. A., Rasmussen, J. H., Sørdalen, T. K., & Thorbjørnsen, S. H. (2022) · ICES Journal of Marine Science · doi:10.1093/icesjms/fsab255 · Cited by 169
Deep learning applications for IoT in health care: A systematic review
Bolhasani, H., Mohseni, M., & Rahmani, A. M. (2021) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2021.100550 · Cited by 156
Efficient Hardware Architectures for Accelerating Deep Neural Networks: Survey
Pudi, D., Boppu, S., Manikandan, M. S., & Cenkeramaddi, L. R. (2022) · IEEE Access · doi:10.1109/access.2022.3229767 · Cited by 180
“Furthermore, the recent applications of DNN include aerospace and defence, automated driving, recommendation systems, and industrial automation [71], [86], [101], [215].”
MethodJia, S., Deng, Y., Lv, J., Du, S., & Xie, Z. (2021) · Measurement · doi:10.1016/j.measurement.2021.110332 · Cited by 155
Kowalek, P., Loch-Olszewska, H., & Szwabiński, J. (2019) · Physical review. E · doi:10.1103/physreve.100.032410 · Cited by 161
Multivariate CNN‐LSTM Model for Multiple Parallel Financial Time‐Series Prediction
Widiputra, H., Mailangkay, A. B. L., & Gautama, E. (2021) · Complexity · doi:10.1155/2021/9903518 · Cited by 181
Grezmak, J. E., Zhang, J., Wang, P. E., Loparo, K. A., & Gao, R. X. (2019) · IEEE Sensors Journal · doi:10.1109/jsen.2019.2958787 · Cited by 166
“Deep Learning (DL), a subset of ML that has demonstrated state-of-the-art pattern recognition and predictive capabilities in several fields [2]–[4], has been extensively investigated as a solution to manufacturing problems.”
BackgroundGjoreski, M., Gradišek, A., Budna, B., Gams, M., & Poglajen, G. (2020) · IEEE Access · doi:10.1109/access.2020.2968900 · Cited by 113
“DL represents a class of ML algorithms that use a cascade of multiple layers of nonlinear processing units [37].”
BackgroundAutomatic physical inference with information maximizing neural networks
Charnock, T., Lavaux, G., & Wandelt, B. D. (2018) · Physical Review D · doi:10.1103/physrevd.97.083004 · Cited by 113
Faraji, M., Nadi, S., Ghaffarpasand, O., Homayoni, S., & Downey, K. (2022) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2022.155324 · Cited by 157
Sigcha, L., Borzì, L., Amato, F., Rechichi, I., Ramos-Romero, C. A., Cardenas, A. J. A., Gascó, L., & Olmo, G. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120541 · Cited by 172
“Although conventional ANN consists of at least three main components, i.e. the input layer, the hidden layer, and the output layer, architectures known as deep neural networks (DNNs) use many more hidden layers to enhance the predictive capabilities of the network (Deng & Yu, 2014).”
BackgroundDeep Learning to Distinguish Recalled but Benign Mammography Images in Breast Cancer Screening
Aboutalib, S., Mohamed, A. A., Berg, W. A., Zuley, M. L., Sumkin, J. H., & Wu, S. (2018) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-18-1115 · Cited by 149
“The most distinguishing strength of the CNN is that it can automatically learn and hierarchically organize features from a large dataset without manual feature engineering (7, 12, 13) and outperformed, in many scenarios, traditional manual-engineered imaging features/descriptors.”
BackgroundExploration of social media for sentiment analysis using deep learning
Chen, L.-C., Lee, C.-M., & Chen, M. (2019) · Soft Computing · doi:10.1007/s00500-019-04402-8 · Cited by 160
“In deep learning, both linear and nonlinear transformations can be carried out through multilayer neural networks to extract the features of data so that the computer can observe, learn, and react to complex scenarios (Deng and Yu 2014; Day and Teng 2017).”
BackgroundSolving Partial Differential Equations Using Deep Learning and Physical Constraints
Guo, Y., Cao, X., Liu, B., & Gao, M. (2020) · Applied Sciences · doi:10.3390/app10175917 · Cited by 169
“In recent years, as a representative of data-driven methods, deep learning methods that are based on deep neural networks have made breakthrough progress [13–15].”
BackgroundZhu, Y., Ouyang, Q., & Mao, Y. (2017) · BMC Bioinformatics · doi:10.1186/s12859-017-1757-y · Cited by 131
Lampropoulos, G., Keramopoulos, E., & Diamantaras, K. (2020) · Visual Informatics · doi:10.1016/j.visinf.2020.01.001 · Cited by 134
Deep learning in robotics: survey on model structures and training strategies
Karoly, A. I., Galambos, P., Kuti, J., & Rudas, I. J. (2021) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2020.3018325 · Cited by 146
“that also perform feature extraction, using multiple hierarchical artificial neural network layers, are referred to as deep learning (DL) [1], [2].”
BackgroundFinancial time series forecasting with deep learning : A systematic literature review: 2005–2019
Sezer, Ö. B., Gudelek, M. U., & Özbayoğlu, A. M. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106181 · Cited by 794
Khare, N., Devan, P., Chowdhary, C. L., Bhattacharya, S., Singh, G., Singh, S., & Yoon, B. (2020) · Electronics · doi:10.3390/electronics9040692 · Cited by 161
“Multiple hidden layers of the feed-forward ANN constitute a deep neural network (DNN) architecture [39].”
BackgroundSpeaker verification with short utterances: a review of challenges, trends and opportunities
Poddar, A., Sahidullah, M., & Saha, G. (2017) · IET Biometrics · doi:10.1049/iet-bmt.2017.0065 · Cited by 160
Neural information retrieval: at the end of the early years
Onal, K. D., Zhang, Y., Altingovde, I. S., Rahman, M. M., Karagoz, P., Braylan, A., Dang, B., Chang, H.-L., Kim, H., McNamara, Q., et al. (2018) · Information Retrieval Journal · doi:10.1007/s10791-017-9321-y · Cited by 136
Okewu, E., Adewole, P., Misra, S., Maskeliūnas, R., & Damaševičius, R. (2021) · Applied Artificial Intelligence · doi:10.1080/08839514.2021.1922847 · Cited by 159
“…al. 2013), (Sak, Senior, and Beaufays 2014b), (Li and Wu 2015), (Zen and Sak 2015), (Deng, Abdel-Hamid, and Yu 2013), (Sainath et al. 2013), (Yu and Deng 2014), (Szegedy and Erhan 2013), (Gers and Schmidhuber 2001), (Sutskever, Vinyals, and Le 2014b), (Mikolov et al. 2010), (Bengio,…”
InfluentialPredictive analytics in education: a comparison of deep learning frameworks
Doleck, T., Lemay, D. J., Basnet, R. B., & Bazelais, P. (2019) · Education and Information Technologies · doi:10.1007/s10639-019-10068-4 · Cited by 163
“There are two key aspects of deep learning: “ (1) models consisting of multiple layers or stages of nonlinear information processing; and (2) methods for supervised or unsupervised learning of feature representation at successively higher, more abstract layers ” (Deng and Yu 2014, p. 201).”
MethodTaormina, R., & Galelli, S. (2018) · Journal of Water Resources Planning and Management · doi:10.1061/(asce)wr.1943-5452.0000983 · Cited by 132
Differential Privacy Preservation in Deep Learning: Challenges, Opportunities and Solutions
Zhao, J., Chen, Y., & Zhang, W. (2019) · IEEE Access · doi:10.1109/access.2019.2909559 · Cited by 134
“Relying on its capabilities of multi-level representation and abstraction, deep learning can understand data, such as images, sounds, texts and others [1], and its applications are being expanded into various areas, such as social network analysis [2], internet of things [3], [4], bioinformatics [5], wireless communic…”
BackgroundA systematic review on Deep Learning approaches for IoT security
Aversano, L., Bernardi, M. L., Cimitile, M., & Pecori, R. (2021) · Computer Science Review · doi:10.1016/j.cosrev.2021.100389 · Cited by 164
Deep power: Deep learning architectures for power quality disturbances classification
Mohan, N., Soman, K. P., & Vinayakumar, R. (2017) · International Conference on Technological Advancements in Power and Energy (TAP Energy) · doi:10.1109/tapenergy.2017.8397249 · Cited by 151
“shift to deep learning techniques from conventional AI techniques [15], [16].”
BackgroundMethodMulti-Modality Medical Image Fusion Using Convolutional Neural Network and Contrast Pyramid
Wang, K., Zheng, M., Wei, H., Qi, G., & Li, Y. (2020) · Sensors · doi:10.3390/s20082169 · Cited by 152
Alzughaibi, S. A., & Khediri, S. E. (2023) · Applied Sciences · doi:10.3390/app13042276 · Cited by 142
Deep learning for sentiment analysis
Rojas‐Barahona, L. M. (2016) · Language and Linguistics Compass · doi:10.1111/lnc3.12228 · Cited by 130
“It also involves analyzing implicatures or effects (Deng &Wiebe 2014) and determining aspects of the target that people like or dislike (Jo & Oh 2011).”
Ma, X., Chen, Z., Chen, W., Li, Z., Chi, Y., Han, C., & Li, S. (2020) · IEEE Access · doi:10.1109/access.2020.2994100 · Cited by 134
“From [61] we know that DNN based method well fits the functional relationship when the training samples of the data sets is sufficient enough.”
MethodHierarchical deep-learning neural networks: finite elements and beyond
Zhang, L., Cheng, L., Li, H., Gao, J., Yu, C., Domel, R., Yang, Y., Tang, S., & Liu, W. K. (2020) · Computational Mechanics · doi:10.1007/s00466-020-01928-9 · Cited by 141
A Comprehensive Survey on the Detection, Classification, and Challenges of Neurological Disorders
Lima, A. A., Mridha, M. F., Das, S. C., Kabir, M. M., Islam, M. R., & Watanobe, Y. (2022) · Biology · doi:10.3390/biology11030469 · Cited by 162
“Deep learning (DL) is a more advanced tool for machine learning (ML) systems, which is a subset of artificial intelligence (AI) in the computer science field [242].”
DeepGene: an advanced cancer type classifier based on deep learning and somatic point mutations
Yuan, Y., Shi, Y., Li, C., Kim, J., Cai, W., Han, Z., & Feng, D. D. (2016) · BMC Bioinformatics · doi:10.1186/s12859-016-1334-9 · Cited by 137
“DNN is a type of artificial neural network that aims to model abstracted high-level data features using multiple nonlinear and complex processing layers, and provides feedback via back-propagation [31].”
BackgroundRadiogenomic Analysis of Oncological Data: A Technical Survey
Incoronato, M., Aiello, M., Infante, T., Cavaliere, C., Grimaldi, A., Mirabelli, P., Monti, S., & Salvatore, M. (2017) · International Journal of Molecular Sciences · doi:10.3390/ijms18040805 · Cited by 149
A systematic review on deep learning architectures and applications
Khamparia, A., & Singh, K. M. (2019) · Expert Systems · doi:10.1111/exsy.12400 · Cited by 127
“The output of current layer will be used as the input to the next layer (Bengio, 2012a, 2012b; Deng, 2014).”
MethodTawhid, M. N. A., Siuly, S., Wang, H., Whittaker, F., Wang, K., & Zhang, Y. (2021) · PLoS ONE · doi:10.1371/journal.pone.0253094 · Cited by 148
“For the DL based classification, CNN model is used as it is the best DL model to deal with image related problems [37, 38].”
MethodTahir, G. A., & Loo, C. K. (2021) · Healthcare · doi:10.3390/healthcare9121676 · Cited by 115
“Moreover, in contrast to conventional methods, deep learning techniques show outstanding performance while processing large datasets and have excellent classification potential [93,94].”
ResultVerSA: Verifiable Secure Aggregation for Cross-Device Federated Learning
Hahn, C., Kim, H.-D., Kim, M., & Hur, J. (2021) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2021.3126323 · Cited by 156
“W ITH the explosive growth in data, neural networks have demonstrated promise and usefulness in solving real-world problems in diverse domains, such as computer vision and speech recognition [1], [2], [3].”
BackgroundDeep Learning: A ReviewPreprint
Vargas, R., Mosavi, A. H., & Ruiz, R. (2018) · Preprints.org · doi:10.20944/preprints201810.0218.v1 · Cited by 163
“In the field of natural language processing, deep learning methods have been applied for image caption generation [20], and handwriting generation [6].”
BackgroundA Survey of Machine Learning Approaches and Techniques for Student Dropout Prediction
Mduma, N., Kalegele, K., & Machuve, D. Z. (2019) · Data Science Journal · doi:10.5334/dsj-2019-014 · Cited by 136
“Deep Neural Network and Probabilistic Graphical Model Deep neural network (DNN) is an approach based on Artificial Neural Networks (ANN) with multiple hidden layers between the input and output layers [65].”
MethodWu, S., Wang, Z., Du, Z., Huang, B., Zhang, F., & Liu, R. (2020) · International Journal of Geographical Information Systems · doi:10.1080/13658816.2020.1775836 · Cited by 135
An intelligent and efficient network intrusion detection system using deep learning
Qazi, E.-U.-H., Imran, M. A., Haider, N., Shoaib, M., & Razzak, I. (2022) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2022.107764 · Cited by 135
Objective Classes for Micro-Facial Expression Recognition
Davison, A. K., Merghani, W., & Yap, M. H. (2018) · Journal of Imaging · doi:10.3390/jimaging4100119 · Cited by 143
DeepDrug3D: Classification of ligand-binding pockets in proteins with a convolutional neural network
Pu, L., Govindaraj, R. G., Lemoine, J. M., Wu, H.-C., & Brylinski, M. (2019) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006718 · Cited by 133
“Deep learning provides the-state-of-the art performance in computer vision [39], natural language processing [40], and other research areas [41, 42].”
BackgroundIntelligent simultaneous fault diagnosis for solid oxide fuel cell system based on deep learning
Zhang, Z., Li, S., Xiao, Y., & Yang, Y. (2018) · Applied Energy · doi:10.1016/j.apenergy.2018.10.113 · Cited by 137
Li, K., Duan, H., Liu, L., Qiu, R., van den Akker, B., Ni, B., Chen, T., Yin, H., Yuan, Z., & Ye, L. (2022) · Environmental Science & Technology · doi:10.1021/acs.est.1c05020 · Cited by 138
Machine learning applications for electrospun nanofibers: a review
Subeshan, B., Atayo, A., & Asmatulu, E. (2024) · Journal of Materials Science · doi:10.1007/s10853-024-09994-7 · Cited by 140
“To surmount these intricacies, a systematic approach involving the incorporation of encrypted expressions denoted as “if and else” statements was introduced into the computational framework [114].”
Which Artificial Intelligence Algorithm Better Predicts the Chinese Stock Market?
Chen, L., Qiao, Z., Wang, M., Wang, C., Du, R., & Stanley, H. E. (2018) · IEEE Access · doi:10.1109/access.2018.2859809 · Cited by 124
“Previous studies indicate that DL more efficiently solves nonlinear problems than traditional methods [19]–[21].”
BackgroundJiang, S., Li, H., & Jin, Z. J. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2021.3052044 · Cited by 140
“In the last decade, the rapid development of deep learning techniques has made valuable achievements in various computer vision and pattern recognition applications [30]–[33].”
BackgroundNetwork anomaly detection using deep learning techniques
Hooshmand, M. K., & Hosahalli, D. (2022) · CAAI Transactions on Intelligence Technology · doi:10.1049/cit2.12078 · Cited by 147
CR-Unet: A Composite Network for Ovary and Follicle Segmentation in Ultrasound Images
Li, H., Fang, J., Liu, S., Liang, X., Yang, X., Mai, Z., Manh, V., Wang, T., Chen, Z., & Ni, D. (2019) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2019.2946092 · Cited by 142
“Applications of deep learning have also involved into various tasks, such as computer vision [23], natural language processing [24], speech recognition [25] and medical image analysis [26]–[28].”
Background
Metadata
- Authors
- Deng, L., & Yu, D.
- Affiliations
- Microsoft (United States) (US)
- Venue
- Foundations and Trends® in Signal Processing
- Publisher
- Emerald
- Published
- 2014-06-30
- Volume
- 7
- Issue
- 3-4
- Pages
- 197-387
- ISSN
- 1932-8346 (ISSN-L)
- 1932-8354
- OpenAlex
- W4205947740
- Cited by
- 3,480
- References
- 21
- Citations by year
- 2026: 113 · 2025: 206 · 2024: 298 · 2023: 410 · 2022: 469 · 2021: 453 · 2020: 404 · 2019: 426 · 2018: 304 · 2017: 188 · 2016: 146 · 2015: 57 · 2014: 3
- FWCI
- 117.48
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Foundations and Trends® in Signal Processing (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- deep learning, signal processing, information processing, speech recognition, computer vision, natural language processing, text processing, information retrieval, multimodal information processing, multi-task learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.