The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Understanding of Machine Learning with Deep Learning: Architectures, Workflow, Applications and Future Directions
Open accessAbstract
In recent years, deep learning (DL) has been the most popular computational approach in the field of machine learning (ML), achieving exceptional results on a variety of complex cognitive tasks, matching or even surpassing human performance. Deep learning technology, which grew out of artificial neural networks (ANN), has become a big deal in computing because it can learn from data. The ability to learn enormous volumes of data is one of the benefits of deep learning. In the past few years, the field of deep learning has grown quickly, and it has been used successfully in a wide range of traditional fields. In numerous disciplines, including cybersecurity, natural language processing, bioinformatics, robotics and control, and medical information processing, deep learning has outperformed well-known machine learning approaches. In order to provide a more ideal starting point from which to create a comprehensive understanding of deep learning, also, this article aims to provide a more detailed overview of the most significant facets of deep learning, including the most current developments in the field. Moreover, this paper discusses the significance of deep learning and the various deep learning techniques and networks. Additionally, it provides an overview of real-world application areas where deep learning techniques can be utilised. We conclude by identifying possible characteristics for future generations of deep learning modelling and providing research suggestions. On the same hand, this article intends to provide a comprehensive overview of deep learning modelling that can serve as a resource for academics and industry people alike. Lastly, we provide additional issues and recommended solutions to assist researchers in comprehending the existing research gaps. Various approaches, deep learning architectures, strategies, and applications are discussed in this work.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Generative adversarial networks
Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2020) · Communications of the ACM · doi:10.1145/3422622 · Cited by 18,384
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Gulshan, V., Peng, L., Coram, M., Stumpe, M. C., Wu, D., Narayanaswamy, A., Venugopalan, S., Widner, K., Madams, T., Cuadros, J., et al. (2016) · JAMA · doi:10.1001/jama.2016.17216 · Cited by 7,697
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 6,938
Neural Collaborative Filtering
He, X., Liao, L., Zhang, H., Nie, L., Hu, X., & Chua, T.-S. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052569 · Cited by 6,652
How transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061
Shin, H.-C., Roth, H. R., Gao, M., Lu, L., Xu, Z., Nogues, I., Yao, J., Mollura, D., & Summers, R. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2528162 · Cited by 5,759 · cited 2×
“The most frequent activation function, the logic sigmoid function, is Interactions between these levels guarantee task domain regularities [19,48]. to summarise The most frequent activation function, the logic sigmoid function, is used to summarise the backpropagation procedure. σ ( α ) = 1 1 (1)…”
BackgroundMethodMachine learning: Algorithms, real-world applications and research directions
Sarker, I. H. (2021) · SN Computer Science · doi:10.1007/s42979-021-00592-x · Cited by 5,583 · cited 4×
“Interactions between these levels guarantee task domain regularities [18,47].”
BackgroundMethodInfluentialA Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects
Li, Z., Liu, F., Yang, W., Peng, S., & Zhou, J. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3084827 · Cited by 5,273 · cited 2×
“12 , 91 The application of neural network-based DL technology is widespread across many industries and areas of study, including healthcare, sentiment analysis, NLP, the id of images, BI, cybersecurity, and many more [45,52,53].”
BackgroundMethodDeep Reinforcement Learning: A Brief Survey
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2743240 · Cited by 4,733
A Brief Survey of Deep Reinforcement Learning
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · arXiv · doi:10.48550/arxiv.1708.05866 · Cited by 4,733
Deep Learning: Methods and Applications
Deng, L., & Yu, D. (2014) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000039 · Cited by 3,480
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Machine learning and deep learning
Janiesch, C., Zschech, P., & Heinrich, K. (2021) · Electronic Markets · doi:10.1007/s12525-021-00475-2 · Cited by 2,959
Predicting the sequence specificities of DNA- and RNA-binding proteins by deep learning
Alipanahi, B., Delong, A., Weirauch, M. T., & Frey, B. J. (2015) · Nature Biotechnology · doi:10.1038/nbt.3300 · Cited by 2,873
Sarker, I. H. (2021) · SN Computer Science · doi:10.1007/s42979-021-00815-1 · Cited by 2,678
Deep learning applications and challenges in big data analytics
Najafabadi, M. M., Villanustre, F., Khoshgoftaar, T. M., Seliya, N., Wald, R., & Muharemagic, E. (2015) · Journal of Big Data · doi:10.1186/s40537-014-0007-7 · Cited by 2,594
Restricted Boltzmann machines for collaborative filtering
Salakhutdinov, R., Mnih, A., & Hinton, G. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273596 · Cited by 1,885
Review of Deep Learning Algorithms and Architectures
Shrestha, A., & Mahmood, A. (2019) · IEEE Access · doi:10.1109/access.2019.2912200 · Cited by 1,883 · cited 2×
“…rules to function; rather, it leverages a massive amount of data to map the provided input to particular labels. is created utilising multiple layers of algorithms (arti fi cial neural networks, or ANNs), each of which delivers a unique interpretation of the data provided to it [25,26].”
BackgroundReynolds, D. (2009) · Encyclopedia of Biometrics · doi:10.1007/978-0-387-73003-5_196 · Cited by 1,875
Deep Learning on Graphs: A Survey
Zhang, Z., Cui, P., & Zhu, W. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.2981333 · Cited by 1,633
AutoRec: Autoencoders Meet Collaborative Filtering
Sedhain, S., Menon, A. K., Sanner, S., & Xie, L. (2015) · Proceedings of the 24th International Conference on World Wide Web · doi:10.1145/2740908.2742726 · Cited by 1,175
Deep Machine Learning - A New Frontier in Artificial Intelligence Research [Research Frontier]
Arel, I., Rose, D. C., & Karnowski, T. P. (2010) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2010.938364 · Cited by 1,121
Deep Residual Learning for Image Recognition: A Survey
Shafiq, M., & Gu, Z. (2022) · Applied Sciences · doi:10.3390/app12188972 · Cited by 1,023
Supervised Machine Learning Algorithms: Classification and Comparison
Babcock University, F.Y, O., J.E.T, A., O, A., J. O, H., O, O., & J, A. (2017) · International Journal of Computer Trends and Technology · doi:10.14445/22312803/ijctt-v48p126 · Cited by 932
Machine Learning in Agriculture: A Comprehensive Updated Review
Benos, L., Tagarakis, A. C., Dolias, G., Berruto, R., Kateris, D., & Bochtis, D. (2021) · Sensors · doi:10.3390/s21113758 · Cited by 900
Hinton, G. (2009) · Scholarpedia · doi:10.4249/scholarpedia.5947 · Cited by 885
A tutorial survey of architectures, algorithms, and applications for deep learning
Deng, L. (2014) · APSIPA Transactions on Signal and Information Processing · doi:10.1017/atsip.2013.9 · Cited by 725
An overview of the supervised machine learning methods
Nasteski, V. (2017) · HORIZONS.B · doi:10.20544/horizons.b.04.1.17.p05 · Cited by 712
Applications of Deep Learning in Biomedicine
Mamoshina, P., Vieira, A., Lane, E., & Zhavoronkov, A. (2016) · Molecular Pharmaceutics · doi:10.1021/acs.molpharmaceut.5b00982 · Cited by 701
Taye, M. M. (2023) · Computation · doi:10.3390/computation11030052 · Cited by 629
Self-citationDeep Feature Learning for Knee Cartilage Segmentation Using a Triplanar Convolutional Neural Network
Prasoon, A., Petersen, K., Igel, C., Lauze, F., Dam, E., & Nielsen, M. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40763-5_31 · Cited by 582
Early diagnosis of Alzheimer's disease with deep learning
Liu, S., Liu, S., Cai, W., Pujol, S., Kikinis, R., & Feng, D. (2014) · 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2014.6868045 · Cited by 523
An Introduction to Machine Learning
Kubat, M. (2017) · doi:10.1007/978-3-319-63913-0 · Cited by 445
Deep Learning Techniques: An Overview
Mathew, A., Amudha, P., & Sivakumari, S. (2021) · Advances in Intelligent Systems and Computing · doi:10.1007/978-981-15-3383-9_54 · Cited by 379
Optimization problems for machine learning: A survey
Gambella, C., Ghaddar, B., & Naoum-Sawaya, J. (2021) · European Journal of Operational Research · doi:10.1016/j.ejor.2020.08.045 · Cited by 365
Review of tool condition monitoring in machining and opportunities for deep learning
Serin, G., Sener, B., Ozbayoglu, A. M., & Unver, H. O. (2020) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-020-05449-w · Cited by 360
Can Deep Learning Revolutionize Mobile Sensing?
Lane, N. D., & Georgiev, P. (2015) · Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications · doi:10.1145/2699343.2699349 · Cited by 282
Deep learning in finance and banking: A literature review and classification
Huang, J., Chai, J., & Cho, S. (2020) · Frontiers of Business Research in China · doi:10.1186/s11782-020-00082-6 · Cited by 248
Coooolll: A Deep Learning System for Twitter Sentiment Classification
Tang, D., Wei, F., Qin, B., Liu, T., & Zhou, M. (2014) · Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014) · doi:10.3115/v1/s14-2033 · Cited by 243
Deep Convolutional Neural Networks for pedestrian detection
Tomè, D., Monti, F., Baroffio, L., Bondi, L., Tagliasacchi, M., & Tubaro, S. (2016) · Signal Processing: Image Communication · doi:10.1016/j.image.2016.05.007 · Cited by 225
Manifold Learning of Brain MRIs by Deep Learning
Initiative, F. T. A. D. N., Brosch, T., & Tam, R. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40763-5_78 · Cited by 221
Neural Networks and Statistical Learning
Du, K.-L., & Swamy, M. N. S. (2019) · Springer eBooks · doi:10.1007/978-1-4471-7452-3 · Cited by 212
Machine learning for structural health monitoring: challenges and opportunities
Yuan, F.-G., Zargar, S. A., Chen, Q., & Wang, S. (2020) · Sensors and Smart Structures Technologies for Civil, Mechanical, and Aerospace Systems 2020 · doi:10.1117/12.2561610 · Cited by 207
What Does ChatGPT Say: The DAO from Algorithmic Intelligence to Linguistic Intelligence
Wang, F.-Y., Miao, Q., Li, X., Wang, X., & Lin, Y. (2023) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2023.123486 · Cited by 205
Variational Autoencoder for Semi-Supervised Text Classification
Xu, W., Sun, H., Deng, C., & Tan, Y. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10966 · Cited by 183
A Smart Dental Health-IoT Platform Based on Intelligent Hardware, Deep Learning, and Mobile Terminal
Liu, L., Xu, J., Huan, Y., Zou, Z., Yeh, S.-C., & Zheng, L.-R. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2019.2919916 · Cited by 170
Hybrid Deep Neural Network--Hidden Markov Model (DNN-HMM) Based Speech Emotion Recognition
Li, L., Zhao, Y., Jiang, D., Zhang, Y., Wang, F., Gonzalez, I., Valentin, E., & Sahli, H. (2013) · 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction · doi:10.1109/acii.2013.58 · Cited by 163
A GPU deep learning metaheuristic based model for time series forecasting
Coelho, I. M., Coelho, V. N., Luz, E. J. D. S., Ochi, L. S., Guimarães, F. G., & Rios, E. (2017) · Applied Energy · doi:10.1016/j.apenergy.2017.01.003 · Cited by 132
Deep Learning for Natural Language Processing
Goyal, P., Pandey, S. K., & Jain, K. (2018) · Apress eBooks · doi:10.1007/978-1-4842-3685-7 · Cited by 121
Continuous Space Translation Models for Phrase-Based Statistical Machine Translation
Schwenk, H. (2025) · doi:10.57702/tyvla89t · Cited by 111
Supervised Determined Source Separation with Multichannel Variational Autoencoder
Kameoka, H., Li, L., Inoue, S., & Makino, S. (2019) · Neural Computation · doi:10.1162/neco_a_01217 · Cited by 95
Deep Learning of Image Features from Unlabeled Data for Multiple Sclerosis Lesion Segmentation
Yoo, Y., Brosch, T., Traboulsee, A. L., Li, D. K. B., & Tam, R. C. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10581-9_15 · Cited by 61
Naeem, M., Paragliola, G., & Coronato, A. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114285 · Cited by 48
Deep Learning for Mobile Mental Health: Challenges and recent advances
Han, J., Zhang, Z., Mascolo, C., André, E., Tao, J., Zhao, Z., & Schuller, B. W. (2021) · IEEE Signal Processing Magazine · doi:10.1109/msp.2021.3099293 · Cited by 42
ETHICAL FRAMEWORK FOR MACHINE LEARNING
Malhotra, C., Kotwal, V., & Dalal, S. (2018) · ITU Kaleidoscope Academic Conference (ITU K) · doi:10.23919/itu-wt.2018.8597767 · Cited by 35
Singh, P. K., & Manure, A. (2019) · Apress eBooks · doi:10.1007/978-1-4842-5558-2 · Cited by 34
Multi-spectral Imaging for Robust Ocular Biometrics
Vetrekar, N., Raja, K. B., Ramachandra, R., Gad, R. S., & Busch, C. (2018) · International Conference on Biometrics · doi:10.1109/icb2018.2018.00038 · Cited by 15
Lin, M. S., Tang, C. G. Y., Kom, X. J., Eyu, J. Y., & Xu, C. (2022) · IEEE International Conference on Industrial Engineering and Engineering Management (IEEM) · doi:10.1109/ieem55944.2022.9989801 · Cited by 6
Estonilo, C. G., & Festijo, E. D. (2022) · IEEE Annual Computing and Communication Workshop and Conference (CCWC) · doi:10.1109/ccwc54503.2022.9720892 · Cited by 3
Machine Learning: An Ethical, Social & Political Perspective
Mageswaran, G., Nagappan, S. D., Hamzah, N., & Brohi, S. N. (2018) · International Conference on Advances in Computing, Communication & Automation (ICACCA) · doi:10.1109/icaccaf.2018.8776702 · Cited by 2
Cited by
Recurrent Neural Networks: A Comprehensive Review of Architectures, Variants, and Applications
Mienye, I. D., Swart, T. G., & Obaido, G. (2024) · Information · doi:10.3390/info15090517 · Cited by 732
Attention is all you need: utilizing attention in AI-enabled drug discovery
Zhang, Y., Liu, C., Liu, M., Liu, T., Lin, H., Huang, C.-B., & Ning, L. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbad467 · Cited by 377
Fahim, Y. A., Hasani, I. W., Kabba, S., & Ragab, W. M. (2025) · European Journal of Medical Research · doi:10.1186/s40001-025-03196-w · Cited by 329
Visan, A. I., & Negut, I. (2024) · Life · doi:10.3390/life14020233 · Cited by 279
Theodore Armand, T. P., Nfor, K. A., Kim, J.-I., & Kim, H.-C. (2024) · Nutrients · doi:10.3390/nu16071073 · Cited by 253
Metadata
- Authors
- Taye, M. M.
- Venue
- Computers
- Publisher
- MDPI AG
- Published
- 2023-04-25
- Volume
- 12
- Issue
- 5
- Pages
- 91
- ISSN
- 2073-431X (ISSN-L)
- OpenAlex
- W4366988472
- Cited by
- 1,057
- References
- 69
- FWCI
- 92.86
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.