The DOI matches its Crossref record; 180 of the 180 references it cites were found in a registry or an index.
A Comprehensive Review of Deep Learning: Architectures, Recent Advances, and Applications
Open accessAbstract
Deep learning (DL) has become a core component of modern artificial intelligence (AI), driving significant advancements across diverse fields by facilitating the analysis of complex systems, from protein folding in biology to molecular discovery in chemistry and particle interactions in physics. However, the field of deep learning is constantly evolving, with recent innovations in both architectures and applications. Therefore, this paper provides a comprehensive review of recent DL advances, covering the evolution and applications of foundational models like convolutional neural networks (CNNs) and Recurrent Neural Networks (RNNs), as well as recent architectures such as transformers, generative adversarial networks (GANs), capsule networks, and graph neural networks (GNNs). Additionally, the paper discusses novel training techniques, including self-supervised learning, federated learning, and deep reinforcement learning, which further enhance the capabilities of deep learning models. By synthesizing recent developments and identifying current challenges, this paper provides insights into the state of the art and future directions of DL research, offering valuable guidance for both researchers and industry experts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.324 · Cited by 30,581
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Multilayer feedforward networks are universal approximators
Hornik, K., Stinchcombe, M., & White, H. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90020-8 · Cited by 21,728
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891
A Comprehensive Survey on Graph Neural Networks
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., & Yu, P. S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2978386 · Cited by 11,000
Bidirectional recurrent neural networks
Schuster, M., & Paliwal, K. K. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.650093 · Cited by 10,172 · cited 1×
“The outputs of these two layers are then combined, often by concatenation, to form the final output [59].”
Review of deep learning: concepts, CNN architectures, challenges, applications, future directions
Alzubaidi, L., Zhang, J., Humaidi, A. J., Al-Dujaili, A., Duan, Y., Al-Shamma, O., Santamaría, J., Fadhel, M. A., Al-Amidie, M., & Farhan, L. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00444-8 · Cited by 7,906
Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Network
Sherstinsky, A. (2020) · Physica D: Nonlinear Phenomena · doi:10.1016/j.physd.2019.132306 · Cited by 5,680
Object Detection With Deep Learning: A Review
Zhao, Z.-Q., Zheng, P., Xu, S.-T., & Wu, X. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2876865 · Cited by 5,545
(1999) · Cited by 5,147
Deep learning in agriculture: A survey
Kamilaris, A., & Prenafeta-Boldú, F. X. (2018) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2018.02.016 · Cited by 5,133
Prototypical Networks for Few-shot Learning
Snell, J., Swersky, K., & Zemel, R. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.05175 · Cited by 4,755
Deep Reinforcement Learning: A Brief Survey
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2743240 · Cited by 4,733
A Brief Survey of Deep Reinforcement Learning
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · arXiv · doi:10.48550/arxiv.1708.05866 · Cited by 4,733
Han (2023) · doi:10.1109/tpami.2022.3152247 · Cited by 4,682
Exploring Simple Siamese Representation Learning
Chen, X., & He, K. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01549 · Cited by 3,725
Deep learning models for plant disease detection and diagnosis
Ferentinos, K. P. (2018) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2018.01.009 · Cited by 3,390
Improved protein structure prediction using potentials from deep learning
Senior, A. W., Evans, R., Jumper, J., Kirkpatrick, J., Sifre, L., Green, T., Qin, C., Žídek, A., Nelson, A. W. R., Bridgland, A., et al. (2020) · Nature · doi:10.1038/s41586-019-1923-7 · Cited by 3,378
International evaluation of an AI system for breast cancer screening
McKinney, S. M., Sieniek, M., Godbole, V., Godwin, J., Antropova, N., Ashrafian, H., Back, T., Chesus, M., Corrado, G. S., Darzi, A., et al. (2020) · Nature · doi:10.1038/s41586-019-1799-6 · Cited by 3,287
DARTS: Differentiable architecture search
Liu, H., Simonyan, K., & Yang, Y. (2018) · arXiv · doi:10.48550/arxiv.1806.09055 · Cited by 3,248
Machine learning and deep learning
Janiesch, C., Zschech, P., & Heinrich, K. (2021) · Electronic Markets · doi:10.1007/s12525-021-00475-2 · Cited by 2,959
Federated Learning in Mobile Edge Networks: A Comprehensive Survey
Lim, W. Y. B., Luong, N. C., Hoang, D. T., Jiao, Y., Liang, Y.-C., Yang, Q., Niyato, D., & Miao, C. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2986024 · Cited by 2,565
A Deep Learning Approach to Antibiotic Discovery
Stokes, J. M., Yang, K., Swanson, K., Jin, W., Cubillos-Ruiz, A., Donghia, N. M., MacNair, C. R., French, S., Carfrae, L. A., Bloom-Ackermann, Z., et al. (2020) · Cell · doi:10.1016/j.cell.2020.01.021 · Cited by 2,463
Deep Speech 2: End-to-End Speech Recognition in English and Mandarin
Amodei, D., Anubhai, R., Battenberg, E., Case, C. T., Casper, J., Catanzaro, B., Chen, J., Chrzanowski, M., Coates, A., Diamos, G., et al. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.02595 · Cited by 2,110
Neural ordinary differential equations
Chen, R. T. Q., Rubanova, Y., Bettencourt, J., & Duvenaud, D. (2018) · arXiv · doi:10.48550/arxiv.1806.07366 · Cited by 2,097
Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labels
Zhang, Z., & Sabuncu, M. R. (2018) · arXiv · doi:10.48550/arxiv.1805.07836 · Cited by 1,907 · cited 3×
“Loss functions guide the optimization process by indicating how the model parameters should be adjusted to minimize errors and improve predictive accuracy [40].”
A survey on federated learning
Zhang, C., Xie, Y., Bai, H., Yu, B., Li, W., & Gao, Y. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106775 · Cited by 1,899
Flamingo: a Visual Language Model for Few-Shot Learning
Alayrac, J.-B., Donahue, J., Luc, P., Miech, A., Barr, I., Hasson, Y., Lenc, K., Mensch, A., Millican, K., Reynolds, M., et al. (2022) · arXiv · doi:10.48550/arxiv.2204.14198 · Cited by 1,555
(2018) · International Conference on Machine Learning · Cited by 1,465
Feng, D., Haase-Schutz, C., Rosenbaum, L., Hertlein, H., Glaser, C., Timm, F., Wiesbeck, W., & Dietmayer, K. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.2972974 · Cited by 1,425
Improved Adam Optimizer for Deep Neural Networks
Zhang, Z. (2018) · 2018 IEEE/ACM 26th International Symposium on Quality of Service (IWQoS) · doi:10.1109/iwqos.2018.8624183 · Cited by 1,400
Effective gene expression prediction from sequence by integrating long-range interactions
Avsec, Ž., Agarwal, V., Visentin, D., Ledsam, J. R., Grabska-Barwinska, A., Taylor, K. R., Assael, Y., Jumper, J., Kohli, P., & Kelley, D. R. (2021) · Nature Methods · doi:10.1038/s41592-021-01252-x · Cited by 1,326
Meta-Transfer Learning for Few-Shot Learning
Sun, Q., Liu, Y., Chua, T.-S., & Schiele, B. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00049 · Cited by 1,264
Sarker, I. H. (2022) · SN Computer Science · doi:10.1007/s42979-022-01043-x · Cited by 1,208
ACTIVATION FUNCTIONS IN NEURAL NETWORKS
Sharma, S., Sharma, S., & Athaiya, A. (2020) · International Journal of Engineering Applied Sciences and Technology · doi:10.33564/ijeast.2020.v04i12.054 · Cited by 1,197
Video-based AI for beat-to-beat assessment of cardiac function
Ouyang, D., He, B., Ghorbani, A., Yuan, N., Ebinger, J., Langlotz, C. P., Heidenreich, P. A., Harrington, R. A., Liang, D. H., Ashley, E. A., et al. (2020) · Nature · doi:10.1038/s41586-020-2145-8 · Cited by 1,153 · cited 1×
“A study by Ouyang et al. [126] utilized a video-based deep learning model to evaluate cardiac function through echocardiograms.”
Deep Learning for Household Load Forecasting—A Novel Pooling Deep RNN
Shi, H., Xu, M., & Li, R. (2018) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2017.2686012 · Cited by 1,102
ProtGPT2 is a deep unsupervised language model for protein design
Ferruz, N., Schmidt, S., & Höcker, B. (2022) · Nature Communications · doi:10.1038/s41467-022-32007-7 · Cited by 795
Recurrent Neural Networks: A Comprehensive Review of Architectures, Variants, and Applications
Mienye, I. D., Swart, T. G., & Obaido, G. (2024) · Information · doi:10.3390/info15090517 · Cited by 732
Self-citationBengio, Y., Lecun, Y., & Hinton, G. (2021) · Communications of the ACM · doi:10.1145/3448250 · Cited by 661
Taye, M. M. (2023) · Computation · doi:10.3390/computation11030052 · Cited by 629
Khemani, B., Patil, S., Kotecha, K., & Tanwar, S. (2024) · Journal of Big Data · doi:10.1186/s40537-023-00876-4 · Cited by 612
Yenduri, G., Ramalingam, M., Selvi, G. C., Supriya, Y., Srivastava, G., Maddikunta, P. K. R., Raj, G. D., Jhaveri, R. H., Prabadevi, B., Wang, W., et al. (2024) · IEEE Access · doi:10.1109/access.2024.3389497 · Cited by 596
Autoencoders and their applications in machine learning: a survey
Berahmand, K., Daneshfar, F., Salehi, E. S., Li, Y., & Xu, Y. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-023-10662-6 · Cited by 593
A review of object detection based on deep learning
Xiao, Y., Tian, Z., Yu, J., Zhang, Y., Liu, S., Du, S., & Lan, X. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-08976-6 · Cited by 584
A Survey on Self-Supervised Learning: Algorithms, Applications, and Future Trends
Gui, J., Chen, T., Zhang, J., Cao, Q., Sun, Z., Luo, H., & Tao, D. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3415112 · Cited by 552
Predicting drug response and synergy using a deep learning model of human cancer cells
Kuenzi, B. M., Park, J., Fong, S. H., Sanchez, K. S., Lee, J., Kreisberg, J. F., Ma, J., & Ideker, T. (2020) · Cancer Cell · doi:10.1016/j.ccell.2020.09.014 · Cited by 544
Deep learning, reinforcement learning, and world models
Matsuo, Y., LeCun, Y., Sahani, M., Precup, D., Silver, D., Sugiyama, M., Uchibe, E., & Morimoto, J. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.03.037 · Cited by 543
The Marginal Value of Adaptive Gradient Methods in Machine Learning
Wilson, A., Roelofs, R., Stern, M., Srebro, N., & Recht, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.08292 · Cited by 522
Deep Reinforcement Learning for Smart Home Energy Management
Yu, L., Xie, W., Xie, D., Zou, Y., Zhang, D., Sun, Z., Zhang, L., Zhang, Y., & Jiang, T. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2957289 · Cited by 471
Zheng, Y.-Y., Kong, J.-L., Jin, X.-B., Wang, X.-Y., Su, T.-L., & Zuo, M. (2019) · Sensors · doi:10.3390/s19051058 · Cited by 462
Schwaller, P., Petraglia, R., Zullo, V., Nair, V. H., Haeuselmann, R. A., Pisoni, R., Bekas, C., Iuliano, A., & Laino, T. (2020) · Chemical Science · doi:10.1039/c9sc05704h · Cited by 403
Deep learning in drug discovery: an integrative review and future challenges
Askr, H., Elgeldawi, E., Aboul Ella, H., Elshaier, Y. A. M. M., Gomaa, M. M., & Hassanien, A. E. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10306-1 · Cited by 390
Bengesi, S., El-Sayed, H., Sarker, M. K., Houkpati, Y., Irungu, J., & Oladunni, T. (2024) · IEEE Access · doi:10.1109/access.2024.3397775 · Cited by 362
Content‐Based Image Retrieval and Feature Extraction: A Comprehensive Review
Latif, A., Rasheed, A., Sajid, U., Ahmed, J., Ali, N., Ratyal, N. I., Zafar, B., Dar, S. H., Sajid, M., & Khalil, T. (2019) · Mathematical Problems in Engineering · doi:10.1155/2019/9658350 · Cited by 347
Chemformer: a pre-trained transformer for computational chemistry
Irwin, R., Dimitriadis, S., He, J., & Bjerrum, E. J. (2022) · Machine Learning: Science and Technology · doi:10.1088/2632-2153/ac3ffb · Cited by 343
A Neural Network Ensemble With Feature Engineering for Improved Credit Card Fraud Detection
Esenogho, E., Mienye, I. D., Swart, T. G., Aruleba, K., & Obaido, G. (2022) · IEEE Access · doi:10.1109/access.2022.3148298 · Cited by 332
Self-citationA Survey of Incentive Mechanism Design for Federated Learning
Zhan, Y., Zhang, J., Hong, Z., Wu, L., Li, P., & Guo, S. (2021) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2021.3063517 · Cited by 284
Comparative Study of Convolution Neural Network’s Relu and Leaky-Relu Activation Functions
Dubey, A. K., & Jain, V. (2019) · Lecture Notes in Electrical Engineering · doi:10.1007/978-981-13-6772-4_76 · Cited by 278
Transfer Learning With Adaptive Fine-Tuning
Vrbancic, G., & Podgorelec, V. (2020) · IEEE Access · doi:10.1109/access.2020.3034343 · Cited by 254
A Survey on Deep Reinforcement Learning Algorithms for Robotic Manipulation
Han, D., Mulyana, B., Stankovic, V., & Cheng, S. (2023) · Sensors · doi:10.3390/s23073762 · Cited by 253
Waikhom, L., & Patgiri, R. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10321-2 · Cited by 253
How Does BERT Answer Questions? A Layer-Wise Analysis of Transformer Representations
van Aken, B., Winter, B., Löser, A., & Gers, F. A. (2019) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3357384.3358028 · Cited by 244
AL-Jumaili, A. H. A., Muniyandi, R. C., Hasan, M. K., Paw, J. K. S., & Singh, M. S. J. (2023) · Sensors · doi:10.3390/s23062952 · Cited by 234
Zhang, C., Sjarif, N. N. A., & Ibrahim, R. (2023) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1519 · Cited by 226
Padhiary, M., Saha, D., Kumar, R., Sethi, L. N., & Kumar, A. (2024) · Smart Agricultural Technology · doi:10.1016/j.atech.2024.100483 · Cited by 226
An application of deep reinforcement learning to algorithmic trading
Théate, T., & Ernst, D. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.114632 · Cited by 224
Capra, M., Bussolino, B., Marchisio, A., Masera, G., Martina, M., & Shafique, M. (2020) · IEEE Access · doi:10.1109/access.2020.3039858 · Cited by 222
Machine Learning in Computer Vision
Khan, A. I., & Al-Habsi, S. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.03.355 · Cited by 220
Sahu, S. K., Mokhade, A., & Bokde, N. D. (2023) · Applied Sciences · doi:10.3390/app13031956 · Cited by 208
A Comprehensive Survey of Regression-Based Loss Functions for Time Series Forecasting
Jadon, A., Patil, A., & Jadon, S. (2024) · Lecture notes in networks and systems · doi:10.1007/978-981-97-3245-6_9 · Cited by 206
Automatic speech recognition using advanced deep learning approaches: A survey
Kheddar, H., Hemis, M., & Himeur, Y. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102422 · Cited by 205
Modern computing: Vision and challenges
Gill, S. S., Wu, H., Patros, P., Ottaviani, C., Arora, P., Pujol, V. C., Haunschild, D., Parlikad, A. K., Cetinkaya, O., Lutfiyya, H., et al. (2024) · Telematics and Informatics Reports · doi:10.1016/j.teler.2024.100116 · Cited by 197
Deep learning for unmanned aerial vehicles detection: A review
Al-Qubaydhi, N., Alenezi, A., Alanazi, T., Senyor, A., Alanezi, N., Alotaibi, B., Alotaibi, M., Razaque, A., & Hariri, S. (2024) · Computer Science Review · doi:10.1016/j.cosrev.2023.100614 · Cited by 196
Classifying Cardiac Arrhythmia from ECG Signal Using 1D CNN Deep Learning Model
Ahmed, A. A., Ali, W., Abdullah, T. A. A., & Malebary, S. J. (2023) · Mathematics · doi:10.3390/math11030562 · Cited by 193
Survey of deep learning for autonomous surface vehicles in marine environments
Qiao, Y., Yin, J., Wang, W., Duarte, F., Yang, J., & Ratti, C. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3235911 · Cited by 192
Deep Learning-Based Autonomous Driving Systems: A Survey of Attacks and Defenses
Deng, Y., Zhang, T., Lou, G., Zheng, X., Jin, J., & Han, Q.-L. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3071405 · Cited by 189
Object detection in real time based on improved single shot multi-box detector algorithm
Kumar, A., Zhang, Z. J., & Lyu, H. (2020) · EURASIP Journal on Wireless Communications and Networking · doi:10.1186/s13638-020-01826-x · Cited by 188
Differential convolutional neural network
Sarıgül, M., Ozyildirim, B. M., & Avci, M. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.04.025 · Cited by 184
A Deep Learning Ensemble With Data Resampling for Credit Card Fraud Detection
Mienye, I. D., & Sun, Y. (2023) · IEEE Access · doi:10.1109/access.2023.3262020 · Cited by 183
Self-citationDeep Learning for Credit Card Fraud Detection: A Review of Algorithms, Challenges, and Solutions
Mienye, I. D., & Jere, N. (2024) · IEEE Access · doi:10.1109/access.2024.3426955 · Cited by 179
Self-citationPławiak, P., Abdar, M., & Rajendra Acharya, U. (2019) · Applied Soft Computing · doi:10.1016/j.asoc.2019.105740 · Cited by 176
Elsisi, M., Tran, M.-Q., Mahmoud, K., Lehtonen, M., & Darwish, M. M. F. (2021) · Sensors · doi:10.3390/s21041038 · Cited by 175
A Transfer Learning Approach to Breast Cancer Classification in a Federated Learning Framework
Tan, Y. N., Tinh, V. P., Lam, P. D., Nam, N. H., & Khoa, T. A. (2023) · IEEE Access · doi:10.1109/access.2023.3257562 · Cited by 172
NAS-Bench-NLP: Neural Architecture Search Benchmark for Natural Language Processing
Klyuchnikov, N., Trofimov, I., Artemova, E., Salnikov, M., Fedorov, M. V., Filippov, A., & Burnaev, E. V. (2022) · IEEE Access · doi:10.1109/access.2022.3169897 · Cited by 165
Akhyar, A., Zulkifley, M. A., Lee, J., Song, T., Han, J., Cho, C., Hyun, S., Son, Y., & Hong, B. (2024) · Ecological Indicators · doi:10.1016/j.ecolind.2024.112067 · Cited by 158
End-to-end deep learning of lane detection and path prediction for real-time autonomous driving
Lee, D., & Liu, J. (2022) · Signal Image and Video Processing · doi:10.1007/s11760-022-02222-2 · Cited by 157
Ni, Q., Ji, J., Feng, K., Zhang, Y., Lin, D., & Zheng, J. (2023) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2023.109753 · Cited by 157
Solar Energy Production Forecasting Based on a Hybrid CNN-LSTM-Transformer Model
Alali, E., Hajji, Y., Said, Y., et al. (2023) · Mathematics · doi:10.3390/math11030676 · Cited by 156
Protein generation with evolutionary diffusion: sequence is all you need
Alamdari, S., Thakkar, N., van den Berg, R., Tenenholtz, N., Strome, R., Moses, A. M., Lu, A. X., Fusi, N., Amini, A. P., & Yang, K. K. (2023) · doi:10.1101/2023.09.11.556673 · Cited by 154
Zheng, W., & Chen, G. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2021.3121312 · Cited by 154
Baseer, K. K., Sivakumar, K., Veeraiah, D., Chhabra, G., Lakineni, P. K., Pasha, M. J., Gandikota, R., & Harikrishnan, G. (2024) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2024.105988 · Cited by 150
Digital twin-driven deep reinforcement learning for adaptive task allocation in robotic construction
Lee, D., Lee, S. H., Masoud, N., Krishnan, M. S., & Li, V. C. (2022) · Advanced Engineering Informatics · doi:10.1016/j.aei.2022.101710 · Cited by 143
Ajagbe, S. A., & Adigun, M. O. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-15805-z · Cited by 143
Attention-Based LSTM Network for Rotatory Machine Remaining Useful Life Prediction
Zhang, H., Zhang, Q., Shao, S., Niu, T., & Yang, X. (2020) · IEEE Access · doi:10.1109/access.2020.3010066 · Cited by 139
Stress Monitoring Using Wearable Sensors: A Pilot Study and Stress-Predict Dataset
Iqbal, T., Simpkin, A. J., Roshan, D., Glynn, N., Killilea, J., Walsh, J. C., Molloy, G. J., Ganly, S., Ryman, H., Coen, E., et al. (2022) · Sensors · doi:10.3390/s22218135 · Cited by 136
Song, H., & Choi, H. (2023) · Applied Sciences · doi:10.3390/app13074644 · Cited by 130
AbaOud, M., Almuqrin, M. A., & Khan, M. F. (2023) · IEEE Access · doi:10.1109/access.2023.3301162 · Cited by 128
Transformer-based models for chemical SMILES representation: A comprehensive literature review
Mswahili, M. E., & Jeong, Y.-S. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e39038 · Cited by 127
Elazab, A., Wang, C., Abdel-Aziz, M. H., Zhang, J., Gu, J. J., Górriz, J. M., Zhang, Y., & Chang, C. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124780 · Cited by 126
Optimized Ensemble Learning Approach with Explainable AI for Improved Heart Disease Prediction
Mienye, I. D., & Jere, N. R. (2024) · Information · doi:10.3390/info15070394 · Cited by 124
Self-citationFin-GAN: forecasting and classifying financial time series via generative adversarial networks
Vuletić, M., Prenzel, F., & Cucuringu, M. (2024) · Quantitative Finance · doi:10.1080/14697688.2023.2299466 · Cited by 119
Drug target prediction through deep learning functional representation of gene signatures
Chen, H., King, F. J., Zhou, B., Wang, Y., Canedy, C. J., Hayashi, J., Zhong, Y., Chang, M. W., Pache, L., Wong, J. L., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-46089-y · Cited by 119
Multi-Agent Deep Reinforcement Learning for UAVs Navigation in Unknown Complex Environment
Xue, Y., & Chen, W. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3298292 · Cited by 118
Artificial intelligence and sustainable development in Africa: A comprehensive review
Mienye, I. D., Sun, Y., & Ileberi, E. (2024) · Machine Learning with Applications · doi:10.1016/j.mlwa.2024.100591 · Cited by 118
Self-citationDeep Learning in Finance: A Survey of Applications and Techniques
Mienye, E. D., Jere, N. R., Obaido, G., Mienye, I. D., & Aruleba, K. (2024) · AI · doi:10.3390/ai5040101 · Cited by 114
Self-citationModel interpretability of financial fraud detection by group SHAP
Lin, K., & Gao, Y. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118354 · Cited by 108
Credit Card Fraud Detection Using Advanced Transformer Model
Yu, C., Xu, Y., Cao, J. P., Zhang, Y., Jin, Y., & Zhu, M. (2024) · IEEE International Conference on Metaverse Computing, Networking and Applications (MetaCom) · doi:10.1109/metacom62920.2024.00064 · Cited by 108
Tsantekidis, A., Passalis, N., & Tefas, A. (2022) · Elsevier eBooks · doi:10.1016/b978-0-32-385787-1.00010-5 · Cited by 103
Hybrid Architecture Based on CNN and Transformer for Strip Steel Surface Defect Classification
Li, S., Wu, C., & Xiong, N. N. (2022) · Electronics · doi:10.3390/electronics11081200 · Cited by 100
Dang, T. K., Tran, T. C., Tuan, L. M., & Tiep, M. V. (2021) · Applied Sciences · doi:10.3390/app112110004 · Cited by 93
A Deep Learning-Based Sensor Modeling for Smart Irrigation System
Sami, M., Khan, S. Q., Khurram, M., Farooq, M. U., Anjum, R., Aziz, S., Qureshi, R., & Sadak, F. (2022) · Agronomy · doi:10.3390/agronomy12010212 · Cited by 93
Obaido, G., Achilonu, O., Ogbuokiri, B., Amadi, C. S., Habeebullahi, L., O’Halloran, T., Chukwu, C. W., Mienye, E. D., Aliyu, M., Fasawe, O., et al. (2024) · IEEE Access · doi:10.1109/access.2024.3418974 · Cited by 90
Transformers for Molecular Property Prediction: Lessons Learned from the Past Five Years
Sultan, A., Sieg, J., Mathea, M., & Volkamer, A. (2024) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.4c00747 · Cited by 90
Naz, A., Khan, H., Din, I., Ali, A., & Husain, M. (2024) · Engineering Technology & Applied Science Research · doi:10.48084/etasr.8080 · Cited by 83
Rehman, A., Razzak, I., & Xu, G. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3171852 · Cited by 79
Human-Guided Deep Reinforcement Learning for Optimal Decision Making of Autonomous Vehicles
Wu, J., Yang, H., Yang, L., Huang, Y., He, X., & Lv, C. (2024) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2024.3384992 · Cited by 78
A Hybrid Deep Learning Approach with Generative Adversarial Network for Credit Card Fraud Detection
Mienye, I. D., & Swart, T. G. (2024) · Technologies · doi:10.3390/technologies12100186 · Cited by 78
Self-citationModelling customers credit card behaviour using bidirectional LSTM neural networks
Ala'raj, M., Abbod, M., & Majdalawieh, M. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00461-7 · Cited by 72
Li, S., Peng, K., Ma, M., Yang, H., Huang, S., & Yang, Z. (2024) · IEEE Access · doi:10.1109/access.2024.3367772 · Cited by 72
Barua, P. D., Vicnesh, J., Lih, O. S., Palmer, E. E., Yamakawa, T., Kobayashi, M., & Acharya, U. R. (2022) · Cognitive Neurodynamics · doi:10.1007/s11571-022-09904-0 · Cited by 68
An intelligent sequential fraud detection model based on deep learning
Zioviris, G., Kolomvatsos, K., & Stamoulis, G. I. (2024) · The Journal of Supercomputing · doi:10.1007/s11227-024-06030-y · Cited by 65
Reed, S., Zolna, K., Parisotto, E., Colmenarejo, S. G., Novikov, A., Barth-Maron, G., Gimenez, M., Sulsky, Y., Kay, J., Springenberg, J. T., et al. (2022) · arXiv · doi:10.48550/arxiv.2205.06175 · Cited by 63
Han, G., Lee, S., Lee, J., Lee, K., & Bae, J. (2021) · Journal of Energy Storage · doi:10.1016/j.est.2021.102868 · Cited by 62
ACWGAN-GP for milling tool breakage monitoring with imbalanced data
Li, X., Yue, C., Liu, X., Zhou, J., & Wang, L. (2023) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2023.102624 · Cited by 60
Correlations of Cross-Entropy Loss in Machine Learning
Connor, R., Dearle, A., Claydon, B., & Vadicamo, L. (2024) · Entropy · doi:10.3390/e26060491 · Cited by 58
Yan, K., Lu, C. L., Ma, X., Ji, Z., & Huang, J. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122545 · Cited by 57
A deep learning approach for Maize Lethal Necrosis and Maize Streak Virus disease detection
O’Halloran, T., Obaido, G., Otegbade, B., & Mienye, I. D. (2024) · Machine Learning with Applications · doi:10.1016/j.mlwa.2024.100556 · Cited by 55
Self-citationAn Outlier-Resilient Autoencoder for Representing High-Dimensional and Incomplete Data
Wu, D., Hu, Y., Liu, K., Li, J., Wang, X., Deng, S., Zheng, N., & Luo, X. (2024) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2024.3437370 · Cited by 53
Explainable deep learning diagnostic system for prediction of lung disease from medical images
Hroub, N. A., Alsannaa, A. N., Alowaifeer, M., Alfarraj, M., & Okafor, E. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108012 · Cited by 50
Jain, D. K., Zhao, X., Gan, C., Shukla, P. K., Jain, A., & Sharma, S. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102429 · Cited by 49
Xiao, W., Yang, Y., Mu, X., Xie, Y., Tang, X., Cao, D., & Liu, T. (2024) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2024.3360445 · Cited by 46
Sonar Image Generation by MFA-CycleGAN for Boosting Underwater Object Detection of AUVs
Zhou, J., Li, Y., Qin, H., Dai, P., Zhao, Z., & Hu, M. (2024) · IEEE Journal of Oceanic Engineering · doi:10.1109/joe.2024.3350746 · Cited by 45
Yoon, D.-H., & Yoon, J. W. (2024) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2024.110069 · Cited by 45
Credit Card Fraud Detection via Intelligent Sampling and Self-supervised Learning
Chen, C.-T., Lee, C., Huang, S.-H., & Peng, W.-C. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3641283 · Cited by 44
Algorithmic trading using continuous action space deep reinforcement learning
Majidi, N., Shamsi, M., & Marvasti, F. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121245 · Cited by 42
Enhancing Dermatological Diagnostics with EfficientNet: A Deep Learning Approach
Manole, I., Butacu, A., Bejan, R. N., & Ţiplica, G. (2024) · Bioengineering · doi:10.3390/bioengineering11080810 · Cited by 41
Saidi, R., Rahmany, I., Dhahri, S., & Moulahi, T. (2024) · IEEE Access · doi:10.1109/access.2024.3419084 · Cited by 36
Deep Neural Networks for Behavioral Credit Rating
Merćep, A., Mrčela, L., Birov, M., & Kostanjčar, Z. (2020) · Entropy · doi:10.3390/e23010027 · Cited by 35
CapsCovNet: A Modified Capsule Network to Diagnose COVID-19 From Multimodal Medical Imaging
Saif, A. F. M., Imtiaz, T., Rifat, S., Shahnaz, C., Zhu, W., & Ahmad, M. O. (2021) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2021.3104791 · Cited by 33
Sinha, S., Dey, S., & Saha, G. (2023) · Computer Speech & Language · doi:10.1016/j.csl.2023.101599 · Cited by 32
Das, M., Ghosh, A., & Sunoj, R. B. (2024) · Journal of Computational Chemistry · doi:10.1002/jcc.27315 · Cited by 32
A Suspicious Financial Transaction Detection Model Using Autoencoder and Risk-Based Approach
Koo, K., Park, M., & Yoon, B. (2024) · IEEE Access · doi:10.1109/access.2024.3399824 · Cited by 32
Yang, X., Zhang, C., Sun, Y., Pang, K., Jing, L., Wa, S., & Lv, C. (2023) · Information · doi:10.3390/info14090499 · Cited by 30
Early detection and prediction of Heart Disease using Wearable devices and Deep Learning algorithms
Sivasubramaniam, S., & Balamurugan, S. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-19127-6 · Cited by 29
A Convolutional Neural Network Model for Credit Card Fraud Detection
Gambo, M. L., Zainal, A. B., & Kassim, M. N. (2022) · International Conference on Data Science and Its Applications (ICoDSA) · doi:10.1109/icodsa55874.2022.9862930 · Cited by 28
Ma, C., Zhang, J., Li, Z., & Xu, S. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-08011-9 · Cited by 28
Gorenstein, L., Onn, A., Green, M., Mayer, A., Segev, S., & Marom, E. M. (2023) · Academic Radiology · doi:10.1016/j.acra.2023.02.019 · Cited by 28
Peng, Y.-L., & Lee, W. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.111335 · Cited by 26
Swin Transformer Combined with Convolution Neural Network for Surface Defect Detection
Li, Y., Xiang, Y., Guo, H., Liu, P., & Liu, C. (2022) · Machines · doi:10.3390/machines10111083 · Cited by 25
Anomaly detection in three-axis CNC machines using LSTM networks and transfer learning
Li, E., Bedi, S. S., & Melek, W. (2023) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-023-11617-5 · Cited by 23
A Deep Learning Approach to Estimate Soil Organic Carbon from Remote Sensing
Pavlović, M., Ilić, S., Ralevic, N., Antonić, N., Raffa, D. W., Bandecchi, M., & Culibrk, D. R. (2024) · Remote Sensing · doi:10.3390/rs16040655 · Cited by 22
Davidashvilly, S., Cardei, M. A., Hssayeni, M. D., Chi, C., & Ghoraani, B. (2024) · BioMedical Engineering OnLine · doi:10.1186/s12938-024-01214-2 · Cited by 21
Santos, T. T., de Souza, K. X. S., Neto, J. C., Koenigkan, L. V., Moreira, A. S., & Ternes, S. (2024) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2024.109199 · Cited by 21
Scaling and evaluating sparse autoencoders
Gao, L., la Tour, T. D., Tillman, H., Goh, G., Troll, R., Radford, A., Sutskever, I., Leike, J., & Wu, J. (2024) · arXiv · doi:10.48550/arxiv.2406.04093 · Cited by 21
Wang, Z., Kim, S., & Joe, I. (2023) · Applied Sciences · doi:10.3390/app13137884 · Cited by 20
Auction-based deep learning-driven smart agricultural supply chain mechanism
Feng, Y., Mei, D., & Zhao, H. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.111009 · Cited by 18
Satellite Images and Deep Learning Tools for Crop Yield Prediction and Price Forecasting
Gastli, M. S., Nassar, L., & Karray, F. (2021) · doi:10.1109/ijcnn52387.2021.9534388 · Cited by 17
Scalable Perception-Action-Communication Loops With Convolutional and Graph Neural Networks
Hu, T.-K., Gama, F., Chen, T., Zheng, W., Wang, Z., Ribeiro, A., & Sadler, B. M. (2021) · IEEE Transactions on Signal and Information Processing over Networks · doi:10.1109/tsipn.2021.3139336 · Cited by 17
Sanida, T., Sanida, M. V., Sideris, A., & Dasygenis, M. (2024) · BioMedInformatics · doi:10.3390/biomedinformatics4030109 · Cited by 17
Fairness Metrics in AI Healthcare Applications: A Review
Mienye, I. D., Swart, T. G., & Obaido, G. (2024) · IEEE International Conference on Information Reuse and Integration (IRI) · doi:10.1109/iri62200.2024.00065 · Cited by 16
Self-citationUncertainty-Aware Autonomous Mobile Robot Navigation with Deep Reinforcement Learning
Rodríguez, L. G., & Plasencia-Salgueiro, A. D. J. (2021) · Studies in computational intelligence · doi:10.1007/978-3-030-77939-9_7 · Cited by 15
Anomaly Detection in Smart Industrial Machinery Through Hidden Markov Models and Autoencoders
Sorostinean, R., Burghelea, Z., & Gellért, Á. (2024) · IEEE Access · doi:10.1109/access.2024.3400970 · Cited by 15
Mckay, M., Danilevicz, M. F., Ashworth, M. B., Rocha, R. L., Upadhyaya, S. R., Bennamoun, M., & Edwards, D. (2024) · Remote Sensing · doi:10.3390/rs16112041 · Cited by 15
Gaber, A., Abdeltwab, H., & Elbatt, T. (2024) · International Conference on Machine Learning and Soft Computing · doi:10.1145/3647750.3647752 · Cited by 13
Attention-based multilayer GRU decoder for on-site glucose prediction on smartphone
Koca, Ö. A., Kabak, H. Ö., & Kılıç, V. (2024) · The Journal of Supercomputing · doi:10.1007/s11227-024-06424-y · Cited by 13
Shyni, H. M., & Chitra, E. (2024) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2024.106600 · Cited by 12
A Survey of Bias and Fairness in Healthcare AI
Mienye, I. D., Obaido, G., Emmanuel, I. D., & Ajani, A. A. (2024) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi61247.2024.00103 · Cited by 11
Self-citationVariational Auto-Encoder for text generation
Hu, H., Liao, M., Mao, W., Liu, W. Y., Zhang, C., & Jing, Y. (2020) · IEEE Information Technology and Mechatronics Engineering Conference (ITOEC) · doi:10.1109/itoec49072.2020.9141571 · Cited by 9
Ensemble of Graph Neural Networks for Enhanced Financial Fraud Detection
Hiremath, A., Arya, A., Sriranga, L., Reddy, K. C. S., & Nikhil, M. (2024) · 2024 IEEE 9th International Conference for Convergence in Technology (I2CT) · doi:10.1109/i2ct61223.2024.10543898 · Cited by 9
Decoupling Deep Learning for Enhanced Image Recognition Interpretability
Peng, Y., He, L., Hu, D., Liu, Y., Yang, L., & Shang, S. (2024) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3674837 · Cited by 8
Li, K., Shen, B., Feng, F., Li, X., Wang, Y., Feng, N., Tang, Z., Ma, L., & Li, H. (2024) · Journal of Pharmaceutical Analysis · doi:10.1016/j.jpha.2024.101128 · Cited by 7
Privacy-Enhanced Federated Learning for Rare Genetic Disorder Classification with EHR
Siganporia, A., Varia, M., Gorimar, U., & Nanade, A. (2023) · Global Conference on Information Technologies and Communications (GCITC) · doi:10.1109/gcitc60406.2023.10426518 · Cited by 5
Kim, Y.-J., Ahn, W. J., Jang, S., Lim, M. T., & Pae, D.-S. (2024) · Applied Sciences · doi:10.3390/app14125213 · Cited by 5
Metadata
- Authors
- Mienye, I. D., & Swart, T. G.
- Venue
- Information
- Publisher
- MDPI AG
- Published
- 2024-11-27
- Volume
- 15
- Issue
- 12
- Pages
- 755
- ISSN
- 2078-2489 (ISSN-L)
- OpenAlex
- W4404756614
- Cited by
- 330
- References
- 180
- FWCI
- 46.61
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.