The DOI matches its Crossref record; 155 of the 155 references it cites were found in a registry or an index.
Recurrent Neural Networks: A Comprehensive Review of Architectures, Variants, and Applications
Open accessAbstract
Recurrent neural networks (RNNs) have significantly advanced the field of machine learning (ML) by enabling the effective processing of sequential data. This paper provides a comprehensive review of RNNs and their applications, highlighting advancements in architectures, such as long short-term memory (LSTM) networks, gated recurrent units (GRUs), bidirectional LSTM (BiLSTM), echo state networks (ESNs), peephole LSTM, and stacked LSTM. The study examines the application of RNNs to different domains, including natural language processing (NLP), speech recognition, time series forecasting, autonomous vehicles, and anomaly detection. Additionally, the study discusses recent innovations, such as the integration of attention mechanisms and the development of hybrid models that combine RNNs with convolutional neural networks (CNNs) and transformer architectures. This review aims to provide ML researchers and practitioners with a comprehensive overview of the current state and future directions of RNN research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Effective Approaches to Attention-based Neural Machine Translation
Luong, T., Pham, H., & Manning, C. D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1166 · Cited by 8,382
Building a Large Annotated Corpus of English: The Penn Treebank
Marcus, M. (1993) · doi:10.21236/ada273556 · Cited by 7,405
Greff, K., Srivastava, R. K., Koutnik, J., Steunebrink, B. R., & Schmidhuber, J. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2582924 · Cited by 6,955
A Review of Recurrent Neural Networks: LSTM Cells and Network Architectures
Yu, Y., Si, X., Hu, C., & Zhang, J. (2019) · Neural Computation · doi:10.1162/neco_a_01199 · Cited by 5,591
Backpropagation through time: what it does and how to do it
Werbos, P. J. (1990) · Proceedings of the IEEE · doi:10.1109/5.58337 · Cited by 4,879
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
Clevert, D.-A., Unterthiner, T., & Hochreiter, S. (2015) · arXiv · doi:10.48550/arxiv.1511.07289 · Cited by 4,513
Neural Architecture Search with Reinforcement Learning
Zoph, B., & Le, Q. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01578 · Cited by 3,974
Deep learning with long short-term memory networks for financial market predictions
Fischer, T., & Krauss, C. (2018) · European Journal of Operational Research · doi:10.1016/j.ejor.2017.11.054 · Cited by 2,785
TIMIT Acoustic-Phonetic Continuous Speech Corpus
Garofolo, J. S., Lamel, L. F., Fisher, W. M., Pallett, D. S., Dahlgren, N. L., Zue, V. W., & Fiscus, J. G. (2020) · Americanae (AECID Library) · doi:10.35111/17gk-bn40 · Cited by 2,508
Recurrent Neural Networks for Multivariate Time Series with Missing Values
Che, Z., Purushotham, S., Cho, K., Sontag, D., & Liu, Y. (2018) · Scientific Reports · doi:10.1038/s41598-018-24271-9 · Cited by 2,370
Deep Speech 2: End-to-End Speech Recognition in English and Mandarin
Amodei, D., Anubhai, R., Battenberg, E., Case, C. T., Casper, J., Catanzaro, B., Chen, J., Chrzanowski, M., Coates, A., Diamos, G., et al. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.02595 · Cited by 2,110
He, R., & McAuley, J. (2016) · Proceedings of the 25th International Conference on World Wide Web · doi:10.1145/2872427.2883037 · Cited by 1,459
Anomaly Detection with Robust Deep Autoencoders
Zhou, C., & Paffenroth, R. C. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098052 · Cited by 1,436
Improved Adam Optimizer for Deep Neural Networks
Zhang, Z. (2018) · 2018 IEEE/ACM 26th International Symposium on Quality of Service (IWQoS) · doi:10.1109/iwqos.2018.8624183 · Cited by 1,400
Recurrent Neural Networks for Time Series Forecasting: Current status and future directions
Hewamalage, H., Bergmeir, C., & Bandara, K. (2021) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2020.06.008 · Cited by 1,371
Activation functions in deep learning: a comprehensive survey and benchmark
Dubey, S. R., Singh, S. K., & Chaudhuri, B. B. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.06.111 · Cited by 1,259
Structural-RNN: Deep Learning on Spatio-Temporal Graphs
Jain, A., Zamir, A. R., Savarese, S., & Saxena, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.573 · Cited by 1,133
Bao, W., Yue, J., & Rao, Y. (2017) · PLOS ONE · doi:10.1371/journal.pone.0180944 · Cited by 1,124
Deep Learning for Household Load Forecasting—A Novel Pooling Deep RNN
Shi, H., Xu, M., & Li, R. (2018) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2017.2686012 · Cited by 1,102
Speech-Transformer: A No-Recurrence Sequence-to-Sequence Model for Speech Recognition
Dong, L., Xu, S., & Xu, B. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8462506 · Cited by 1,100
Deep learning modelling techniques: Current progress, applications, advantages, and challenges
Ahmed, S. F., Alam, M. S. B., Hassan, M., Rozbu, M. R., Ishtiak, T., Rafa, N., Mofijur, M., Shawkat Ali, A. B. M., & Gandomi, A. H. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10466-8 · Cited by 1,079
Taye, M. M. (2023) · Computers · doi:10.3390/computers12050091 · Cited by 1,057
State-of-the-Art Speech Recognition with Sequence-to-Sequence Models
Chiu, C.-C., Sainath, T. N., Wu, Y., Prabhavalkar, R., Nguyen, P., Chen, Z., Kannan, A., Weiss, R. J., Rao, K., Gonina, E., et al. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8462105 · Cited by 1,043
Independently Recurrent Neural Network (IndRNN): Building A Longer and Deeper RNN
Li, S., Li, W., Cook, C., Zhu, C., & Gao, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00572 · Cited by 972
Stock market's price movement prediction with LSTM neural networks
Nelson, D. M. Q., Pereira, A. C. M., & de Oliveira, R. A. (2017) · 2017 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966019 · Cited by 951
Neural Machine Translation of Rare Words with Subword Units
Sennrich, R., Haddow, B., & Birch, A. (2015) · arXiv · doi:10.48550/arxiv.1508.07909 · Cited by 950
Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention
Katharopoulos, A., Vyas, A., Pappas, N., & Fleuret, F. (2020) · arXiv · doi:10.48550/arxiv.2006.16236 · Cited by 827
A Theoretically Grounded Application of Dropout in Recurrent Neural Networks
Gal, Y., & Ghahramani, Z. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.05287 · Cited by 766
CTRL: A Conditional Transformer Language Model for Controllable Generation
Keskar, N. S., McCann, B., Varshney, L. R., Xiong, C., & Socher, R. (2019) · arXiv · doi:10.48550/arxiv.1909.05858 · Cited by 751
DeepAnT: A Deep Learning Approach for Unsupervised Anomaly Detection in Time Series
Munir, M., Siddiqui, S. A., Dengel, A., & Ahmed, S. (2019) · IEEE Access · doi:10.1109/access.2018.2886457 · Cited by 696
An Attentive Survey of Attention Models
Chaudhari, S., Mithal, V., Polatkan, G., & Ramanath, R. (2021) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3465055 · Cited by 689
An LSTM Network for Highway Trajectory PredictionPreprint
Altch\'e, F., & Fortelle, A. D. L. (2018) · arXiv (Cornell University) · Cited by 663
Recurrent nets that time and count
Gers, F. A., & Schmidhuber, J. (2000) · Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium · doi:10.1109/ijcnn.2000.861302 · Cited by 623
Time-Series Anomaly Detection Service at Microsoft
Ren, H., Xu, B., Wang, Y., Yi, C., Huang, C., Kou, X., Xing, T., Yang, M., Tong, J., & Zhang, Q. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330680 · Cited by 623
Simple and Accurate Dependency Parsing Using Bidirectional LSTM Feature Representations
Kiperwasser, E., & Goldberg, Y. (2016) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00101 · Cited by 615
Performance Evaluation of Deep Neural Networks Applied to Speech Recognition: RNN, LSTM and GRU
Shewalkar, A., Nyavanandi, D., & Ludwig, S. A. (2019) · Journal of Artificial Intelligence and Soft Computing Research · doi:10.2478/jaiscr-2019-0006 · Cited by 576
Dropout vs. batch normalization: an empirical study of their impact to deep learning
Garbin, C., Zhu, X., & Marques, O. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-019-08453-9 · Cited by 571
RNN-LSTM: From applications to modeling techniques and beyond—Systematic review
Al-Selwi, S. M., Hassan, M. F., Abdulkadir, S. J., Muneer, A., Sumiea, E. H., Alqushaibi, A., & Ragab, M. G. (2024) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2024.102068 · Cited by 505
From Softmax to Sparsemax: A Sparse Model of Attention and Multi-Label Classification
Martins, A. F. T., & Astudillo, R. F. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.02068 · Cited by 431
Review and Comparison of Commonly Used Activation Functions for Deep Neural Networks
Szandała, T. (2021) · Studies in Computational Intelligence · doi:10.1007/978-981-15-5495-7_11 · Cited by 422
Very deep convolutional networks for end-to-end speech recognition
Zhang, Y., Chan, W., & Jaitly, N. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7953077 · Cited by 407
Deep learning in bioinformatics: Introduction, application, and perspective in the big data era
Li, Y., Huang, C., Ding, L., Li, Z., Pan, Y., & Gao, X. (2019) · Methods · doi:10.1016/j.ymeth.2019.04.008 · Cited by 401
A Survey of Decision Trees: Concepts, Algorithms, and Applications
Mienye, I. D., & Jere, N. (2024) · IEEE Access · doi:10.1109/access.2024.3416838 · Cited by 353
Self-citationMachine Learning in Disaster Management: Recent Developments in Methods and Applications
Linardos, V., Drakaki, M., Tzionas, P., & Karnavas, Y. (2022) · Machine Learning and Knowledge Extraction · doi:10.3390/make4020020 · Cited by 319
Short-term load forecasting based on LSTM networks considering attention mechanism
Lin, J., Ma, J., Zhu, J., & Cui, Y. (2022) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2021.107818 · Cited by 307
Attention, please! A survey of neural attention models in deep learning
de Santana Correia, A., & Colombini, E. L. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10148-x · Cited by 298
A survey of regularization strategies for deep models
Moradi, R., Berangi, R., & Minaei, B. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-019-09784-7 · Cited by 297
Progress in Neural NLP: Modeling, Learning, and Reasoning
Zhou, M., Duan, N., Liu, S., & Shum, H.-Y. (2020) · Engineering · doi:10.1016/j.eng.2019.12.014 · Cited by 281
Recurrent Neural Networks for Short-Term Load Forecasting: An Overview and Comparative Analysis
Bianchi, F. M., Maiorino, E., Kampffmeyer, M. C., Rizzi, A., & Jenssen, R. (2017) · SpringerBriefs in Computer Science · doi:10.1007/978-3-319-70338-1 · Cited by 280
Locally recurrent globally feedforward networks: a critical review of architectures
Tsoi, A. C., & Back, A. D. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279187 · Cited by 279
Enhancing Stock Movement Prediction with Adversarial Training
Feng, F., Chen, H., He, X., Ding, J., Sun, M., & Chua, T.-S. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/810 · Cited by 263
Improved protein structure prediction by deep learning irrespective of co-evolution information
(2021) · doi:10.1038/s42256-021-00348-5 · Cited by 256
Transfer Learning for Sentiment Analysis Using BERT Based Supervised Fine-Tuning
Prottasha, N. J., Sami, A. A., Kowsher, M., Murad, S. A., Bairagi, A. K., Masud, M., & Baz, M. (2022) · Sensors · doi:10.3390/s22114157 · Cited by 248
A Review on Dropout Regularization Approaches for Deep Neural Networks within the Scholarly Domain
Salehin, I., & Kang, D.-K. (2023) · Electronics · doi:10.3390/electronics12143106 · Cited by 228
Healthcare predictive analytics using machine learning and deep learning techniques: a survey
Badawy, M., Ramadan, N., & Hefny, H. A. (2023) · Journal of Electrical Systems and Information Technology · doi:10.1186/s43067-023-00108-y · Cited by 225
Khan, W., Daud, A., Khan, K., Muhammad, S., & Haq, R. (2023) · Natural Language Processing Journal · doi:10.1016/j.nlp.2023.100026 · Cited by 217
A Comparison of LSTM and GRU Networks for Learning Symbolic Sequences
Cahuantzi, R., Chen, X., & Güttel, S. (2023) · Lecture Notes in Networks and Systems · doi:10.1007/978-3-031-37963-5_53 · Cited by 199
Sequential Modeling Enables Scalable Learning for Large Vision Models
Bai, Y., Geng, X., Mangalam, K., Bar, A., Yuille, A., Darrell, T., Malik, J., & Efros, A. A. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02157 · Cited by 198
Modern computing: Vision and challenges
Gill, S. S., Wu, H., Patros, P., Ottaviani, C., Arora, P., Pujol, V. C., Haunschild, D., Parlikad, A. K., Cetinkaya, O., Lutfiyya, H., et al. (2024) · Telematics and Informatics Reports · doi:10.1016/j.teler.2024.100116 · Cited by 197
AL-Jumaili, A. H. A., Muniyandi, R. C., Hasan, M. K., Paw, J. K. S., & Singh, M. S. J. (2023) · Sensors · doi:10.3390/s23062952 · Cited by 195
Naseem, U., Razzak, I., Khan, S. K., & Prasad, M. (2021) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3434237 · Cited by 194
A Comprehensive Survey of Neural Architecture Search: Challenges and Solutions
Ren, P., Xiao, Y., Chang, X., Huang, P.-Y., Li, Z., Chen, X., & Wang, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.02903 · Cited by 193
Recurrent neural network for motion trajectory prediction in human-robot collaborative assembly
Zhang, J., Liu, H., Chang, Q., Wang, L., & Gao, R. X. (2020) · CIRP Annals · doi:10.1016/j.cirp.2020.04.077 · Cited by 186
A Deep Learning Ensemble With Data Resampling for Credit Card Fraud Detection
Mienye, I. D., & Sun, Y. (2023) · IEEE Access · doi:10.1109/access.2023.3262020 · Cited by 183
Self-citationDeep Learning for Credit Card Fraud Detection: A Review of Algorithms, Challenges, and Solutions
Mienye, I. D., & Jere, N. (2024) · IEEE Access · doi:10.1109/access.2024.3426955 · Cited by 179
Self-citationDisplacement prediction of Jiuxianping landslide using gated recurrent unit (GRU) networks
Zhang, W., Li, H., Tang, L., Gu, X., Wang, L., & Wang, L. (2022) · Acta Geotechnica · doi:10.1007/s11440-022-01495-8 · Cited by 178
Comparing LSTM and GRU Models to Predict the Condition of a Pulp Paper Press
Mateus, B. C., Mendes, M., Farinha, J. T., Assis, R., & Cardoso, A. J. M. (2021) · Energies · doi:10.3390/en14216958 · Cited by 171
Ni, Q., Ji, J., Feng, K., Zhang, Y., Lin, D., & Zheng, J. (2023) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2023.109753 · Cited by 157
Recurrent Neural Networks: An Embedded Computing Perspective
Rezk, N. M., Purnaprajna, M., Nordström, T., & Ul-Abdin, Z. (2020) · IEEE Access · doi:10.1109/access.2020.2982416 · Cited by 151
CORe50: a New Dataset and Benchmark for Continuous Object Recognition
Lomonaco, V., & Maltoni, D. (2017) · arXiv · doi:10.48550/arxiv.1705.03550 · Cited by 135
A Comprehensive Review of Bias in Deep Learning Models: Methods, Impacts, and Future Directions
Shah, M., & Sureja, N. (2024) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-024-10134-2 · Cited by 130
End-to-End Driving Via Conditional Imitation Learning
Codevilla, F., Muller, M., Lopez, A., Koltun, V., & Dosovitskiy, A. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460487 · Cited by 129
A Systematic Review of Echo State Networks From Design to Application
Sun, C., Song, M., Cai, D., Zhang, B., Hong, S., & Li, H. (2022) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2022.3225780 · Cited by 127
DeepSite: bidirectional LSTM and CNN models for predicting DNA–protein binding
Zhang, Y., Qiao, S., Ji, S., & Li, Y. (2019) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-019-00990-x · Cited by 122
Obaido, G., Mienye, I. D., Egbelowo, O. F., Emmanuel, I. D., Ogunleye, A., Ogbuokiri, B., Mienye, P., & Aruleba, K. (2024) · Machine Learning with Applications · doi:10.1016/j.mlwa.2024.100576 · Cited by 121
Self-citationPI-LSTM: Physics-informed long short-term memory network for structural response modeling
Liu, F., Li, J., & Wang, L. (2023) · Engineering Structures · doi:10.1016/j.engstruct.2023.116500 · Cited by 116
RMAF: Relu-Memristor-Like Activation Function for Deep Learning
Yu, Y., Adu, K., Tashi, N., Anokye, P., Wang, X., & Ayidzoe, M. A. (2020) · IEEE Access · doi:10.1109/access.2020.2987829 · Cited by 115
Niu, Z., Zhong, G., Yue, G., Wang, L., Yu, H. L., Xiao, L., & Dong, J. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.10.050 · Cited by 108
ResNet: Solving Vanishing Gradient in Deep Networks
Borawar, L., & Kaur, R. (2023) · Lecture notes in networks and systems · doi:10.1007/978-981-19-8825-7_21 · Cited by 105
Survey on Recurrent Neural Network in Natural Language Processing
M.Tarwani, K., & Edem, S. (2017) · International Journal of Engineering Trends and Technology · doi:10.14445/22315381/ijett-v48p253 · Cited by 103
Tsantekidis, A., Passalis, N., & Tefas, A. (2022) · Elsevier eBooks · doi:10.1016/b978-0-32-385787-1.00010-5 · Cited by 103
A comprehensive survey on automatic speech recognition using neural networks
Dhanjal, A. S., & Singh, W. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-16438-y · Cited by 99
Understanding Gradient Clipping in Private SGD: A Geometric PerspectivePreprint
Chen, X., Wu, Z. S., & Hong, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.15429 · Cited by 98
Time series forecasting based on echo state network and empirical wavelet transformation
Gao, R., Du, L., Duru, O., & Yuen, K. F. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107111 · Cited by 95
Dynamic ensemble deep echo state network for significant wave height forecasting
Gao, R., Li, R., Hu, M., Suganthan, P. N., & Yuen, K. F. (2022) · Applied Energy · doi:10.1016/j.apenergy.2022.120261 · Cited by 95
Deep Learning in Finance: A Survey of Applications and Techniques
Mienye, E. D., Jere, N. R., Obaido, G., Mienye, I. D., & Aruleba, K. (2024) · AI · doi:10.3390/ai5040101 · Cited by 93
Self-citationRecurrent Neural Networks for Edge Intelligence: A Survey
Lalapura, V. S., Amudha, J., & Satheesh, H. S. (2021) · ACM Computing Surveys · doi:10.1145/3448974 · Cited by 90
Rundo, F. (2019) · Applied Sciences · doi:10.3390/app9204460 · Cited by 85
Obaido, G., Achilonu, O., Ogbuokiri, B., Amadi, C. S., Habeebullahi, L., O’Halloran, T., Chukwu, C. W., Mienye, E. D., Aliyu, M., Fasawe, O., et al. (2024) · IEEE Access · doi:10.1109/access.2024.3418974 · Cited by 84
Self-citationAn efficient two-state GRU based on feature attention mechanism for sentiment analysis
Zulqarnain, M., Ghazali, R., Aamir, M., & Hassim, Y. M. M. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-13339-4 · Cited by 78
Analyzing Sentiments Regarding ChatGPT Using Novel BERT: A Machine Learning Approach
Sudheesh, R., Mujahid, M., Rustam, F., Shafique, R., Chunduri, V., Villar, M. G., Ballester, J. B., Díez, I. D. L. T., & Ashraf, I. (2023) · Information · doi:10.3390/info14090474 · Cited by 75
A Machine Learning Method with Hybrid Feature Selection for Improved Credit Card Fraud Detection
Mienye, I. D., & Sun, Y. (2023) · Applied Sciences · doi:10.3390/app13127254 · Cited by 74
Self-citationYadav, S., Ekbal, A., Saha, S., Kumar, A., & Bhattacharyya, P. (2018) · Knowledge-Based Systems · doi:10.1016/j.knosys.2018.11.020 · Cited by 73
A CNN-LSTM Model for Tailings Dam Risk Prediction
Yang, J., Qu, J., Mi, Q., & Li, Q. (2020) · IEEE Access · doi:10.1109/access.2020.3037935 · Cited by 73
Fei, H., & Tan, F. (2018) · Algorithms · doi:10.3390/a11110172 · Cited by 72
Vatanchi, S. M., Etemadfard, H., Maghrebi, M. F., & Shad, R. (2023) · Water Resources Management · doi:10.1007/s11269-023-03579-w · Cited by 72
Gallicchio, C., & Micheli, A. (2018) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489464 · Cited by 68
Mustaqeem, M., Ishaq, M., & Kwon, S. (2022) · Sustainable Energy Technologies and Assessments · doi:10.1016/j.seta.2022.102275 · Cited by 65
Pre-Training of Deep Bidirectional Protein Sequence Representations With Structural Information
Min, S., Park, S., Kim, S., Choi, H.-S., Lee, B., & Yoon, S. (2021) · IEEE Access · doi:10.1109/access.2021.3110269 · Cited by 62
Bhambu, A., Gao, R., & Suganthan, P. N. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.111759 · Cited by 62
COVID-19 Diagnosis: A Review of Rapid Antigen, RT-PCR and Artificial Intelligence Methods
Aruleba, R. T., Adekiya, T. A., Ayawei, N., Obaido, G., Aruleba, K., Mienye, I. D., Aruleba, I., & Ogbuokiri, B. (2022) · Bioengineering · doi:10.3390/bioengineering9040153 · Cited by 61
Self-citationApplying Recurrent Neural Networks for Anomaly Detection in Electrocardiogram Sensor Data
Minic, A., Jovanović, L., Bačanin, N., Stoean, C., Zivkovic, M. Z., Spalević, P., Petrović, A., Dobrojević, M., & Stoean, R. (2023) · Sensors · doi:10.3390/s23249878 · Cited by 61
Sequence-to-sequence Bangla Sentence Generation with LSTM Recurrent Neural Networks
Islam, M. S., Mousumi, S. S. S., Abujar, S., & Hossain, S. A. (2019) · Procedia Computer Science · doi:10.1016/j.procs.2019.05.026 · Cited by 58
Gajendran, S., Manjula, D., & Sugumaran, V. (2020) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103609 · Cited by 58
Traffic Pattern Classification in Smart Cities Using Deep Recurrent Neural Network
Ismaeel, A. G., Janardhanan, K., Sankar, M., Natarajan, Y., Mahmood, S. N., Alani, S., & Shather, A. H. (2023) · Sustainability · doi:10.3390/su151914522 · Cited by 54
Short-Term Stock Correlation Forecasting Based on CNN-BiLSTM Enhanced by Attention Mechanism
Luo, A., Zhong, L., Wang, J., Wang, Y., Li, S., & Tai, W. (2024) · IEEE Access · doi:10.1109/access.2024.3369419 · Cited by 53
Applications of Recurrent Neural Networks in Environmental Factor Forecasting: A Review
Chen, Y., Cheng, Q., Cheng, Y., Yang, H. F., & Yu, H. (2018) · Neural Computation · doi:10.1162/neco_a_01134 · Cited by 52
Low-Complexity, Real-Time Joint Neural Echo Control and Speech Enhancement Based On Percepnet
Valin, J.-M., Tenneti, S. V., Helwani, K., Isik, U., & Krishnaswamy, A. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414140 · Cited by 52
Hasanat, S. M., Younis, R., Alahmari, S., Ejaz, M. T., Haris, M., Yousaf, H., Watara, S. A., Ullah, K., & Ullah, Z. (2024) · International Journal of Energy Research · doi:10.1155/2024/2403847 · Cited by 52
Attentive Convolution: Equipping CNNs with RNN-style Attention Mechanisms
Yin, W., & Schütze, H. (2018) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00249 · Cited by 51
Bilingual attention based neural machine translation
Kang, L., He, S., Wang, M., Long, F., & Su, J. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03563-8 · Cited by 51
Alhajeri, M. S., Ren, Y. M., Ou, F., Abdullah, F., & Christofides, P. D. (2024) · Process Safety and Environmental Protection · doi:10.1016/j.cherd.2024.03.019 · Cited by 50
Spatio temporal hydrological extreme forecasting framework using LSTM deep learning model
Anshuka, A., Chandra, R., Buzacott, A., Sanderson, D., & van Ogtrop, F. (2022) · Stochastic Environmental Research and Risk Assessment · doi:10.1007/s00477-022-02204-3 · Cited by 47
LSTM model for visual speech recognition through facial expressions
Bhaskar, S., & Thasleema, T. M. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-12796-1 · Cited by 47
LightRNN: Memory and Computation-Efficient Recurrent Neural NetworksPreprint
Li, X., Qin, T., Yang, J., & Liu, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.09893 · Cited by 46
Mers, M., Yang, Z., Hsieh, Y., & Tsai, Y. J. (2022) · Transportation Research Record Journal of the Transportation Research Board · doi:10.1177/03611981221100521 · Cited by 46
A deep learning approach for Maize Lethal Necrosis and Maize Streak Virus disease detection
O’Halloran, T., Obaido, G., Otegbade, B., & Mienye, I. D. (2024) · Machine Learning with Applications · doi:10.1016/j.mlwa.2024.100556 · Cited by 45
Self-citationDong, X., Chowdhury, S., Qian, L., Li, X., Guan, Y., Yang, J., & Yu, Q. (2019) · PLoS ONE · doi:10.1371/journal.pone.0216046 · Cited by 43
Abimbola, B., Marin, E. D. L. C., & Tan, Q. (2024) · Machine Learning and Knowledge Extraction · doi:10.3390/make6020041 · Cited by 43
Attention-Based STL-BiLSTM Network to Forecast Tourist Arrival
Adil, M., Wu, J., Chakrabortty, R. K., Alahmadi, A. A., Ansari, M. F., & Ryan, M. J. (2021) · Processes · doi:10.3390/pr9101759 · Cited by 40
On the adaptation of recurrent neural networks for system identification
Forgione, M., Muni, A., Piga, D., & Gallieri, M. (2023) · Automatica · doi:10.1016/j.automatica.2023.111092 · Cited by 40
Mastorocostas, P., & Theocharis, J. B. (2006) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2005.856722 · Cited by 39
Can Fairness be Automated? Guidelines and Opportunities for Fairness-aware AutoML
Weerts, H., Pfisterer, F., Feurer, M., Eggensperger, K., Bergman, E., Awad, N. H., Vanschoren, J., Pechenizkiy, M., Bischl, B., & Hutter, F. (2024) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.14747 · Cited by 38
Autonomous Driving Control Using End-to-End Deep Learning
Lee, M., & Ha, Y.-G. (2020) · IEEE International Conference on Big Data and Smart Computing (BigComp) · doi:10.1109/bigcomp48618.2020.00-23 · Cited by 34
CBMAFM: CNN-BiLSTM Multi-Attention Fusion Mechanism for sentiment classification
Wankhade, M., Annavarapu, C. S. R., & Abraham, A. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-17437-9 · Cited by 32
End-to-End Speech Recognition For Arabic Dialects
Nasr, S., Duwairi, R., & Quwaider, M. (2023) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-023-07670-7 · Cited by 31
State initialization for recurrent neural network modeling of time-series data
Mohajerin, N., & Waslander, S. L. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966138 · Cited by 29
Efficient Long-Short Temporal Attention network for unsupervised Video Object Segmentation
Li, P., Zhang, Y., Li, Y., Xiao, H., Lin, B., & Xu, X. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.110078 · Cited by 28
Sparse noise minimization in image classification using Genetic Algorithm and DenseNet
Mienye, I. D., Ainah, P. K., Emmanuel, I. D., & Esenogho, E. (2021) · Conference on Information Communications Technology and Society (ICTAS) · doi:10.1109/ictas50802.2021.9395014 · Cited by 26
Self-citationReservoir Computing Based Echo State Networks for Ventricular Heart Beat Classification
Mastoi, Q.-U.-A., Wah, T. Y., & Raj, R. G. (2019) · Applied Sciences · doi:10.3390/app9040702 · Cited by 25
Quradaa, F. H., Shahzad, S., & Almoqbily, R. S. (2024) · PLoS ONE · doi:10.1371/journal.pone.0296858 · Cited by 24
Explicit Context Integrated Recurrent Neural Network for applications in smart environments
Baruah, R. D., & Muñoz-Organero, M. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124752 · Cited by 24
Ensemble echo network with deep architecture for time-series modeling
Hu, R., Tang, Z., Song, X., Luo, J., Wu, E. Q., & Chang, S. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-05286-8 · Cited by 23
SENSDeep: An Ensemble Deep Learning Method for Protein–Protein Interaction Sites Prediction
Aybey, E., & Gümüş, Ö. (2022) · Interdisciplinary Sciences Computational Life Sciences · doi:10.1007/s12539-022-00543-x · Cited by 23
Anomaly detection in three-axis CNC machines using LSTM networks and transfer learning
Li, E., Bedi, S. S., & Melek, W. (2023) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-023-11617-5 · Cited by 23
Deep Learning: A Overview of Theory and Architectures
Shahinzadeh, H., Mahmoudi, A., Asilian, A., Sadrarhami, H., Hemmati, M., & Saberi, Y. (2024) · CSI International Symposium on Artificial Intelligence and Signal Processing · doi:10.1109/aisp61396.2024.10475265 · Cited by 23
A Hybrid Deep Learning Model to Estimate the Future Electricity Demand of Sustainable Cities
DOĞAN, G. Y., Aksoy, A., & Öztürk, N. (2024) · Sustainability · doi:10.3390/su16156503 · Cited by 23
An automatic speech recognition system for isolated Amazigh word using 1D & 2D CNN-LSTM architecture
Daouad, M., Allah, F. A., & Dadi, E. W. (2023) · International Journal of Speech Technology · doi:10.1007/s10772-023-10054-9 · Cited by 20
Effective Feature Selection for Improved Prediction of Heart Disease
Mienye, I. D., & Sun, Y. (2022) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-030-93314-2_6 · Cited by 19
Self-citationDriving Behavior Prediction Based on Combined Neural Network Model
Li, R., Shu, X., & Li, C. (2024) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2024.3350199 · Cited by 18
Liu, Y., & Diao, S. (2024) · PLoS ONE · doi:10.1371/journal.pone.0297192 · Cited by 15
Understanding Gradient Clipping In Incremental Gradient Methods.
Jiang, Q., Wu, Y., Zhuang, B., Wang, S., & Xiao, J. Z. (2021) · International Conference on Artificial Intelligence and Statistics · Cited by 14
Multi-Head Attention based Bi-LSTM for Anomaly Detection in Multivariate Time-Series of WSN
Matar, M., Xia, T., Huguenard, K. D., Huston, D. R., & Wshah, S. (2023) · IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS) · doi:10.1109/aicas57966.2023.10168670 · Cited by 14
Performance Evaluation of Recurrent Neural Networks-LSTM and GRU for Automatic Speech Recognition
Kumar, D., & Aziz, S. (2023) · International Conference on Computer, Electronics & Electrical Engineering & their Applications (IC2E3) · doi:10.1109/ic2e357697.2023.10262561 · Cited by 14
Arabic Text Generation Using Recurrent Neural Networks
Souri, A., Maazouzi, Z. E., Achhab, M. A., & Mohajir, B. E. E. (2018) · Communications in computer and information science · doi:10.1007/978-3-319-96292-4_41 · Cited by 11
When Is It Likely to Fail? Performance Monitor for Black-Box Trajectory Prediction Model
Shao, W., Li, B., Yu, W., Xu, J., & Wang, H. (2024) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2024.3356070 · Cited by 10
Variational Auto-Encoder for text generation
Hu, H., Liao, M., Mao, W., Liu, W. Y., Zhang, C., & Jing, Y. (2020) · IEEE Information Technology and Mechatronics Engineering Conference (ITOEC) · doi:10.1109/itoec49072.2020.9141571 · Cited by 9
Decoupling Deep Learning for Enhanced Image Recognition Interpretability
Peng, Y., He, L., Hu, D., Liu, Y., Yang, L., & Shang, S. (2024) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3674837 · Cited by 8
Jacobs, W. R., Kadirkamanathan, V., & Anderson, S. (2024) · IEEE Access · doi:10.1109/access.2024.3353369 · Cited by 7
DAT-RNN: Trajectory Prediction with Diverse Attention
Li, Z., Du, X., & Cao, Y. K. (2020) · International Conference on Machine Learning and Applications · doi:10.1109/icmla51294.2020.00233 · Cited by 2
Cited by
Fahim, Y. A., Hasani, I. W., Kabba, S., & Ragab, W. M. (2025) · European Journal of Medical Research · doi:10.1186/s40001-025-03196-w · Cited by 329
Mienye, I. D., Obaido, G., Jere, N., Mienye, E., Aruleba, K., Emmanuel, I. D., & Ogbuokiri, B. (2024) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2024.101587 · Cited by 212
Self-citationDini, P., & Paolini, D. (2025) · Batteries · doi:10.3390/batteries11030107 · Cited by 40
A Hybrid Modeling Framework for Predictive Digital Twins of CHO Cell Culture
Richelle, A., Andersson, D., Antonakoudis, A., Jakobsson, J., Pijeaud, S., Vernersson, A., & Trygg, J. (2025) · doi:10.1101/2025.11.24.690194 · Cited by 6
Metadata
- Authors
- Mienye, I. D., Swart, T. G., & Obaido, G.
- Venue
- Information
- Publisher
- MDPI AG
- Published
- 2024-08-25
- Volume
- 15
- Issue
- 9
- Pages
- 517
- ISSN
- 2078-2489 (ISSN-L)
- OpenAlex
- W4401889742
- Cited by
- 732
- References
- 155
- FWCI
- 108.94
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.