The DOI matches its Crossref record; 96 of the 96 references it cites were found in a registry or an index.
A critical review of RNN and LSTM variants in hydrological time series predictions
Open accessAbstract
The rapid advancement in Artificial Intelligence (AI) and big data has developed significance in the water sector, particularly in hydrological time-series predictions. Recurrent Neural Networks (RNNs) and Long Short-Term Memory (LSTM) networks have become research focal points due to their effectiveness in modeling non-linear, time-variant hydrological systems. This review explores the different architectures of RNNs, LSTMs, and Gated Recurrent Units (GRUs) and their efficacy in predicting hydrological time-series data.•RNNs are foundational but face limitations such as vanishing gradients, which impede their ability to model long-term dependencies. LSTMs and GRUs have been developed to overcome these limitations, with LSTMs using memory cells and gating mechanisms, while GRUs provide a more streamlined architecture with similar benefits.•The integration of attention mechanisms and hybrid models that combine RNNs, LSTMs, and GRUs with other Machine learning (ML) and Deep Learning (DL) has improved prediction accuracy by capturing both temporal and spatial dependencies.•Despite their effectiveness, practical implementations of these models in hydrological time series prediction require extensive datasets and substantial computational resources. Future research should develop interpretable architectures, enhance data quality, incorporate domain knowledge, and utilize transfer learning to improve model generalization and scalability across diverse hydrological contexts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
Bidirectional recurrent neural networks
Schuster, M., & Paliwal, K. K. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.650093 · Cited by 10,172
Learning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542
Greff, K., Srivastava, R. K., Koutnik, J., Steunebrink, B. R., & Schmidhuber, J. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2582924 · Cited by 6,955
Recent advances in convolutional neural networks
Gu, J., Wang, Z., Kuen, J., Ma, L., Shahroudy, A., Shuai, B., Liu, T., Wang, X., Wang, G., Cai, J., et al. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.013 · Cited by 6,576
Framewise phoneme classification with bidirectional LSTM and other neural network architectures
Graves, A., & Schmidhuber, J. (2005) · Neural Networks · doi:10.1016/j.neunet.2005.06.042 · Cited by 5,839
A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects
Li, Z., Liu, F., Yang, W., Peng, S., & Zhou, J. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3084827 · Cited by 5,273
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215
Deep learning applications and challenges in big data analytics
Najafabadi, M. M., Villanustre, F., Khoshgoftaar, T. M., Seliya, N., Wald, R., & Muharemagic, E. (2015) · Journal of Big Data · doi:10.1186/s40537-014-0007-7 · Cited by 2,594
Rainfall–runoff modelling using Long Short-Term Memory (LSTM) networks
(2018) · doi:10.5194/hess-22-6005-2018 · Cited by 2,114
Review on Convolutional Neural Networks (CNN) in vegetation remote sensing
Kattenborn, T., Leitloff, J., Schiefer, F., & Hinz, S. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.12.010 · Cited by 1,805
Deep Neural Networks for Object Detection
Szegedy, C., Toshev, A., & Erhan, D. (2013) · neural information processing systems · Cited by 1,663
Introduction to multi-layer feed-forward neural networks
Svozil, D., Kvasnicka, V., & Pospichal, J. (1997) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/s0169-7439(97)00061-0 · Cited by 1,600
Explaining Deep Neural Networks and Beyond: A Review of Methods and Applications
Samek, W., Montavon, G., Lapuschkin, S., Anders, C. J., & Muller, K.-R. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3060483 · Cited by 1,477
Recurrent Neural Networks for Time Series Forecasting: Current status and future directions
Hewamalage, H., Bergmeir, C., & Bandara, K. (2021) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2020.06.008 · Cited by 1,371
Exploring Strategies for Training Deep Neural Networks
Larochelle, H., Bengio, Y., Louradour, J., & Lamblin, P. (2009) · doi:10.1145/1577069.1577070 · Cited by 1,095
Application of Long Short-Term Memory (LSTM) Neural Network for Flood Forecasting
Le, X.-H., Ho, H. V., Lee, G., & Jung, S. (2019) · Water · doi:10.3390/w11071387 · Cited by 889
LSTM can Solve Hard Long Time Lag Problems
Hochreiter, S., & Schmidhuber, J. (1996) · Cited by 861
A Rainfall‐Runoff Model With LSTM‐Based Sequence‐to‐Sequence Learning
Xiang, Z., Yan, J., & Demir, I. (2020) · Water Resources Research · doi:10.1029/2019wr025326 · Cited by 768
Bebis, G., & Georgiopoulos, M. (1994) · IEEE Potentials · doi:10.1109/45.329294 · Cited by 746
Gao, S., Huang, Y., Zhang, S., Han, J., Wang, G., Zhang, M., & Lin, Q. (2020) · Journal of Hydrology · doi:10.1016/j.jhydrol.2020.125188 · Cited by 691
Aslam, S., Herodotou, H., Mohsin, S. M., Javaid, N., Ashraf, N., & Aslam, S. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2021.110992 · Cited by 649
A comprehensive review of deep learning applications in hydrology and water resources
Sit, M., Demiray, B. Z., Xiang, Z., Ewing, G. J., Sermet, Y., & Demir, I. (2020) · Water Science and Technology · doi:10.2166/wst.2020.369 · Cited by 618
Deep Learning with a Long Short-Term Memory Networks Approach for Rainfall-Runoff Simulation
Hu, C., Wu, Q., Li, H., Jian, S., Li, N., & Lou, Z. (2018) · Water · doi:10.3390/w10111543 · Cited by 614
Grossberg, S. (2013) · Scholarpedia · doi:10.4249/scholarpedia.1888 · Cited by 602
Short-term water quality variable prediction using a hybrid CNN–LSTM deep learning model
Barzegar, R., Aalami, M. T., & Adamowski, J. (2020) · Stochastic Environmental Research and Risk Assessment · doi:10.1007/s00477-020-01776-2 · Cited by 575
Dropout vs. batch normalization: an empirical study of their impact to deep learning
Garbin, C., Zhu, X., & Marques, O. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-019-08453-9 · Cited by 571
Recurrent neural networks: design and applications
Stoianov, I. (1999) · Cited by 446
A review of irregular time series data handling with gated recurrent neural networks
Weerakody, P. B., Wong, K. W., Wang, G., & Ela, W. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.02.046 · Cited by 433
Kao, I.-F., Zhou, Y., Chang, L.-C., & Chang, F.-J. (2020) · Journal of Hydrology · doi:10.1016/j.jhydrol.2020.124631 · Cited by 410
LSTM based long-term energy consumption prediction with periodicity
Wang, J. Q., Du, Y., & Wang, J. (2020) · Energy · doi:10.1016/j.energy.2020.117197 · Cited by 410
2013 IEEE Workshop on Automatic Speech Recognition and Understanding
(2013) · doi:10.1109/asru31144.2013 · Cited by 402
Deep learning for load forecasting with smart meter data: Online Adaptive Recurrent Neural Network
Fekri, M. N., Patel, H., Grolinger, K., & Sharma, V. (2021) · Applied Energy · doi:10.1016/j.apenergy.2020.116177 · Cited by 382
Analysis and Prediction of Water Quality Using LSTM Deep Neural Networks in IoT Environment
Liu, P., Wang, J., Sangaiah, A. K., Xie, Y., & Yin, X. (2019) · Sustainability · doi:10.3390/su11072058 · Cited by 369
Proceedings of the 23rd ACM international conference on Multimedia
(2015) · doi:10.1145/2733373 · Cited by 367
Rainfall–runoff modeling using artificial neural network coupled with singular spectrum analysis
Wu, C. L., & Chau, K. W. (2011) · Journal of Hydrology · doi:10.1016/j.jhydrol.2011.01.017 · Cited by 360
Streamflow and rainfall forecasting by two long short-term memory-based models
Ni, L., Wang, D., Singh, V. P., Wu, J., Wang, Y., Tao, Y., & Zhang, J. (2020) · Journal of Hydrology · doi:10.1016/j.jhydrol.2019.124296 · Cited by 360
Study and analysis of SARIMA and LSTM in forecasting time series data
Kumar Dubey, A., Kumar, A., García-Díaz, V., Kumar Sharma, A., & Kanhaiya, K. (2021) · Sustainable Energy Technologies and Assessments · doi:10.1016/j.seta.2021.101474 · Cited by 357
Sahoo, B. B., Jha, R., Singh, A., & Kumar, D. (2019) · Acta Geophysica · doi:10.1007/s11600-019-00330-1 · Cited by 339
Improving time series forecasting using LSTM and attention models
Abbasimehr, H., & Paki, R. (2022) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-020-02761-x · Cited by 312
Himeur, Y., Rimal, B., Tiwary, A., & Amira, A. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.06.003 · Cited by 288
ArunKumar, K. E., Kalaga, D. V., Mohan Sai Kumar, C., Kawaji, M., & Brenza, T. M. (2022) · Alexandria Engineering Journal · doi:10.1016/j.aej.2022.01.011 · Cited by 287
Yang, S., Yang, D., Chen, J., & Zhao, B. (2019) · Journal of Hydrology · doi:10.1016/j.jhydrol.2019.124229 · Cited by 219
Handling data irregularities in classification: Foundations, trends, and future challenges
Das, S., Datta, S., & Chaudhuri, B. B. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.03.008 · Cited by 216
Hu, Z., Zhang, Y., Zhao, Y., Xie, M., Zhong, J., Tu, Z., & Liu, J. (2019) · Sensors · doi:10.3390/s19061420 · Cited by 211
Yao, Z., Wang, Z., Wang, D., Wu, J., & Chen, L. (2023) · Journal of Hydrology · doi:10.1016/j.jhydrol.2023.129977 · Cited by 203
Deep learning, explained: Fundamentals, explainability, and bridgeability to process-based modelling
Razavi, S. (2021) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2021.105159 · Cited by 201
Motion trajectory prediction based on a CNN-LSTM sequential model
Xie, G., Shangguan, A., Fei, R., Ji, W., Ma, W., & Hei, X. (2020) · Science China Information Sciences · doi:10.1007/s11432-019-2761-y · Cited by 194
Convolutional Tensor-Train LSTM for Spatio-temporal LearningPreprint
Su, J., Byeon, W., Kossaifi, J., Huang, F., Kautz, J., & Anandkumar, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.09131 · Cited by 183
Caterini, A. L., & Chang, D. E. (2018) · SpringerBriefs in computer science · doi:10.1007/978-3-319-75304-1_5 · Cited by 176
High temporal resolution rainfall–runoff modeling using long-short-term-memory (LSTM) networks
Li, W., Kiaghadi, A., & Dawson, C. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-05010-6 · Cited by 173
Holistic LSTM for Pedestrian Trajectory Prediction
Quan, R., Zhu, L., Wu, Y., & Yang, Y. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3058599 · Cited by 172
Comparing LSTM and GRU Models to Predict the Condition of a Pulp Paper Press
Mateus, B. C., Mendes, M., Farinha, J. T., Assis, R., & Cardoso, A. J. M. (2021) · Energies · doi:10.3390/en14216958 · Cited by 171
Using a stacked residual LSTM model for sentiment intensity prediction
Wang, J., Peng, B., & Zhang, X. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.09.049 · Cited by 170
Dehghani, A., Moazam, H. M. Z. H., Mortazavizadeh, F., Ranjbar, V., Mirzaei, M., Mortezavi, S., Ng, J. L., & Dehghani, A. (2023) · Ecological Informatics · doi:10.1016/j.ecoinf.2023.102119 · Cited by 167
Pedestrian Trajectory Prediction Based on Deep Convolutional LSTM Network
Song, X., Chen, K., Li, X., Sun, J., Hou, B., Cui, Y. J., Zhang, B., Xiong, G., & Wang, Z. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.2981118 · Cited by 165
Deep Neural Network for Robust Modulation Classification Under Uncertain Noise Conditions
Hu, S., Pei, Y., Liang, P. P., & Liang, Y. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2951594 · Cited by 160
Pham, B. T., Luu, C., Phong, T. V., Trịnh, P. T., Shirzadi, A., Renoud, S., Asadi, S., Le, H. V., von Meding, J. K., & Clague, J. J. (2020) · Journal of Hydrology · doi:10.1016/j.jhydrol.2020.125615 · Cited by 155
Deep BLSTM-GRU Model for Monthly Rainfall Prediction: A Case Study of Simtokha, Bhutan
Chhetri, M., Kumar, S., Roy, P. P., & Kim, B. (2020) · Remote Sensing · doi:10.3390/rs12193174 · Cited by 149
Deep Learning (CNN, RNN) Applications for Smart Homes: A Systematic Review
Yu, J., de Antonio, A., & Villalba‐Mora, E. (2022) · Computers · doi:10.3390/computers11020026 · Cited by 120
Zhang, W., Zhou, H., Bao, X., & Cui, H. (2022) · Energy · doi:10.1016/j.energy.2022.126190 · Cited by 117
Waqas, M., Humphries, U. W., Wangwongchai, A., Dechpichai, P., & Ahmad, S. (2023) · Water · doi:10.3390/w15162979 · Cited by 116
Self-citationJaiswal, G., Rani, R., Mangotra, H., & Sharma, A. (2023) · Computer Science Review · doi:10.1016/j.cosrev.2023.100584 · Cited by 106
Rainfall-runoff modeling using long short-term memory based step-sequence framework
Yin, H., Wang, F., Zhang, X., Zhang, Y., Chen, J., Xia, R., & Jin, J. (2022) · Journal of Hydrology · doi:10.1016/j.jhydrol.2022.127901 · Cited by 96
Combining audio and visual speech recognition using LSTM and deep convolutional neural network
Shashidhar, R., Patilkulkarni, S., & Puneeth, S. B. (2022) · International Journal of Information Technology · doi:10.1007/s41870-022-00907-y · Cited by 90
Johny, K., Pai, M. L., & Adarsh, S. (2022) · Applied Soft Computing · doi:10.1016/j.asoc.2022.108941 · Cited by 72
Wangwongchai, A., Waqas, M., Dechpichai, P., Hlaing, P. T., Ahmad, S., & Humphries, U. W. (2023) · MethodsX · doi:10.1016/j.mex.2023.102459 · Cited by 69
Self-citationWang, Q., Huang, J. H., Liu, R., Men, C., Guo, L., Miao, Y., Jiao, L., Wang, Y., Shoaib, M., & Xia, X. (2020) · Journal of Hydrology · doi:10.1016/j.jhydrol.2020.124875 · Cited by 67
Vehicle trajectory prediction and generation using LSTM models and GANs
Rossi, L., Ajmar, A., Paolanti, M., & Pierdicca, R. (2021) · PLoS ONE · doi:10.1371/journal.pone.0253868 · Cited by 66
Wongburi, P., & Park, J. K. (2023) · Water · doi:10.3390/w15193325 · Cited by 63
Waqas, M., Humphries, U. W., Hlaing, P. T., Wangwongchai, A., & Dechpichai, P. (2024) · MethodsX · doi:10.1016/j.mex.2024.102757 · Cited by 62
Self-citationMa, M., Liu, C., Wei, R., Liang, B., & Dai, J. (2022) · Journal of Applied Clinical Medical Physics · doi:10.1002/acm2.13558 · Cited by 60
Multi-step ahead wind power forecasting based on dual-attention mechanism
Aslam, M., Kim, J., & Jung, J. (2022) · Energy Reports · doi:10.1016/j.egyr.2022.11.167 · Cited by 57
LSTM model for visual speech recognition through facial expressions
Bhaskar, S., & Thasleema, T. M. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-12796-1 · Cited by 53
Liu, Y., Wang, H., Feng, W., & Huang, H. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18179287 · Cited by 52
A combined deep CNN-RNN network for rainfall-runoff modelling in Bardha Watershed, India
Shekar, P. R., Mathew, A., Yeswanth, P. V., & Deivalakshmi, S. (2024) · Artificial Intelligence in Geosciences · doi:10.1016/j.aiig.2024.100073 · Cited by 48
Tabas, S. S., & Samadi, S. (2022) · Environmental Research Letters · doi:10.1088/1748-9326/ac7247 · Cited by 42
A novel privacy-preserving speech recognition framework using bidirectional LSTM
Wang, Q., Feng, C., Xu, Y., Zhong, H., & Sheng, V. S. (2020) · Journal of Cloud Computing Advances Systems and Applications · doi:10.1186/s13677-020-00186-7 · Cited by 41
Niknam, A. R. R., Sabaghzadeh, M., Barzkar, A., & Shishebori, D. (2024) · Environmental Science and Pollution Research · doi:10.1007/s11356-024-32228-x · Cited by 41
Applying deep neural networks to predict incidence and phenology of plant pests and diseases
Grünig, M., Razavi, E., Calanca, P., Mazzi, D., Wegner, J. D., & Pellissier, L. (2021) · Ecosphere · doi:10.1002/ecs2.3791 · Cited by 39
Time-Series Power Forecasting for Wind and Solar Energy Based on the SL-Transformer
Zhu, J., Zhao, Z., Zheng, X., An, Z., Guo, Q., Li, Z., Sun, J., & Guo, Y. (2023) · Energies · doi:10.3390/en16227610 · Cited by 33
Agbinya, J. I. (2022) · River Publishers eBooks · doi:10.1201/9781003337225-10 · Cited by 32
An LSTM-based neural network method of particulate pollution forecast in China
Chen, Y., Cui, S., Chen, P., Yuan, Q., Kang, P., & Zhu, L. (2021) · Environmental Research Letters · doi:10.1088/1748-9326/abe1f5 · Cited by 29
Li, J., Chen, Z., Li, X., Yi, X., Zhao, Y., He, X., Huang, Z., Hassaan, M. A., Nemr, A. E., & Huang, M. (2022) · Frontiers of Environmental Science & Engineering · doi:10.1007/s11783-023-1667-3 · Cited by 28
A deep learning perspective on meteorological droughts prediction in the Mun River Basin, Thailand
Humphries, U. W., Waqas, M., Hliang, P. T., Dechpichai, P., & Wangwongchai, A. (2024) · AIP Advances · doi:10.1063/5.0209709 · Cited by 26
Self-citationBias learning improves data driven models for streamflow prediction
Lin, Y., Wang, D., Meng, Y., Sun, W., Qiu, J., Shangguan, W., Cai, J., Kim, Y., & Dai, Y. (2023) · Journal of Hydrology Regional Studies · doi:10.1016/j.ejrh.2023.101557 · Cited by 24
Incorporating novel input variable selection method for in the different water basins of Thailand
Waqas, M., Humphries, U. W., Wangwongchai, A., Dechpichai, P., Zarin, R., & Hlaing, P. T. (2023) · Alexandria Engineering Journal · doi:10.1016/j.aej.2023.11.046 · Cited by 22
Self-citationSelective Recurrent Neural Network
Šter, B. (2012) · Neural Processing Letters · doi:10.1007/s11063-012-9259-4 · Cited by 18
Wang, Q., Liu, Y., Yue, Q., Zheng, Y., Yao, X., & Yu, J. (2020) · Water · doi:10.3390/w12123532 · Cited by 18
Özdemir, S., & Özkan, S. (2023) · Sustainability · doi:10.3390/su152216008 · Cited by 18
Recurrent neural networks for rainfall-runoff modeling of small Amazon catchments
de Mendonça, L. M., Blanco, C. J. C., & Carvalho, F. D. O. (2022) · Modeling Earth Systems and Environment · doi:10.1007/s40808-022-01626-w · Cited by 14
Peng, X., & Li, Y. (2021) · Journal of Electrochemical Energy Conversion and Storage · doi:10.1115/1.4052093 · Cited by 7
Unsupervised hybrid anomaly detection model for logistics fleet management systems
Phiboonbanakit, T., Huynh, V., Horanont, T., & Supnithi, T. (2019) · IET Intelligent Transport Systems · doi:10.1049/iet-its.2019.0167 · Cited by 5
Cited by
Anomaly Detection Method Considering PLC Control Logic Structure for ICS Cyber Threat Detection
Lee, J. H., Ji, I. H., Jeon, S. H., & Seo, J. T. (2025) · Applied Sciences · doi:10.3390/app15073507 · Cited by 5
Metadata
- Authors
- Waqas, M., & Humphries, U. W.
- Venue
- MethodsX
- Publisher
- Elsevier BV
- Published
- 2024-12
- Volume
- 13
- Pages
- 102946
- ISSN
- 2215-0161 (ISSN-L)
- OpenAlex
- W4402469109
- Cited by
- 354
- References
- 96
- FWCI
- 41.73
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.