The DOI matches its Crossref record; 88 of the 88 references it cites were found in a registry or an index.
Time-series forecasting with deep learning: a survey
Open accessAbstract
Numerous deep learning architectures have been developed to accommodate the diversity of time-series datasets across different domains. In this article, we survey common encoder and decoder designs used in both one-step-ahead and multi-horizon time-series forecasting—describing how temporal information is incorporated into predictions by each model. Next, we highlight recent developments in hybrid deep learning models, which combine well-studied statistical models with neural network components to improve pure methods in either category. Lastly, we outline some ways in which deep learning can also facilitate decision support with time-series data. This article is part of the theme issue ‘Machine learning for weather and climate modelling’.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
A New Approach to Linear Filtering and Prediction Problems
Kalman, R. E. (1960) · Journal of Basic Engineering · doi:10.1115/1.3662552 · Cited by 31,751
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545 · cited 1×
“The development of attention mechanisms [47,48] has also led to improvements in long-term dependency learning—with transformer architectures achieving state-of-the-art performance in multiple natural language processing applications [12,49,50].”
BackgroundA Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707
Time Series Analysis: Forecasting and Control
Geurts, M., Box, G. E. P., & Jenkins, G. M. (1977) · Journal of Marketing Research · doi:10.2307/3150485 · Cited by 19,186
Research works printed but not linked: 7
- 10.1111/j.1467-9892.2012.00805.x · DOI
- Wan E. 1994 Time series prediction by using a connectionist network with internal delay lines. In Time Series Prediction pp. 195–217. Boston MA: Addison-Wesley.
- Li Y Yu R Shahabi C Liu Y. 2018 Diffusion convolutional recurrent neural network: data-driven traffic forecasting. In Proc. of the Int. Conf. on Learning Representations ICLR Vancouver Canada 30 April–3 May 2018 .
- Salinas D Bohlke-Schneider M Callot L Medico R Gasthaus J. 2019 High-dimensional multivariate forecasting with low-rank gaussian copula processes. In Advances in Neural Information Processing Systems (NeurIPS) Vancouver Canada 8–14 December 2019 .
- Choi E Bahadori MT Sun J Kulas JA Schuetz A Stewart WF. 2016 RETAIN: an interpretable predictive model for healthcare using reverse time attention mechanism. In Advances in Neural Information Processing Systems (NIPS) Barcelona Spain 5–10 December 2016 .
- Lim B Alaa A van der Schaar M. 2018 Forecasting treatment responses over time using recurrent marginal structural networks. In NeurIPS .
- 10.1016/j.ijforecast.2019.02.013 · doi:10.1016/j.ijforecast.2019.02.013
Cited by
Transformers in Time Series: A Survey
Wen, Q., Zhou, T., Zhang, C., Chen, W., Ma, Z., Yan, J., & Sun, L. (2023) · Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/759 · Cited by 1,260
Jin, M., Koh, H. Y., Wen, Q., Zambon, D., Alippi, C., Webb, G. I., King, I., & Pan, S. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3443141 · Cited by 567
Nguyen, H. D., Tran, K. P., Thomassey, S., & Hamad, M. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2020.102282 · Cited by 494
Deep Learning for Time Series Forecasting: Tutorial and Literature Survey
Benidis, K., Rangapuram, S. S., Flunkert, V., Wang, Y., Maddix, D., Turkmen, C., Gasthaus, J., Bohlke-Schneider, M., Salinas, D., Stella, L., et al. (2023) · ACM Computing Surveys · doi:10.1145/3533382 · Cited by 382
Machine learning and deep learning based predictive quality in manufacturing: a systematic review
Tercan, H., & Meisen, T. (2022) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-022-01963-8 · Cited by 376
Signal propagation in complex networks
Ji, P., Ye, J., Mu, Y., Lin, W., Tian, Y., Hens, C., Perc, M., Tang, Y., Sun, J., & Kurths, J. (2023) · Physics Reports · doi:10.1016/j.physrep.2023.03.005 · Cited by 360
Data Augmentation techniques in time series domain: a survey and taxonomy
Iglesias, G., Talavera, E., González-Prieto, Á., Mozo, A., & Gómez-Canaval, S. (2023) · Neural Computing and Applications · doi:10.1007/s00521-023-08459-3 · Cited by 347
“Previous works were centred on a specific model or approximation, with works such as [16, 21, 22].”
MethodIs Mamba effective for time series forecasting?
Wang, Z., Kong, F., Feng, S., Wang, M., Yang, X., Zhao, H., Wang, D., & Zhang, Y. (2025) · Neurocomputing · doi:10.1016/j.neucom.2024.129178 · Cited by 284
Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospects
Zhang, K., Wen, Q., Zhang, C., Cai, R., Jin, M., Liu, Y., Zhang, J. Y., Liang, Y., Pang, G., Song, D., et al. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3387317 · Cited by 295
“The first category focuses on different tasks, such as classification [37], [38], forecasting [39], [40], [41], [42], and anomaly detection [43], [44].”
BackgroundUsing artificial intelligence to improve public health: a narrative review
Olawade, D. B., Wada, O. J., David-Olawade, A. C., Kunonga, E., Abaire, O., & Ling, J. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1196397 · Cited by 274
Kim, J., Kim, H., Kim, H., Lee, D., & Yoon, S. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11223-9 · Cited by 263
LLM4TS: Aligning Pre-Trained LLMs as Data-Efficient Time-Series Forecasters
Chang, C., Wang, W.-Y., Peng, W.-C., & Chen, T.-F. (2023) · arXiv · doi:10.48550/arxiv.2308.08469 · Cited by 146
TimeCLR: A self-supervised contrastive learning framework for univariate time series representation
Yang, X., Zhang, Z., & Cui, R. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108606 · Cited by 114
Small perturbations are enough: Adversarial attacks on time series prediction
Wu, T., Wang, X., Qiao, S., Xian, X., Liu, Y., & Zhang, L. (2022) · Information Sciences · doi:10.1016/j.ins.2021.11.007 · Cited by 72
Deep learning-based algorithms for long-term prediction of chlorophyll-a in catchment streams
Abbas, A., Park, M., Baek, S.-S., & Cho, K. H. (2023) · Journal of Hydrology · doi:10.1016/j.jhydrol.2023.130240 · Cited by 63
Yeh, Y.-C., Syed, T., Brinitzer, G., Frick, K., Schmid-Staiger, U., Haasdonk, B., Tovar, G. E. M., Krujatz, F., Mädler, J., & Urbas, L. (2023) · Bioresource Technology · doi:10.1016/j.biortech.2023.129882 · Cited by 56
Marvasti, T. B., Gao, Y., Murray, K. R., Hershman, S., McIntosh, C., & Moayedi, Y. (2024) · Canadian Journal of Cardiology · doi:10.1016/j.cjca.2024.07.009 · Cited by 35
ACT: Adversarial Convolutional Transformer for Time Series Forecasting
Li, Y., Wang, H., Li, J., Liu, C., & Tan, J. (2022) · 2022 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892791 · Cited by 19
“Transformer-based methods [18] have recently become the mainstream methods for solving time series problems, owing to the attention mechanism [19].”
Method(2023) · doi:10.1145/3583780.3615155 · Cited by 19
Ayad, A., Hallawa, A., Peine, A., Martin, L., Fazlic, L. B., Dartmann, G., Marx, G., & Schmeink, A. (2022) · JMIR Medical Informatics · doi:10.2196/37658 · Cited by 14
Modern Machine Learning Methods for Time Series Analysis
Huang, C., & Petukhina, A. (2022) · Statistics and Computing · doi:10.1007/978-3-031-13584-2_10 · Cited by 2
Metadata
- Authors
- Lim, B., & Zohren, S.
- Venue
- Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences
- Publisher
- The Royal Society
- Published
- 2021-02-15
- Volume
- 379
- Issue
- 2194
- Pages
- 20200209
- ISSN
- 1364-503X (ISSN-L)
- 1471-2962
- OpenAlex
- W3022643593
- Cited by
- 1,787
- References
- 88
- FWCI
- 110.34
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- royalsociety.org/journals/ethics-policies/data-sharing-mining/ (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.