Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 178

The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.

Deep Learning for Time Series Forecasting: Advances and Open Problems

Open access
Casolaro, Angelo, Capone, Vincenzo, Iannuzzo, Gennaro, Camastra, Francesco · 2023 · Information

Abstract

A time series is a sequence of time-ordered data, and it is generally used to describe how a phenomenon evolves over time. Time series forecasting, estimating future values of time series, allows the implementation of decision-making strategies. Deep learning, the currently leading field of machine learning, applied to time series forecasting can cope with complex and high-dimensional time series that cannot be usually handled by other machine learning techniques. The aim of the work is to provide a review of state-of-the-art deep learning architectures for time series forecasting, underline recent advances and open problems, and also pay attention to benchmark data sets. Moreover, the work presents a clear distinction between deep learning architectures that are suitable for short-term and long-term forecasting. With respect to existing literature, the major advantage of the work consists in describing the most recent architectures for time series forecasting, such as Graph Neural Networks, Deep Gaussian Processes, Generative Adversarial Networks, Diffusion Models, and Transformers.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/info14110598

Cites

21 of 21 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 21 references

Research works printed but not linked: 190

  1. Chianese, 2019, Spatio-temporal learning in predicting ambient particulate matter concentration by multi-layer perceptron, Ecol. Inform., 49, 54, 10.1016/j.ecoinf.2018.12.001 · DOI
  2. Feng, 2011, Ozone concentration forecast method based on genetic algorithm optimized back propagation neural networks and support vector machine data classification, Atmos. Environ., 45, 1979, 10.1016/j.atmosenv.2011.01.022 · DOI
  3. Paine, 2012, How to fit nonlinear plant growth models and calculate growth rates: An update for ecologists, Methods Ecol. Evol., 3, 245, 10.1111/j.2041-210X.2011.00155.x · DOI · Paper page
  4. Pala, 2019, Forecasting sunspot time series using deep learning methods, Sol. Phys., 294, 50, 10.1007/s11207-019-1434-6 · DOI
  5. Duarte, 2010, Dynamics of the Dow Jones and the NASDAQ stock indexes, Nonlinear Dyn., 61, 691, 10.1007/s11071-010-9680-z · DOI
  6. Binkowski, M., Marti, G., and Donnat, P. (2018, January 10–15). Autoregressive convolutional neural networks for asynchronous time series. Proceedings of the International Conference on Machine Learning, Stockholm, Sweden.
  7. Ugurlu, U., Oksuz, I., and Tas, O. (2018). Electricity price forecasting using recurrent neural networks. Energies, 11. · doi:10.20944/preprints201804.0286.v1
  8. Kuan, L., Yan, Z., Xin, W., Yan, C., Xiangkun, P., Wenxue, S., Zhe, J., Yong, Z., Nan, X., and Xin, Z. (2017, January 26–28). Short-term electricity load forecasting method based on multilayered self-normalising GRU network. Proceedings of the 2017 IEEE Conference on Energy Internet and Energy System Integration (EI2), Beijing, China. · DOI
  9. Zhu, 2020, Short-term prediction for wind power based on temporal convolutional network, Energy Rep., 6, 424, 10.1016/j.egyr.2020.11.219 · doi:10.1016/j.egyr.2020.11.219
  10. Koprinska, I., Wu, D., and Wang, Z. (2018, January 8–13). Convolutional neural networks for energy time series forecasting. Proceedings of the 2018 International Joint Conference on Neural Networks (IJCNN), Rio de Janeiro, Brazil. · DOI · Paper page
  11. Li, 2022, Multi-step-ahead wind speed forecasting based on a hybrid decomposition method and temporal convolutional networks, Energy, 238, 121981, 10.1016/j.energy.2021.121981 · DOI
  12. Narigina, 2013, Machine Learning-based Forecasting of Sensor Data for Enhanced Environmental Sensing, Wseas Trans. Syst., 22, 543, 10.37394/23202.2023.22.55 · doi:10.37394/23202.2023.22.55
  13. Han, 2017, Laplacian echo state network for multivariate time series prediction, IEEE Trans. Neural Netw. Learn. Syst., 29, 238, 10.1109/TNNLS.2016.2574963 · DOI
  14. Kumar, 2019, Forecasting monthly precipitation using sequential modelling, Hydrol. Sci. J., 64, 690, 10.1080/02626667.2019.1595624 · DOI
  15. Wan, R., Mei, S., Wang, J., Liu, M., and Yang, F. (2019). Multivariate temporal convolutional network: A deep neural networks approach for multivariate time series forecasting. Electronics, 8. · DOI · Paper page
  16. Liu, 2021, AQI time series prediction based on a hybrid data decomposition and echo state networks, Environ. Sci. Pollut. Res., 28, 51160, 10.1007/s11356-021-14186-w · DOI
  17. Akita, R., Yoshihara, A., Matsubara, T., and Uehara, K. (2016, January 26–29). Deep learning for stock prediction using numerical and textual information. Proceedings of the 2016 IEEE/ACIS 15th International Conference on Computer and Information Science (ICIS), Okayama, Japan. · DOI · Paper page
  18. Pang, 2020, An innovative neural network approach for stock market prediction, J. Supercomput., 76, 2098, 10.1007/s11227-017-2228-y · DOI · Paper page
  19. Zhang, L., Aggarwal, C., and Qi, G.J. (2017, January 13–17). Stock price prediction via discovering multi-frequency trading patterns. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada. · DOI · Paper page
  20. McNally, S., Roche, J., and Caton, S. (2018, January 21–23). Predicting the price of bitcoin using machine learning. Proceedings of the 2018 26th Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP), Cambridge, UK. · DOI · Paper page
  21. Ye, J., Liu, Z., Du, B., Sun, L., Li, W., Fu, Y., and Xiong, H. (2022, January 14–18). Learning the evolutionary and multi-scale graph structure for multivariate time series forecasting. Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Washington, DC, USA. · DOI
  22. Chen, 2023, Multi-Scale Adaptive Graph Neural Network for Multivariate Time Series Forecasting, IEEE Trans. Knowl. Data Eng., 35, 10748, 10.1109/TKDE.2023.3268199 · DOI · Paper page
  23. Song, 2020, Distributed attention-based temporal convolutional network for remaining useful life prediction, IEEE Internet Things J., 8, 9594, 10.1109/JIOT.2020.3004452 · DOI · Paper page
  24. Alhassan, Z., McGough, A.S., Alshammari, R., Daghstani, T., Budgen, D., and Al Moubayed, N. (2018, January 4–7). Type-2 diabetes mellitus diagnosis from time series clinical data using deep learning models. Proceedings of the Artificial Neural Networks and Machine Learning–ICANN 2018: 27th International Conference on Artificial Neural Networks, Rhodes, Greece. Proceedings, Part III 27. · DOI
  25. Kim, 2020, Time series prediction using deep echo state networks, Neural Comput. Appl., 32, 17769, 10.1007/s00521-020-04948-x · DOI
  26. Lim, B. (2018). Forecasting treatment responses over time using recurrent marginal structural networks. Adv. Neural Inf. Process. Syst., 31.
  27. Huang, S., Wang, D., Wu, X., and Tang, A. (2019, January 3–7). Dsanet: Dual self-attention network for multivariate time series forecasting. Proceedings of the 28th ACM International Conference on Information and Knowledge Management, Beijing, China. · DOI · Paper page
  28. Wu, Z., Pan, S., Long, G., Jiang, J., Chang, X., and Zhang, C. (2020, January 6–10). Connecting the dots: Multivariate time series forecasting with graph neural networks. Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Virtual. · DOI · Paper page
  29. Cui, 2021, METRO: A generic graph neural network framework for multivariate time series forecasting, Proc. Vldb Endow., 15, 224, 10.14778/3489496.3489503 · DOI
  30. Zhao, 2019, Deep temporal convolutional networks for short-term traffic flow forecasting, IEEE Access, 7, 114496, 10.1109/ACCESS.2019.2935504 · DOI · Paper page
  31. Sagheer, 2019, Time series forecasting of petroleum production using deep LSTM recurrent networks, Neurocomputing, 323, 203, 10.1016/j.neucom.2018.09.082 · DOI · Paper page
  32. Sánchez, L., Anseán, D., Otero, J., and Couso, I. (2017). Assessing the health of LiFePO4 traction batteries through monotonic echo state networks. Sensors, 18. · DOI
  33. Zhang, 2018, Long short-term memory recurrent neural network for remaining useful life prediction of lithium-ion batteries, IEEE Trans. Veh. Technol., 67, 5695, 10.1109/TVT.2018.2805189 · DOI · Paper page
  34. Colla, V., Matino, I., Dettori, S., Cateni, S., and Matino, R. (2019, January 24–26). Reservoir computing approaches applied to energy management in industry. Proceedings of the Engineering Applications of Neural Networks: 20th International Conference, EANN 2019, Xersonisos, Greece. Proceedings 20. · doi:10.1007/978-3-030-20257-6_6
  35. Li, 2019, Adaptive prognostic of fuel cells by implementing ensemble echo state networks in time-varying model space, IEEE Trans. Ind. Electron., 67, 379, 10.1109/TIE.2019.2893827 · DOI
  36. Bala, 2020, An improved grasshopper optimization algorithm based echo state network for predicting faults in airplane engines, IEEE Access, 8, 159773, 10.1109/ACCESS.2020.3020356 · DOI
  37. Mahmoud, A., and Mohammed, A. (2021). Machine Learning and Big Data Analytics Paradigms: Analysis, Applications and Challenges, Springer.
  38. Lim, 2021, Time-series forecasting with deep learning: A survey, Philos. Trans. R. Soc., 379, 20200209, 10.1098/rsta.2020.0209 · DOI · Paper page
  39. Sezer, 2020, Financial time series forecasting with deep learning: A systematic literature review: 2005–2019, Appl. Soft Comput., 90, 106181, 10.1016/j.asoc.2020.106181 · DOI
  40. Zeroual, 2020, Deep learning methods for forecasting COVID-19 time-Series data: A Comparative study, Chaos Solitons Fractals, 140, 110121, 10.1016/j.chaos.2020.110121 · DOI · Paper page
  41. Riquelme, 2021, An experimental review on deep learning architectures for time series forecasting, Int. J. Neural Syst., 31, 2130001, 10.1142/S0129065721300011 · DOI · Paper page
  42. Oyedele, 2022, Rainfall prediction: A comparative analysis of modern machine learning algorithms for time series forecasting, Mach. Learn. Appl., 7, 100204
  43. Lakshmanna, K., Kaluri, R., Gundluru, N., Alzamil, Z.S., Rajput, D.S., Khan, A.A., Haq, M.A., and Alhussen, A. (2022). A review on deep learning techniques for IoT data. Electronics, 11. · DOI
  44. Makridakis, 2020, The M4 Competition: 100,000 time series and 61 forecasting methods, Int. J. Forecast., 36, 54, 10.1016/j.ijforecast.2019.04.014 · DOI · Paper page
  45. Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press.
  46. Hastie, T., Tibshirani, R., Friedman, J.H., and Friedman, J.H. (2009). The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Springer. · DOI · Paper page
  47. Gudelek, M.U., Boluk, S.A., and Ozbayoglu, A.M. (December, January 27). A deep learning based stock trading model with 2-D CNN trend detection. Proceedings of the 2017 IEEE Symposium Series on Computational Intelligence (SSCI), Honolulu, HI, USA. · DOI
  48. Kuo, P.H., and Huang, C.J. (2018). A high precision artificial neural networks model for short-term energy load forecasting. Energies, 11. · DOI · Paper page
  49. Zahid, M., Ahmed, F., Javaid, N., Abbasi, R.A., Zainab Kazmi, H.S., Javaid, A., Bilal, M., Akbar, M., and Ilahi, M. (2019). Electricity price and load forecasting using enhanced convolutional neural network and enhanced support vector regression in smart grids. Electronics, 8. · DOI · Paper page
  50. Cai, 2019, Day-ahead building-level load forecasts using deep learning vs. traditional time series techniques, Appl. Energy, 236, 1078, 10.1016/j.apenergy.2018.12.042 · DOI · Paper page
  51. Borovykh, A., Bohte, S., and Oosterlee, C.W. (2018). Dilated convolutional neural networks for time series forecasting. J. Comput. Financ. Forthcom. · DOI
  52. Lara-Benítez, P., Carranza-García, M., Luna-Romera, J.M., and Riquelme, J.C. (2020). Temporal convolutional networks applied to energy-related time series forecasting. Appl. Sci., 10. · doi:10.20944/preprints202003.0096.v1
  53. Hewage, 2020, Temporal convolutional neural (TCN) network for an effective weather forecasting using time series data from the local weather station, Soft Comput., 24, 16453, 10.1007/s00500-020-04954-0 · DOI · Paper page
  54. Sfetsos, 2000, Univariate and multivariate forecasting of hourly solar radiation with artificial intelligence techniques, Sol. Energy, 68, 169, 10.1016/S0038-092X(99)00064-X · DOI · Paper page
  55. Hsieh, 2011, Forecasting stock markets using wavelet transforms and recurrent neural networks: An integrated system based on artificial bee colony algorithm, Appl. Soft Comput., 11, 2510, 10.1016/j.asoc.2010.09.007 · doi:10.1016/j.asoc.2010.09.007
  56. Elman, 1990, Finding structure in time, Cogn. Sci., 14, 179, 10.1207/s15516709cog1402_1 · DOI · Paper page
  57. Jaeger, 2001, The “echo state” approach to analysing and training recurrent neural networks-with an erratum note, Bonn Ger. Ger. Natl. Res. Cent. Inf. Technol. Gmd Tech. Rep., 148, 13
  58. Jordan, 1997, Serial order: A parallel distributed processing approach, Advances in Psychology, Volume 121, 471, 10.1016/S0166-4115(97)80111-2 · DOI · Paper page
  59. Shi, 2017, A whole system assessment of novel deep learning approach on short-term load forecasting, Energy Procedia, 142, 2791, 10.1016/j.egypro.2017.12.423 · doi:10.1016/j.egypro.2017.12.423
  60. Mohammadi, 2018, Small-scale building load forecast based on hybrid forecast engine, Neural Process. Lett., 48, 329, 10.1007/s11063-017-9723-2 · DOI · Paper page
  61. Ruiz, 2018, Energy consumption forecasting based on Elman neural networks with evolutive optimization, Expert Syst. Appl., 92, 380, 10.1016/j.eswa.2017.09.059 · DOI · Paper page
  62. Kantz, H., and Schreiber, T. (2004). Nonlinear Time Series Analysis, Cambridge University Press. · DOI · Paper page
  63. Simonyan, K., Vedaldi, A., and Zisserman, A. (2013). Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv.
  64. Morando, 2017, ANOVA method applied to proton exchange membrane fuel cell ageing forecasting using an echo state network, Math. Comput. Simul., 131, 283, 10.1016/j.matcom.2015.06.009 · DOI
  65. Antonelo, 2017, Echo state networks for data-driven downhole pressure estimation in gas-lift oil wells, Neural Netw., 85, 106, 10.1016/j.neunet.2016.09.009 · DOI
  66. Shen, 2018, A novel echo state network for multivariate and nonlinear time series prediction, Appl. Soft Comput., 62, 524, 10.1016/j.asoc.2017.10.038 · DOI
  67. Jing, Z., Yuxi, L., Yan, C., Bao, Y., Jiakui, Z., and Di, L. (2019, January 15–18). Photovoltaic Output Prediction Model Based on Echo State Networks with Weather Type Index. Proceedings of the 2019 3rd International Conference on Innovation in Artificial Intelligence, Suzhou, China. · DOI
  68. Hu, 2020, Effective energy consumption forecasting using enhanced bagged echo state network, Energy, 193, 116778, 10.1016/j.energy.2019.116778 · doi:10.1016/j.energy.2019.116778
  69. Mansoor, M., Grimaccia, F., and Mussetta, M. (2020, January 19–24). Echo State Network Performance in Electrical and Industrial Applications. Proceedings of the 2020 International Joint Conference on Neural Networks (IJCNN), Glasgow, UK. · DOI
  70. Hu, 2020, Forecasting energy consumption and wind power generation using deep echo state network, Renew. Energy, 154, 598, 10.1016/j.renene.2020.03.042 · DOI
  71. Yang, 2020, A novel echo state network and its application in temperature prediction of exhaust gas from hot blast stove, IEEE Trans. Instrum. Meas., 69, 9465, 10.1109/TIM.2020.3003975 · DOI
  72. Li, 2020, Prediction of blood glucose concentration for type 1 diabetes based on echo state networks embedded with incremental learning, Neurocomputing, 378, 248, 10.1016/j.neucom.2019.10.003 · DOI
  73. Gao, 2021, Time series forecasting based on echo state network and empirical wavelet transformation, Appl. Soft Comput., 102, 107111, 10.1016/j.asoc.2021.107111 · DOI
  74. Mansoor, 2021, Comparison of echo state network and feed-forward neural networks in electrical load forecasting for demand response programs, Math. Comput. Simul., 184, 282, 10.1016/j.matcom.2020.07.011 · DOI
  75. Sui, 2022, Modified echo state network for prediction of nonlinear chaotic time series, Nonlinear Dyn., 110, 3581, 10.1007/s11071-022-07788-7 · DOI
  76. Marino, D.L., Amarasinghe, K., and Manic, M. (2016, January 23-26). Building energy load forecasting using deep neural networks. Proceedings of the IECON 2016—42nd Annual Conference of the IEEE Industrial Electronics Society, Florence, Italy. · DOI · Paper page
  77. Fu, R., Zhang, Z., and Li, L. (2016, January 11–13). Using LSTM and GRU neural network methods for traffic flow prediction. Proceedings of the 2016 31st Youth Academic Annual Conference of Chinese Association of Automation (YAC), Wuhan, China. · DOI · Paper page
  78. Li, Z., and Tam, V. (December, January 27). Combining the real-time wavelet denoising and long-short-term-memory neural network for predicting stock indexes. Proceedings of the 2017 IEEE Symposium Series on Computational Intelligence (SSCI), Honolulu, HI, USA. · DOI
  79. dos Santos Pinheiro, L., and Dras, M. (2017, January 6–8). Stock market prediction with deep learning: A character-based neural language model for event-based trading. Proceedings of the Australasian Language Technology Association Workshop 2017, Brisbane, Australia.
  80. Shi, 2017, Deep learning for household load forecasting—A novel pooling deep RNN, IEEE Trans. Smart Grid, 9, 5271, 10.1109/TSG.2017.2686012 · DOI · Paper page
  81. Li, 2017, Long short-term memory neural network for air pollutant concentration predictions: Method development and evaluation, Environ. Pollut., 231, 997, 10.1016/j.envpol.2017.08.114 · DOI · Paper page
  82. Baek, 2018, ModAugNet: A new forecasting framework for stock market index value with an overfitting prevention LSTM module and a prediction LSTM module, Expert Syst. Appl., 113, 457, 10.1016/j.eswa.2018.07.019 · DOI · Paper page
  83. Fischer, 2018, Deep learning with long short-term memory networks for financial market predictions, Eur. J. Oper. Res., 270, 654, 10.1016/j.ejor.2017.11.054 · DOI · Paper page
  84. Kratzert, 2018, Rainfall–runoff modelling using Long Short-Term Memory (LSTM) networks, Hydrol. Earth Syst. Sci., 22, 6005, 10.5194/hess-22-6005-2018 · doi:10.5194/hess-22-6005-2018
  85. Zhang, 2018, Developing a Long Short-Term Memory (LSTM) based model for predicting water table depth in agricultural areas, J. Hydrol., 561, 918, 10.1016/j.jhydrol.2018.04.065 · DOI · Paper page
  86. Bouktif, S., Fiaz, A., Ouni, A., and Serhani, M.A. (2018). Optimal deep learning lstm model for electric load forecasting using feature selection and genetic algorithm: Comparison with machine learning approaches. Energies, 11. · DOI · Paper page
  87. Xu, L., Li, C., Xie, X., and Zhang, G. (2018). Long-short-term memory network based hybrid model for short-term electrical load forecasting. Information, 9. · DOI
  88. Wang, 2018, LASSO and LSTM integrated temporal model for short-term solar intensity forecasting, IEEE Internet Things J., 6, 2933, 10.1109/JIOT.2018.2877510 · DOI
  89. Freeman, 2018, Forecasting air quality time series using deep learning, J. Air Waste Manag. Assoc. (1995), 68, 866, 10.1080/10962247.2018.1459956 · DOI · Paper page
  90. Wang, Y., Smola, A., Maddix, D., Gasthaus, J., Foster, D., and Januschowski, T. (2019, January 9–15). Deep factors for forecasting. Proceedings of the International Conference on Machine Learning, Long Beach, CA, USA.
  91. Nichiforov, C., Stamatescu, G., Stamatescu, I., and Făgărăşan, I. (2019). Evaluation of sequence-learning models for large-commercial-building load forecasting. Information, 10. · doi:10.20944/preprints201904.0318.v1
  92. Zou, M., Fang, D., Harrison, G., and Djokic, S. (2019, January 9–12). Weather based day-ahead and week-ahead load forecasting using deep recurrent neural network. Proceedings of the 2019 IEEE 5th International forum on Research and Technology for Society and Industry (RTSI), Florence, Italy. · DOI
  93. Chimmula, 2020, Time series forecasting of COVID-19 transmission in Canada using LSTM networks, Chaos Solitons Fractals, 135, 109864, 10.1016/j.chaos.2020.109864 · DOI · Paper page
  94. Wu, Y., Ni, J., Cheng, W., Zong, B., Song, D., Chen, Z., Liu, Y., Zhang, X., Chen, H., and Davidson, S.B. (2021, January 2–9). Dynamic gaussian mixture based deep generative model for robust forecasting on sparse multivariate time series. Proceedings of the AAAI Conference on Artificial Intelligence, Virtual. · DOI · Paper page
  95. Dastgerdi, 2022, Investigating the effect of noise elimination on LSTM models for financial markets prediction using Kalman Filter and Wavelet Transform, WSEAS Trans. Bus. Econ., 19, 432, 10.37394/23207.2022.19.39 · DOI
  96. Wang, Y., Liao, W., and Chang, Y. (2018). Gated recurrent unit network-based short-term photovoltaic forecasting. Energies, 11. · DOI · Paper page
  97. Du, Y., Wang, J., Feng, W., Pan, S., Qin, T., Xu, R., and Wang, C. (2021, January 1–5). Adarnn: Adaptive learning and forecasting of time series. Proceedings of the 30th ACM International Conference on Information & Knowledge Management, Gold Coast, QLD, Australia. · DOI · Paper page
  98. Bollerslev, 1986, Generalized autoregressive conditional heteroskedasticity, J. Econom., 31, 307, 10.1016/0304-4076(86)90063-1 · DOI · Paper page
  99. Gensler, A., Henze, J., Sick, B., and Raabe, N. (2016, January 9–12). Deep Learning for solar power forecasting—An approach using AutoEncoder and LSTM Neural Networks. Proceedings of the 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Budapest, Hungary. · DOI · Paper page
  100. Bao, W., Yue, J., and Rao, Y. (2017). A deep learning framework for financial time series using stacked autoencoders and long-short term memory. PLoS ONE, 12. · DOI · Paper page
  101. Lee, C.Y., and Soo, V.W. (2017, January 1–3). Predict stock price with financial news based on recurrent convolutional neural networks. Proceedings of the 2017 Conference on Technologies and Applications of Artificial Intelligence (TAAI), Taipei, Taiwan. · DOI
  102. Kuo, P.H., and Huang, C.J. (2018). An electricity price forecasting model by hybrid structured deep neural networks. Sustainability, 10. · DOI · Paper page
  103. Tian, C., Ma, J., Zhang, C., and Zhan, P. (2018). A deep neural network model for short-term load forecast based on long short-term memory network and convolutional neural network. Energies, 11. · DOI · Paper page
  104. Liu, 2018, Smart deep learning based wind speed prediction model using wavelet packet decomposition, convolutional neural network and convolutional long short term memory network, Energy Convers. Manag., 166, 120, 10.1016/j.enconman.2018.04.021 · DOI
  105. Chen, Y., Wu, J., and Bu, H. (2018, January 21–22). Stock market embedding and prediction: A deep learning method. Proceedings of the 2018 15th International Conference on Service Systems and Service Management (ICSSSM), Hangzhou, China. · DOI
  106. Hossain, M.A., Karim, R., Thulasiram, R., Bruce, N.D., and Wang, Y. (2018, January 18–21). Hybrid deep learning model for stock price prediction. Proceedings of the 2018 IEEE Symposium Series on Computational Intelligence (SSCI), Bangalore, India. · DOI
  107. Kim, 2018, Forecasting the volatility of stock price index: A hybrid model integrating LSTM with multiple GARCH-type models, Expert Syst. Appl., 103, 25, 10.1016/j.eswa.2018.03.002 · DOI · Paper page
  108. Li, Y., Yu, R., Shahabi, C., and Liu, Y. (May, January 30). Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting. Proceedings of the International Conference on Learning Representations, Vancouver, BC, Canada.
  109. Huang, C.J., and Kuo, P.H. (2018). A deep CNN-LSTM model for particulate matter (PM2. 5) forecasting in smart cities. Sensors, 18. · DOI · Paper page
  110. Soh, 2018, Adaptive deep learning-based air quality prediction model using the most relevant spatial-temporal relations, IEEE Access, 6, 38186, 10.1109/ACCESS.2018.2849820 · DOI · Paper page
  111. Fan, C., Zhang, Y., Pan, Y., Li, X., Zhang, C., Yuan, R., Wu, D., Wang, W., Pei, J., and Huang, H. (2019, January 4–8). Multi-horizon time series forecasting with temporal attention learning. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Anchorage, AK, USA. · DOI · Paper page
  112. Pan, C., Tan, J., Feng, D., and Li, Y. (2019, January 6–9). Very short-term solar generation forecasting based on LSTM with temporal attention mechanism. Proceedings of the 2019 IEEE 5th International Conference on Computer and Communications (ICCC), Chengdu, China. · doi:10.1109/iccc47050.2019.9064298
  113. Wang, 2019, Bi-directional long short-term memory method based on attention mechanism and rolling update for short-term load forecasting, Int. J. Electr. Power Energy Syst., 109, 470, 10.1016/j.ijepes.2019.02.022 · DOI · Paper page
  114. Shen, 2020, A novel time series forecasting model with deep learning, Neurocomputing, 396, 302, 10.1016/j.neucom.2018.12.084 · DOI · Paper page
  115. Pal, R., Sekh, A.A., Kar, S., and Prasad, D.K. (2020). Neural network based country wise risk prediction of COVID-19. Appl. Sci., 10. · DOI
  116. Dudukcu, 2023, Temporal Convolutional Networks with RNN approach for chaotic time series prediction, Appl. Soft Comput., 133, 109945, 10.1016/j.asoc.2022.109945 · DOI · Paper page
  117. Hamilton, W.L. (2020). Graph Representation Learning, Morgan & Claypool Publishers. · DOI · Paper page
  118. Cheng, 2022, Financial time series forecasting with multi-modality graph neural network, Pattern Recognit., 121, 108218, 10.1016/j.patcog.2021.108218 · DOI · Paper page
  119. Geng, 2022, Graph correlated attention recurrent neural network for multivariate time series forecasting, Inf. Sci., 606, 126, 10.1016/j.ins.2022.04.045 · DOI
  120. Xiang, S., Cheng, D., Shang, C., Zhang, Y., and Liang, Y. (2022, January 17–21). Temporal and Heterogeneous Graph Neural Network for Financial Time Series Prediction. Proceedings of the 31st ACM International Conference on Information & Knowledge Management, Atlanta, GA, USA. · DOI
  121. Jin, 2022, Multivariate time series forecasting with dynamic graph neural odes, IEEE Trans. Knowl. Data Eng., 35, 9168, 10.1109/TKDE.2022.3221989 · DOI · Paper page
  122. Liu, 2022, Multivariate time series forecasting with temporal polynomial graph neural networks, Adv. Neural Inf. Process. Syst., 35, 19414
  123. Williams, C.K., and Rasmussen, C.E. (2006). Gaussian Processes for Machine Learning, MIT Press. · DOI · Paper page
  124. Berg, C., Christensen, J.P.R., and Ressel, P. (1984). Harmonic Analysis on Semigroups: Theory of Positive Definite and Related Functions, Springer. · DOI · Paper page
  125. Hensman, J., Fusi, N., and Lawrence, N.D. (2013). Gaussian processes for big data. arXiv.
  126. Damianou, A., and Lawrence, N.D. (May, January 29). Deep gaussian processes. Proceedings of the Artificial Intelligence and Statistics, Scottsdale, AZ, USA.
  127. You, J., Li, X., Low, M., Lobell, D., and Ermon, S. (2017, January 4–9). Deep gaussian process for crop yield prediction based on remote sensing data. Proceedings of the AAAI Conference on Artificial Intelligence, San Francisco, CA, USA. · DOI · Paper page
  128. Mahdi, M.D., Mrittika, N.J., Shams, M., Chowdhury, L., and Siddique, S. (October, January 26). A Deep Gaussian Process for Forecasting Crop Yield and Time Series Analysis of Precipitation Based in Munshiganj, Bangladesh. Proceedings of the IGARSS 2020—2020 IEEE International Geoscience and Remote Sensing Symposium, Waikoloa, HI, USA. · doi:10.1109/igarss39084.2020.9323423
  129. Jiang, 2022, Deep graph Gaussian processes for short-term traffic flow forecasting from spatiotemporal data, IEEE Trans. Intell. Transp. Syst., 23, 20177, 10.1109/TITS.2022.3178136 · DOI
  130. Chang, 2023, A multistep forecasting method for online car-hailing demand based on wavelet decomposition and deep Gaussian process regression, J. Supercomput., 79, 3412, 10.1007/s11227-022-04773-0 · DOI
  131. Camastra, F., Casolaro, A., and Iannuzzo, G. (2023, January 22–26). Time Series prediction with missing data by an Iterated Deep Gaussian Process. Proceedings of the 31st Edition of WIRN 2023, Vietri sul Mare, Salerno, Italy.
  132. Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014, January 8–13). Generative Adversarial Nets. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada.
  133. Mogren, O. (2016). C-RNN-GAN: Continuous recurrent neural networks with adversarial training. arXiv.
  134. Box, G.E., Jenkins, G.M., Reinsel, G.C., and Ljung, G.M. (2015). Time Series Analysis: Forecasting and Control, John Wiley & Sons.
  135. Wu, 2021, A GAN-Enhanced Ensemble Model for Energy Consumption Forecasting in Large Commercial Buildings, IEEE Access, 9, 158820, 10.1109/ACCESS.2021.3131185 · DOI
  136. Mirza, M., and Osindero, S. (2014). Conditional generative adversarial nets. arXiv.
  137. Chen, X., Duan, Y., Houthooft, R., Schulman, J., Sutskever, I., and Abbeel, P. (2016). InfoGAN: Interpretable Representation Learning by Information Maximising Generative Adversarial Nets. Adv. Neural Inf. Process. Syst., 29.
  138. Wang, 2022, Predicting the epidemics trend of COVID-19 using epidemiological-based generative adversarial networks, IEEE J. Sel. Top. Signal Process., 16, 276, 10.1109/JSTSP.2022.3152375 · doi:10.1109/jstsp.2022.3152375
  139. Wiese, 2020, Quant GANs: Deep generation of financial time series, Quant. Financ., 20, 1419, 10.1080/14697688.2020.1730426 · DOI · Paper page
  140. Hazra, D., and Byun, Y.C. (2020). SynSigGAN: Generative adversarial networks for synthetic biomedical signal generation. Biology, 9. · DOI · Paper page
  141. Esteban, C., Hyland, S.L., and Rätsch, G. (2017). Real-valued (medical) time series generation with recurrent conditional gans. arXiv.
  142. Yoon, J., Jarrett, D., and Van der Schaar, M. (2019). Time-series generative adversarial networks. Adv. Neural Inf. Process. Syst., 32.
  143. Ni, H., Szpruch, L., Wiese, M., Liao, S., and Xiao, B. (2020). Conditional sig-wasserstein gans for time series generation. arXiv. · DOI
  144. Koochali, 2019, Probabilistic forecasting of sensory data with generative adversarial networks–ForGAN, IEEE Access, 7, 63868, 10.1109/ACCESS.2019.2915544 · DOI
  145. Bej, 2022, Time-Series prediction for the epidemic trends of COVID-19 using Conditional Generative adversarial Networks Regression on country-wise case studies, SN Comput. Sci., 3, 352, 10.1007/s42979-022-01225-7 · DOI
  146. Zúñiga, G., and Acuña, G. (2021, January 2–4). Probabilistic multistep time series forecasting using conditional generative adversarial networks. Proceedings of the 2021 IEEE Latin American Conference on Computational Intelligence (LA-CCI), Temuco, Chile. · doi:10.1109/la-cci48322.2021.9769836
  147. Huang, 2022, Time series forecasting for hourly photovoltaic power using conditional generative adversarial network and Bi-LSTM, Energy, 246, 123403, 10.1016/j.energy.2022.123403 · DOI · Paper page
  148. Li, 2022, A novel hybrid model for multi-step ahead photovoltaic power prediction based on conditional time series generative adversarial networks, Renew. Energy, 199, 560, 10.1016/j.renene.2022.08.134 · DOI
  149. Zhou, 2018, Stock market prediction on high-frequency data using generative adversarial nets, Math. Probl. Eng., 2018, 4907423
  150. Zhang, 2019, Trafficgan: Network-scale deep traffic prediction with generative adversarial nets, IEEE Trans. Intell. Transp. Syst., 22, 219, 10.1109/TITS.2019.2955794 · DOI
  151. Kaushik, 2020, Medicine expenditure prediction via a variance-based generative adversarial network, IEEE Access, 8, 110947, 10.1109/ACCESS.2020.3002346 · DOI
  152. Gu, Y., Chen, Q., Liu, K., Xie, L., and Kang, C. (2019, January 18–21). GAN-based Model for Residential Load Generation Considering Typical Consumption Patterns. Proceedings of the 2019 IEEE Power & Energy Society Innovative Smart Grid Technologies Conference (ISGT), Washington, DC, USA. · DOI
  153. He, B., and Kita, E. (2020, January 17–20). Stock price prediction by using hybrid sequential generative adversarial networks. Proceedings of the 2020 International Conference on Data Mining Workshops (ICDMW), Sorrento, Italy. · DOI
  154. Wu, 2020, Adversarial sparse transformer for time series forecasting, Adv. Neural Inf. Process. Syst., 33, 17105
  155. Li, 2020, GANs-LSTM model for soil temperature estimation from meteorological: A new approach, IEEE Access, 8, 59427, 10.1109/ACCESS.2020.2982996 · DOI
  156. Yin, 2021, Multi-attention generative adversarial network for multivariate time series prediction, IEEE Access, 9, 57351, 10.1109/ACCESS.2021.3065969 · DOI
  157. Wu, W., Huang, F., Kao, Y., Chen, Z., and Wu, Q. (2021). Prediction method of multiple related time series based on generative adversarial networks. Information, 12. · DOI
  158. Jiang, 2021, Day-ahead renewable scenario forecasts based on generative adversarial networks, Int. J. Energy Res., 45, 7572, 10.1002/er.6340 · DOI
  159. Bendaoud, 2021, Comparing Generative Adversarial Networks architectures for electricity demand forecasting, Energy Build., 247, 111152, 10.1016/j.enbuild.2021.111152 · DOI
  160. Wu, 2022, Long-term 4D trajectory prediction using generative adversarial networks, Transp. Res. Part Emerg. Technol., 136, 103554, 10.1016/j.trc.2022.103554 · DOI
  161. Ye, 2022, Evaluating performance of different generative adversarial networks for large-scale building power demand prediction, Energy Build., 269, 112247, 10.1016/j.enbuild.2022.112247 · DOI
  162. Vuletić, M., Prenzel, F., and Cucuringu, M. (2023, September 25). Fin-Gan: Forecasting and Classifying Financial Time Series via Generative Adversarial Networks. Available online: https://ssrn.com/abstract=4328302. · doi:10.2139/ssrn.4328302
  163. Rasul, K., Seward, C., Schuster, I., and Vollgraf, R. (2021, January 18–24). Autoregressive denoising diffusion models for multivariate probabilistic time series forecasting. Proceedings of the International Conference on Machine Learning, Virtual.
  164. Yan, T., Zhang, H., Zhou, T., Zhan, Y., and Xia, Y. (2021). ScoreGrad: Multivariate probabilistic time series forecasting with continuous energy-based generative models. arXiv.
  165. Li, 2022, Generative time series forecasting with diffusion, denoise, and disentanglement, Adv. Neural Inf. Process. Syst., 35, 23009
  166. Biloš, M., Rasul, K., Schneider, A., Nevmyvaka, Y., and Günnemann, S. (2022). Modeling temporal data as continuous functions with process diffusion. arXiv.
  167. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017). Attention is all you need. Adv. Neural Inf. Process. Syst., 30.
  168. Wu, 2021, Autoformer: Decomposition transformers with auto-correlation for long-term series forecasting, Adv. Neural Inf. Process. Syst., 34, 22419
  169. Zhou, T., Ma, Z., Wen, Q., Wang, X., Sun, L., and Jin, R. (2022, January 17–23). Fedformer: Frequency enhanced decomposed transformer for long-term series forecasting. Proceedings of the International Conference on Machine Learning, Baltimore, MD, USA.
  170. He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.
  171. Ba, J.L., Kiros, J.R., and Hinton, G.E. (2016). Layer normalization. arXiv.
  172. Li, S., Jin, X., Xuan, Y., Zhou, X., Chen, W., Wang, Y.X., and Yan, X. (2019). Enhancing the locality and breaking the memory bottleneck of transformer on time series forecasting. Adv. Neural Inf. Process. Syst., 32.
  173. Wang, S., Li, B.Z., Khabsa, M., Fang, H., and Ma, H. (2020). Linformer: Self-attention with linear complexity. arXiv.
  174. Donoho, 2006, Compressed sensing, IEEE Trans. Inf. Theory, 52, 1289, 10.1109/TIT.2006.871582 · DOI · Paper page
  175. Nie, Y., Nguyen, N.H., Sinthong, P., and Kalagnanam, J. (2023, January 1–5). A Time Series is Worth 64 Words: Long-term Forecasting with Transformers. Proceedings of the International Conference on Learning Representations, Kigali, Rwanda.
  176. Zhang, Y., and Yan, J. (2022, January 1–5). Crossformer: Transformer utilising cross-dimension dependency for multivariate time series forecasting. Proceedings of the Eleventh International Conference on Learning Representations, Kigali, Rwanda.
  177. Liu, S., Yu, H., Liao, C., Li, J., Lin, W., Liu, A.X., and Dustdar, S. (2022, January 25–29). Pyraformer: Low-Complexity Pyramidal Attention for Long-Range Time Series Modeling and Forecasting. Proceedings of the International Conference on Learning Representations, Virtual.
  178. Shabani, M.A., Abdi, A.H., Meng, L., and Sylvain, T. (2023, January 1–5). Scaleformer: Iterative Multi-scale Refining Transformers for Time Series Forecasting. Proceedings of the The Eleventh International Conference on Learning Representations, Kigali, Rwanda.
  179. Cirstea, R.G., Guo, C., Yang, B., Kieu, T., Dong, X., and Pan, S. (2022). Triformer: Triangular, Variable-Specific Attentions for Long Sequence Multivariate Time Series Forecasting–Full Version. arXiv. · DOI
  180. Liu, 2022, Non-stationary transformers: Exploring the stationarity in time series forecasting, Adv. Neural Inf. Process. Syst., 35, 9881
  181. Schirmer, M., Eltayeb, M., Lessmann, S., and Rudolph, M. (2022, January 17–23). Modeling irregular time series with continuous recurrent units. Proceedings of the International Conference on Machine Learning, Baltimore, MD, USA.
  182. Zhou, 2022, Film: Frequency improved legendre memory model for long-term time series forecasting, Adv. Neural Inf. Process. Syst., 35, 12677
  183. Ekambaram, V., Jati, A., Nguyen, N., Sinthong, P., and Kalagnanam, J. (2023, January 6–10). TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecasting. Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Long Beach, CA, USA. · DOI · Paper page
  184. Wang, H., Peng, J., Huang, F., Wang, J., Chen, J., and Xiao, Y. (2023, January 1–5). MICN: Multi-scale Local and Global Context Modeling for Long-term Series Forecasting. Proceedings of the Eleventh International Conference on Learning Representations, Kigali, Rwanda.
  185. Mackey, 1977, Oscillation and chaos in physiological control systems, Science, 197, 287, 10.1126/science.267326 · DOI · Paper page
  186. Weiss, 1995, Lorenz-like chaos in NH3-FIR lasers, Infrared Phys. Technol., 36, 489, 10.1016/1350-4495(94)00088-3 · doi:10.1016/1350-4495(94)00088-3
  187. Aguirre, 1997, Nonlinear identification and cluster analysis of chaotic attractors from a real implementation of Chua’s circuit, Int. J. Bifurc. Chaos, 7, 1411, 10.1142/S0218127497001138 · doi:10.1142/s0218127497001138
  188. Wijngaard, 2003, Homogeneity of 20th century European daily temperature and precipitation series, Int. J. Climatol. J. R. Meteorol. Soc., 23, 679, 10.1002/joc.906 · DOI · Paper page
  189. Song, Y., Garg, S., Shi, J., and Ermon, S. (2020, January 3–6). Sliced score matching: A scalable approach to density and score estimation. Proceedings of the Uncertainty in Artificial Intelligence, Virtual.
  190. Papoulis, A., and Unnikrishna Pillai, S. (2002). Probability, Random Variables and Stochastic Processes, McGraw-Hill.

Metadata

Authors
Casolaro, A., Capone, V., Iannuzzo, G., & Camastra, F.
Venue
Information
Publisher
MDPI AG
Published
2023-11-04
Volume
14
Issue
11
Pages
598
ISSN
2078-2489 (ISSN-L)
OpenAlex
W4388333441
Cited by
178
References
21
FWCI
21.90
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Deep Learning for Time Series Forecasting: Advances and Open Problems. https://app.cochat.ai/papers/10.3390/info14110598
The paper
Casolaro, A., Capone, V., Iannuzzo, G., & Camastra, F. (2023). Deep Learning for Time Series Forecasting: Advances and Open Problems. Information. https://doi.org/10.3390/info14110598

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.