The DOI matches its Crossref record; 208 of the 208 references it cites were found in a registry or an index.
A Review of Deep Learning Models for Time Series Prediction
Abstract
In order to approximate the underlying process of temporal data, time series prediction has been a hot research topic for decades. Developing predictive models plays an important role in interpreting complex real-world elements. With the sharp increase in the quantity and dimensionality of data, new challenges, such as extracting deep features and recognizing deep latent patterns, have emerged, demanding novel approaches and effective solutions. Deep learning, composed of multiple processing layers to learn with multiple levels of abstraction, is, now, commonly deployed for overcoming the newly arisen difficulties. This paper reviews the state-of-the-art developments in deep learning for time series prediction. Based on modeling for the perspective of conditional or joint probability, we categorize them into discriminative, generative, and hybrids models. Experiments are implemented on both benchmarks and real-world data to elaborate the performance of the representative deep learning-based prediction methods. Finally, we conclude with comments on possible future perspectives and ongoing challenges with time series prediction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Nearest neighbor pattern classification
Cover, T., & Hart, P. (1967) · IEEE Transactions on Information Theory · doi:10.1109/tit.1967.1053964 · Cited by 16,936
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Estimation and Hypothesis Testing of Cointegration Vectors in Gaussian Vector Autoregressive Models
Johansen, S. (1991) · Econometrica · doi:10.2307/2938278 · Cited by 11,116
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Least Squares Support Vector Machine Classifiers
Suykens, J. A. K., & Vandewalle, J. (1999) · Neural Processing Letters · doi:10.1023/a:1018628609742 · Cited by 9,362
Conditional Generative Adversarial Nets
Mirza, M., & Osindero, S. (2014) · arXiv · doi:10.48550/arxiv.1411.1784 · Cited by 8,863
Chai, T., & Draxler, R. R. (2014) · Geoscientific Model Development · doi:10.5194/gmd-7-1247-2014 · Cited by 8,761 · cited 1×
“Mean Absolute Percentage Error (MAPE) [211] and Root Mean Square Error (RMSE) [212] are deployed as indices for error statistics, which are defined as follows. where N denotes the length of predicted results, i.e., ˆ y i . y i refers to the real value.”
BackgroundModel-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512
On the Properties of Neural Machine Translation: Encoder–Decoder Approaches
Cho, K., van Merrienboer, B., Bahdanau, D., & Bengio, Y. (2014) · Proceedings of SSST-8, Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation · doi:10.3115/v1/w14-4012 · Cited by 7,099
Greff, K., Srivastava, R. K., Koutnik, J., Steunebrink, B. R., & Schmidhuber, J. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2582924 · Cited by 6,955 · cited 1×
“While there have been several improvements and modifications to the standard (vanilla) LSTM, recent studies [87], [95] show that most variants do not significantly improve the performance for sequential tasks such as speed, music and handwriting recognition.”
Background(2017) · International Conference on Machine Learning · Cited by 6,382
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294
Fast Training of Support Vector Machines Using Sequential Minimal Optimization
Platt, J. C. (1998) · Advances in Kernel Methods · doi:10.7551/mitpress/1130.003.0016 · Cited by 5,437
“Least squares generative adversarial networks,”
Mao, X., Li, Q., Xie, H., Lau, R. Y. K., Wang, Z., & Smolley, S. P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.304 · Cited by 5,437
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911
Receptive fields of single neurones in the cat's striate cortex
Hubel, D. H., & Wiesel, T. N. (1959) · The Journal of Physiology · doi:10.1113/jphysiol.1959.sp006308 · Cited by 4,653
Convolutional networks for images, speech, and time series
LeCun, Y., & Bengio, Y. (1998) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.5555/303568.303704 · Cited by 4,231
Introduction to Time Series and Forecasting
(2002) · Springer Texts in Statistics · doi:10.1007/b97391 · Cited by 3,807
Deep Learning: Methods and Applications
Deng, L., & Yu, D. (2014) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000039 · Cited by 3,480
Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources
Zhu, X. X., Tuia, D., Mou, L., Xia, G.-S., Zhang, L., Xu, F., & Fraundorfer, F. (2017) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2017.2762307 · Cited by 3,400
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Traffic Flow Prediction With Big Data: A Deep Learning Approach
Lv, Y., Duan, Y., Kang, W., Li, Z., & Wang, F.-Y. (2014) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2014.2345663 · Cited by 3,000
Dynamic bayesian networks: representation, inference and learning
Murphy, K. P., & Russell, S. (2002) · Cited by 2,616
Lee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553453 · Cited by 2,412
Learning to forget: continual prediction with LSTM
Gers, F. A. (1999) · 9th International Conference on Artificial Neural Networks: ICANN '99 · doi:10.1049/cp:19991218 · Cited by 2,337
SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient
Yu, L., Zhang, W., Wang, J., & Yu, Y. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10804 · Cited by 2,285
Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction
Zhang, J., Zheng, Y., & Qi, D. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10735 · Cited by 2,282
Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art
Zhang, L., Zhang, L., & Du, B. (2016) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2016.2540798 · Cited by 2,208
CNN architectures for large-scale audio classification
Hershey, S., Chaudhuri, S., Ellis, D. P. W., Gemmeke, J. F., Jansen, A., Moore, R. C., Plakal, M., Platt, D., Saurous, R. A., Seybold, B., et al. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7952132 · Cited by 2,023
(2001) · Cited by 1,932
Generative adversarial network in medical imaging: A review
Yi, X., Walia, E., & Babyn, P. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.101552 · Cited by 1,863
Deep Learning: Methods and Applications
Deng, L. (2014) · now publishers, Inc. eBooks · doi:10.1561/9781601988157 · Cited by 1,759
Hybrid speech recognition with Deep Bidirectional LSTM
Graves, A., Jaitly, N., & Mohamed, A.-R. (2013) · 2013 IEEE Workshop on Automatic Speech Recognition and Understanding · doi:10.1109/asru.2013.6707742 · Cited by 1,736
A Tutorial on Learning with Bayesian Networks
Heckerman, D. (2008) · Studies in Computational Intelligence · doi:10.1007/978-3-540-85066-3_3 · Cited by 1,693
A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Prediction
Qin, Y., Song, D., Chen, H., Cheng, W., Jiang, G., & Cottrell, G. W. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/366 · Cited by 1,585
Understanding Black-box Predictions via Influence Functions
Koh, P. W., & Liang, P. (2017) · arXiv · doi:10.48550/arxiv.1703.04730 · Cited by 1,514
Meta-learning with memory-augmented neural networks
Santoro, A., Bartunov, S., Botvinick, M., Wierstra, D., & Lillicrap, T. (2016) · International Conference on Machine Learning · Cited by 1,504
An Empirical Exploration of Recurrent Network Architectures
Józefowicz, R., Zaremba, W., & Sutskever, I. (2015) · International Conference on Machine Learning · Cited by 1,459
Using LSTM and GRU neural network methods for traffic flow prediction
Fu, R., Zhang, Z., & Li, L. (2016) · 2016 31st Youth Academic Annual Conference of Chinese Association of Automation (YAC) · doi:10.1109/yac.2016.7804912 · Cited by 1,434
Ma, X., Dai, Z., He, Z., Ma, J., Wang, Y., & Wang, Y. (2017) · Sensors · doi:10.3390/s17040818 · Cited by 1,409
Application of support vector machines in financial time series forecasting
Tay, F. E. H., & Cao, L. (2001) · Omega · doi:10.1016/s0305-0483(01)00026-3 · Cited by 1,268
Kasabov, N. K., & Song, Q. (2002) · IEEE Transactions on Fuzzy Systems · doi:10.1109/91.995117 · Cited by 1,264
NIPS 2016 Tutorial: Generative Adversarial Networks
Goodfellow, I. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.00160 · Cited by 1,229
A survey on deep learning for big data
Zhang, Q., Yang, L. T., Chen, Z., & Li, P. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.10.006 · Cited by 1,226
A Tutorial on Learning with Bayesian Networks
Heckerman, D. (1998) · Learning in Graphical Models · doi:10.1007/978-94-011-5014-9_11 · Cited by 1,220
Deep Architecture for Traffic Flow Prediction: Deep Belief Networks With Multitask Learning
Huang, W., Song, G., Hong, H., & Xie, K. (2014) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2014.2311123 · Cited by 1,139
Time Series Prediction Using Support Vector Machines: A Survey
Sapankevych, N., & Sankar, R. (2009) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2009.932254 · Cited by 1,129
SVM-KNN: Discriminative Nearest Neighbor Classification for Visual Category Recognition
Zhang, H., Berg, A. C., Maire, M., & Malik, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.301 · Cited by 1,114
Chatfield, C. (2000) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420036206 · Cited by 1,040
Learning and relearning in Boltzmann machines
Hinton, G. E., & Sejnowski, T. J. (2001) · Graphical Models · doi:10.7551/mitpress/3349.003.0005 · Cited by 1,037
(2015) · Cited by 989
Time Series Analysis Forecasting and Control.
Chakravarti, I. M., Box, G. E. P., & Jenkins, G. M. (1973) · Journal of the American Statistical Association · doi:10.2307/2284112 · Cited by 972
(2007) · Cited by 937
Bidirectional LSTM Networks for Improved Phoneme Classification and Recognition
Graves, A., Fernández, S., & Schmidhuber, J. (2005) · Lecture Notes in Computer Science · doi:10.1007/11550907_126 · Cited by 925
Mellit, A., & Pavan, A. M. (2010) · Solar Energy · doi:10.1016/j.solener.2010.02.006 · Cited by 886
Learning to Diagnose with LSTM Recurrent Neural Networks
Lipton, Z. C., Kale, D. C., Elkan, C., & Wetzel, R. (2015) · arXiv · doi:10.48550/arxiv.1511.03677 · Cited by 879
A novel hybridization of artificial neural networks and ARIMA models for time series forecasting
Khashei, M., & Bijari, M. (2011) · Applied Soft Computing · doi:10.1016/j.asoc.2010.10.015 · Cited by 821
Representational Power of Restricted Boltzmann Machines and Deep Belief Networks
Le Roux, N., & Bengio, Y. (2008) · Neural Computation · doi:10.1162/neco.2008.04-07-510 · Cited by 821
Using artificial neural network models in stock market index prediction
Guresen, E., Kayakutlu, G., & Daim, T. U. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.02.068 · Cited by 786
Deep learning based ensemble approach for probabilistic wind power forecasting
Wang, H.-Z., Li, G.-Q., Wang, G.-B., Peng, J.-C., Jiang, H., & Liu, Y.-T. (2017) · Applied Energy · doi:10.1016/j.apenergy.2016.11.111 · Cited by 753
Ben Taieb, S., Bontempi, G., Atiya, A. F., & Sorjamaa, A. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2012.01.039 · Cited by 734
Deep learning for event-driven stock prediction
Ding, X., Zhang, Y., Liu, T., & Duan, J. (2015) · International Conference on Artificial Intelligence · Cited by 685
Time Series Classification Using Multi-Channels Deep Convolutional Neural Networks
Zheng, Y., Liu, Q., Chen, E., Ge, Y., & Zhao, J. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-08010-9_33 · Cited by 652
Self-citationWang, L., Zeng, Y., & Chen, T. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.08.018 · Cited by 631
Recurrent nets that time and count
Gers, F. A., & Schmidhuber, J. (2000) · Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium · doi:10.1109/ijcnn.2000.861302 · Cited by 623
Deep Learning for solar power forecasting — An approach using AutoEncoder and LSTM Neural Networks
Gensler, A., Henze, J., Sick, B., & Raabe, N. (2016) · 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC) · doi:10.1109/smc.2016.7844673 · Cited by 614
Zou, M., & Conzen, S. D. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bth463 · Cited by 587 · cited 1×
“There already exist numerous studies on using BNs for time series prediction [145]–[148].”
BackgroundComparison of ARIMA and Artificial Neural Networks Models for Stock Price Prediction
Adebiyi, A. A., Adewumi, A. O., & Ayo, C. K. (2014) · Journal of Applied Mathematics · doi:10.1155/2014/614342 · Cited by 577
Deep Learning for Time-Series AnalysisPreprint
Gamboa, J. C. B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.01887 · Cited by 573
Deep Gaussian Process for Crop Yield Prediction Based on Remote Sensing Data
You, J., Li, X., Low, M., Lobell, D., & Ermon, S. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11172 · Cited by 558
Introduction to Time Series and Forecasting.
Brockwell, P. J., & Davis, R. A. (1998) · Biometrics · doi:10.2307/2533882 · Cited by 541
Time series forecasting using a deep belief network with restricted Boltzmann machines
Kuremoto, T., Kimura, S., Kobayashi, K., & Obayashi, M. (2014) · Neurocomputing · doi:10.1016/j.neucom.2013.03.047 · Cited by 527
Forecasting the behavior of multivariate time series using neural networks
Chakraborty, K., Mehrotra, K., Mohan, C. K., & Ranka, S. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80092-9 · Cited by 517
GeoMAN: Multi-level Attention Networks for Geo-sensory Time Series Prediction
Liang, Y., Ke, S., Zhang, J., Yi, X., & Zheng, Y. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/476 · Cited by 510
Van Gestel, T., Suykens, J. A. K., Baestaens, D.-E., Lambrechts, A., Lanckriet, G., Vandaele, B., De Moor, B., & Vandewalle, J. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.935093 · Cited by 499
Deep belief network based deterministic and probabilistic wind speed forecasting approach
Wang, H. Z., Wang, G. B., Li, G. Q., Peng, J. C., & Liu, Y. T. (2016) · Applied Energy · doi:10.1016/j.apenergy.2016.08.108 · Cited by 495
Gokmen, T., & Vlasov, Y. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00333 · Cited by 491
Liu, H., Mi, X.-W., & Li, Y.-F. (2018) · Energy Conversion and Management · doi:10.1016/j.enconman.2017.11.053 · Cited by 474
Empirical Mode Decomposition based ensemble deep learning for load demand time series forecasting
Qiu, X., Ren, Y., Suganthan, P. N., & Amaratunga, G. A. J. (2017) · Applied Soft Computing · doi:10.1016/j.asoc.2017.01.015 · Cited by 450
A Deep Learning Scheme for Motor Imagery Classification based on Restricted Boltzmann Machines
Lu, N., Li, T., Ren, X., & Miao, H. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2016.2601240 · Cited by 419
Comparison of two new ARIMA-ANN and ARIMA-Kalman hybrid methods for wind speed prediction
Liu, H., Tian, H.-Q., & Li, Y.-F. (2012) · Applied Energy · doi:10.1016/j.apenergy.2012.04.001 · Cited by 407
Forecasting with Univariate Box - Jenkins Models : concepts and cases
Pankratz, A. (1983) · Cited by 406
Yuan, C., Liu, S., & Fang, Z. (2016) · Energy · doi:10.1016/j.energy.2016.02.001 · Cited by 393
Girard, A., Rasmussen, C. E., Candela, J. Q., & Murray‐Smith, R. (2002) · Cited by 384
A deep learning ensemble approach for crude oil price forecasting
Zhao, Y., Li, J., & Yu, L. (2017) · Energy Economics · doi:10.1016/j.eneco.2017.05.023 · Cited by 380
The Recurrent Temporal Restricted Boltzmann Machine
Sutskever, I., Hinton, G. E., & Taylor, G. W. (2008) · neural information processing systems · Cited by 370
Ensemble deep learning for regression and time series forecasting
Qiu, X., Zhang, L., Ren, Y., Suganthan, P., & Amaratunga, G. (2014) · 2014 IEEE Symposium on Computational Intelligence in Ensemble Learning (CIEL) · doi:10.1109/ciel.2014.7015739 · Cited by 368
An Improved K-nearest Neighbor Model for Short-term Traffic Flow Prediction
Zhang, L., Liu, Q., Yang, W., Nai, W., & Dong, D. (2013) · Procedia - Social and Behavioral Sciences · doi:10.1016/j.sbspro.2013.08.076 · Cited by 366
Conditional Time Series Forecasting with Convolutional Neural Networks
Borovykh, A., Bohté, S. M., & Oosterlee, C. W. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.04691 · Cited by 362
Chaotic Time Series Prediction Based on a Novel Robust Echo State Network
Li, D., Han, M., & Wang, J. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2188414 · Cited by 341
GAN Augmentation: Augmenting Training Data using Generative Adversarial Networks
Bowles, C. T., Chen, L., Guerrero, R., Bentley, P., Gunn, R. N., Hammers, A., Dickie, D. A., Hernández, M. D. C. V., Wardlaw, J. M., & Rueckert, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.10863 · Cited by 327
Phased LSTM: Accelerating Recurrent Network Training for Long or Event-based Sequences
Neil, D., Pfeiffer, M., & Liu, S. (2016) · Zurich Open Repository and Archive (University of Zurich) · doi:10.48550/arxiv.1610.09513 · Cited by 319
Gaussian process for nonstationary time series prediction
Brahim-Belhouari, S., & Bermak, A. (2004) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2004.02.006 · Cited by 315
Wind Speed Prediction Using a Univariate ARIMA Model and a Multivariate NARX Model
Cadenas, E., Rivera, W., Campos–Amezcua, R., & Heard, C. (2016) · Energies · doi:10.3390/en9020109 · Cited by 310
An Autoencoder Approach to Learning Bilingual Word Representations
P, S. C. A., Lauly, S., Larochelle, H., Khapra, M. M., Ravindran, B., Raykar, V. C., & Saha, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1402.1454 · Cited by 309
Continuous Deep Q-Learning with Model-based Acceleration
Gu, S., Lillicrap, T., Sutskever, I., & Levine, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.00748 · Cited by 304
Deep belief network based electricity load forecasting: An analysis of Macedonian case
Dedinec, A., Filiposka, S., Dedinec, A., & Kocarev, L. (2016) · Energy · doi:10.1016/j.energy.2016.07.090 · Cited by 300
Building Energy Consumption Prediction: An Extreme Deep Learning Approach
Li, C., Ding, Z., Zhao, D., Yi, J., & Zhang, G. (2017) · Energies · doi:10.3390/en10101525 · Cited by 300
Caffeine: towards uniformed representation and acceleration for deep convolutional neural networks
Zhang, C., Fang, Z., Zhou, P., Pan, P., & Cong, J. (2016) · Proceedings of the 35th International Conference on Computer-Aided Design · doi:10.1145/2966986.2967011 · Cited by 299
A Deep Hybrid Model for Weather Forecasting
Grover, A., Kapoor, A., & Horvitz, E. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783275 · Cited by 276
Recursive Estimation and Time-Series Analysis: An Introduction
Young, P. C. (1984) · Medical Entomology and Zoology · Cited by 274
Use long short-term memory to enhance Internet of Things for combined sewer overflow monitoring
Zhang, D., Lindholm, G., & Ratnaweera, H. (2018) · Journal of Hydrology · doi:10.1016/j.jhydrol.2017.11.018 · Cited by 271
Caffeine: Toward Uniformed Representation and Acceleration for Deep Convolutional Neural Networks
Zhang, C., Sun, G., Fang, Z., Zhou, P., Pan, P., & Cong, J. (2019) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2017.2785257 · Cited by 270
Failure and reliability prediction by support vector machines regression of time series data
Moura, M. D. C., Zio, E., Lins, I. D., & Droguett, E. (2011) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2011.06.006 · Cited by 265
Stock Market Prediction on High-Frequency Data Using Generative Adversarial Nets
Zhou, X., Pan, Z., Hu, G., Tang, S., & Zhao, C. (2018) · Mathematical Problems in Engineering · doi:10.1155/2018/4907423 · Cited by 258
Deep Transfer Learning for Crop Yield Prediction with Remote Sensing Data
Wang, A. X., Tran, C., Desai, N., Lobell, D., & Ermon, S. (2018) · Proceedings of the 1st ACM SIGCAS Conference on Computing and Sustainable Societies · doi:10.1145/3209811.3212707 · Cited by 254
Cooperative coevolution of Elman recurrent neural networks for chaotic time series prediction
Chandra, R., & Zhang, M. (2012) · Neurocomputing · doi:10.1016/j.neucom.2012.01.014 · Cited by 243
k-Nearest Neighbor Model for Multiple-Time-Step Prediction of Short-Term Traffic Condition
Yu, B., Song, X., Guan, F., Yang, Z., & Yao, B. (2016) · Journal of Transportation Engineering · doi:10.1061/(asce)te.1943-5436.0000816 · Cited by 243
Wu, Y., & Tan, H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.01022 · Cited by 243
Probabilistic Wind Power Forecasting Using Radial Basis Function Neural Networks
Sideratos, G., & Hatziargyriou, N. D. (2012) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2012.2187803 · Cited by 235
Short-term wind speed prediction using empirical wavelet transform and Gaussian process regression
Hu, J., & Wang, J. (2015) · Energy · doi:10.1016/j.energy.2015.10.041 · Cited by 228
Data mining and wind power prediction: A literature review
Colak, I., Sagiroglu, S., & Yesilbudak, M. (2012) · Renewable Energy · doi:10.1016/j.renene.2012.02.015 · Cited by 222
Miller, T., Howe, P., & Sonenberg, L. (2017) · arXiv · doi:10.48550/arxiv.1712.00547 · Cited by 218
Predictive Deep Boltzmann Machine for Multiperiod Wind Speed Forecasting
Zhang, C.-Y., Chen, C. L. P., Gan, M., & Chen, L. (2015) · IEEE Transactions on Sustainable Energy · doi:10.1109/tste.2015.2434387 · Cited by 215
PSO-based analysis of Echo State Network parameters for time series forecasting
Chouikhi, N., Ammar, B., Rokbani, N., & Alimi, A. M. (2017) · Applied Soft Computing · doi:10.1016/j.asoc.2017.01.049 · Cited by 205
Sparse Deep Stacking Network for Fault Diagnosis of Motor
Sun, C., Ma, M., Zhao, Z., & Chen, X. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2819674 · Cited by 202
Daily reservoir inflow forecasting using multiscale deep feature learning with hybrid models
Bai, Y., Chen, Z., Xie, J., & Li, C. (2016) · Journal of Hydrology · doi:10.1016/j.jhydrol.2015.11.011 · Cited by 199
Ramedani, Z., Omid, M., Keyhani, A., Shamshirband, S., & Khoshnevisan, B. (2014) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2014.07.108 · Cited by 198
Prediction of noisy chaotic time series using an optimal radial basis function neural network
Leung, H., Lo, T., & Wang, S. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.950144 · Cited by 191
Self-citationOnline ARIMA Algorithms for Time Series Prediction
Liu, C., Hoi, S. C. H., Zhao, P., & Sun, J. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10257 · Cited by 191
Variational Heteroscedastic Gaussian Process Regression
Titsias, M. K., & Lázaro-Gredilla, M. (2011) · International Conference on Machine Learning · Cited by 190
Chaotic time series prediction with a global model: Artificial neural network
Karunasinghe, D. S. K., & Liong, S. (2005) · Journal of Hydrology · doi:10.1016/j.jhydrol.2005.07.048 · Cited by 178
Time series forecasting using backpropagation neural networks
Wong, F. S. (1991) · Neurocomputing · doi:10.1016/0925-2312(91)90045-d · Cited by 171
Data driven parallel prediction of building energy consumption using generative adversarial nets
Tian, C., Li, C., Zhang, G., & Lv, Y. (2019) · Energy and Buildings · doi:10.1016/j.enbuild.2019.01.034 · Cited by 168
Hoermann, S., Bach, M., & Dietmayer, K. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460874 · Cited by 166
Hutchinson, B., Deng, L., & Yu, D. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.268 · Cited by 165
Back propagation in time‐series forecasting
Lachtermacher, G., & Fuller, J. D. (1995) · Journal of Forecasting · doi:10.1002/for.3980140405 · Cited by 164
Chandra, R. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2404823 · Cited by 162
Day-Ahead Deregulated Electricity Market Price Forecasting Using Recurrent Neural Network
Anbazhagan, S., & Kumarappan, N. (2013) · IEEE Systems Journal · doi:10.1109/jsyst.2012.2225733 · Cited by 160
Least squares support vector machine for short-term prediction of meteorological time series
Mellit, A., Pavan, A. M., & Benghanem, M. (2013) · Theoretical and Applied Climatology · doi:10.1007/s00704-012-0661-7 · Cited by 159
Harpham, C., & Dawson, C. W. (2006) · Neurocomputing · doi:10.1016/j.neucom.2005.07.010 · Cited by 159
Gradient radial basis function networks for nonlinear and nonstationary time series prediction
Chng, E. S., Chen, S., & Mulgrew, B. (1996) · IEEE Transactions on Neural Networks · doi:10.1109/72.478403 · Cited by 159
Multi-output support vector machine for regional multi-step-ahead PM2.5 forecasting
Zhou, Y., Chang, F.-J., Chang, L.-C., Kao, I.-F., Wang, Y.-S., & Kang, C.-C. (2019) · Science of The Total Environment · doi:10.1016/j.scitotenv.2018.09.111 · Cited by 159
Miranian, A., & Abdollahzade, M. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2227148 · Cited by 152
PM2.5 concentration prediction using hidden semi-Markov model-based times series data mining
Dong, M., Yang, D., Kuang, Y., He, D., Erdal, S., & Kenski, D. M. (2008) · Expert Systems with Applications · doi:10.1016/j.eswa.2008.12.017 · Cited by 149
Conditional Restricted Boltzmann Machines for Structured Output PredictionPreprint
Mnih, V., Larochelle, H., & Hinton, G. E. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1202.3748 · Cited by 147
Deep Supervised and Contractive Neural Network for SAR Image Classification
Geng, J., Wang, H., Fan, J., & Ma, X. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2645226 · Cited by 142
Filonov, P., Lavrentyev, A., & Vorontsov, A. (2016) · arXiv · doi:10.48550/arxiv.1612.06676 · Cited by 140
Recursive Bayesian Recurrent Neural Networks for Time-Series Modeling
Mirikitani, D. T., & Nikolaev, N. (2010) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2009.2036174 · Cited by 137
Short-term prediction of wind power using EMD and chaotic theory
An, X., Jiang, D., Zhao, M., & Liu, C. (2011) · Communications in Nonlinear Science and Numerical Simulation · doi:10.1016/j.cnsns.2011.06.003 · Cited by 136
Wang, L., Wang, Z., & Liu, S. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.08.055 · Cited by 123
Shao, Z., Zhang, L., & Wang, L. (2017) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2017.2748341 · Cited by 122
An Autoencoder-Based Image Reconstruction for Electrical Capacitance Tomography
Zheng, J., & Peng, L. (2018) · IEEE Sensors Journal · doi:10.1109/jsen.2018.2836337 · Cited by 119
Lu, W., Yang, J., Liu, X., & Witold Pedrycz, C. (2014) · Knowledge-Based Systems · doi:10.1016/j.knosys.2014.07.004 · Cited by 114
Recurrent Neural Networks for Missing or Asynchronous Data
Bengio, Y., & Gingras, F. (1995) · neural information processing systems · Cited by 109
Al-Qahtani, F. H., & Crone, S. F. (2013) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2013.6706742 · Cited by 105
Time series forecasting based on wavelet filtering
Joo, T. W., & Kim, S. B. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.01.026 · Cited by 104
Deep-STEP: A Deep Learning Approach for Spatiotemporal Prediction of Remote Sensing Data
Das, M., & Ghosh, S. K. (2016) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2016.2619984 · Cited by 103
An Efficient Interval Type-2 Fuzzy CMAC for Chaos Time-Series Prediction and Synchronization
Lee, C., Chang, F., & Lin, C. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2013.2254113 · Cited by 100
Generative Adversarial Networks for Parallel Transportation Systems
Lv, Y., Chen, Y., Li, L., & Wang, F. (2018) · IEEE Intelligent Transportation Systems Magazine · doi:10.1109/mits.2018.2842249 · Cited by 97
Joint Prediction of Continuous and Discrete States in Time-Series Based on Belief Functions
Ramasso, E., Rombaut, M., & Noureddine Zerhouni, A. (2012) · IEEE Transactions on Cybernetics · doi:10.1109/tsmcb.2012.2198882 · Cited by 95
Cohen, W. W., & Carvalho, V. R. (2005) · Cited by 94
Learning and Selecting Features Jointly with Point-wise Gated Boltzmann Machines
Sohn, K., Zhou, G., Lee, C., & Lee, H. (2013) · Cited by 93
Gaussian Process Regression Stochastic Volatility Model for Financial Time Series
Han, J., Zhang, X.-P. S., & Wang, F. (2016) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2016.2570738 · Cited by 84
Early prediction on time series: a nearest neighbor approach
Xing, Z., Pei, J., & Yu, P. S. (2009) · Cited by 82
Zhang, X., Chen, G., Wang, W., Wang, Q., & Dai, F. (2017) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2017.2672736 · Cited by 78
Self-citationMyung, J., Kim, D., Kho, S., & Park, C. (2011) · Transportation Research Record Journal of the Transportation Research Board · doi:10.3141/2256-07 · Cited by 77
A novel double deep ELMs ensemble system for time series forecasting
Song, G., & Dai, Q. (2017) · Knowledge-Based Systems · doi:10.1016/j.knosys.2017.07.014 · Cited by 77
Extended and Unscented Kalman filtering based feedforward neural networks for time series prediction
Wu, X., & Wang, Y. (2011) · Applied Mathematical Modelling · doi:10.1016/j.apm.2011.07.052 · Cited by 76
Chen, J., Jin, Q., & Jing, C. (2012) · Mathematical Problems in Engineering · doi:10.1155/2012/235929 · Cited by 74
Liang, Y., Cui, Z., Tian, Y., Chen, H., & Wang, Y. (2018) · Transportation Research Record Journal of the Transportation Research Board · doi:10.1177/0361198118798737 · Cited by 74
A Deep-Learning-Based Forecasting Ensemble to Predict Missing Data for Remote Sensing Analysis
Das, M., & Ghosh, S. K. (2017) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2017.2760202 · Cited by 73
Nonlinear Dynamic Boltzmann Machines for Time-Series Prediction
Dasgupta, S., & Osogami, T. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10806 · Cited by 71
Big-data-generated traffic flow prediction using deep learning and dempster-shafer theory
Soua, R., Koesdwiady, A. B., & Karray, F. (2016) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727607 · Cited by 70
Cowton, J., Kyriazakis, I., Plötz, T., & Bacardit, J. (2018) · Sensors · doi:10.3390/s18082521 · Cited by 69
Eğrioğlu, E., Yolcu, U., Aladağ, Ç. H., & Baş, E. (2014) · Neural Processing Letters · doi:10.1007/s11063-014-9342-0 · Cited by 68
Nonparametric guidance of autoencoder representations using label information
Snoek, J., Adams, R. P., & Larochelle, H. (2012) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · doi:10.5555/2503308.2503324 · Cited by 67
Quan, T., Liu, X., & Liu, Q. (2009) · Applied Soft Computing · doi:10.1016/j.asoc.2009.08.025 · Cited by 66
A novel model of leaky integrator echo state network for time-series prediction
Lun, S., Yao, X., Qi, H.-Y., & Hu, H. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.02.029 · Cited by 65
Kou, P., Liang, D., Gao, L., & Lou, J. (2014) · Energy Conversion and Management · doi:10.1016/j.enconman.2014.10.003 · Cited by 65
Incremental Dual-memory LSTM in Land Cover Prediction
Jia, X., Khandelwal, A., Nayak, G., Gerber, J., Carlson, K. M., West, P. C., & Kumar, V. (2017) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3097983.3098112 · Cited by 64
Multi-step-ahead host load prediction using autoencoder and echo state networks in cloud computing
Yang, Q., Zhou, Y., Yu, Y., Yuan, J., Xing, X., & Du, S. (2015) · The Journal of Supercomputing · doi:10.1007/s11227-015-1426-8 · Cited by 63
Chaotic time series prediction with employment of ant colony optimization
Gromov, V. A., & Shulga, A. N. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2012.01.171 · Cited by 63
Eğrioğlu, E., Yolcu, U., Aladağ, Ç. H., & Baş, E. (2014) · Procedia - Social and Behavioral Sciences · doi:10.1016/j.sbspro.2013.12.593 · Cited by 62
Infrastructure Deterioration Prediction with a Poisson Hidden Markov Model on Time Series Data
Lethanh, N., KAITO, K., & Kobayashi, K. (2014) · Journal of Infrastructure Systems · doi:10.1061/(asce)is.1943-555x.0000242 · Cited by 62
Sparse Deep Stacking Network for Image Classification
Li, J., Chang, H., & Yang, J. J. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9786 · Cited by 60
SINGH, S. P., Urooj, S., & Lay-Ekuakille, A. (2016) · IEEE Sensors Journal · doi:10.1109/jsen.2016.2533440 · Cited by 56
Deep learning approach for large scale land cover mapping based on remote sensing data fusion
Kussul, N., Шелестов, А. Ю., Лавренюк, М. С., Butko, I., & Skakun, S. V. (2016) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss.2016.7729043 · Cited by 55
Time Series Forecasting Using Restricted Boltzmann Machine
Kuremoto, T., Kimura, S., Kobayashi, K., & Obayashi, M. (2012) · Communications in computer and information science · doi:10.1007/978-3-642-31837-5_3 · Cited by 44
Random features for Kernel Deep Convex Network
Huang, P.-S., Deng, L., Hasegawa‐Johnson, M., & He, X. (2013) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2013.6638237 · Cited by 40
Gaussian process for long-term time-series forecasting
Yan, W., Qiu, H., & Xue, Y. (2009) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2009.5178729 · Cited by 35
Recurrent deep stacking networks for supervised speech separation
Wang, Z.-Q., & Wang, D. (2017) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2017.7952120 · Cited by 34
Forecast chaotic time series data by DBNs
Kuremoto, T., Obayashi, M., Kobayashi, K., Hirata, T., & Mabu, S. (2014) · International Congress on Image and Signal Processing (CISP) · doi:10.1109/cisp.2014.7003950 · Cited by 31
Semi-described and semi-supervised learning with Gaussian processesPreprint
Damianou, A., & Lawrence, N. D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1509.01168 · Cited by 30
Convolutional Deep Stacking Networks for distributed compressive sensing
Palangi, H., Ward, R. K., & Deng, L. (2016) · Signal Processing · doi:10.1016/j.sigpro.2016.07.006 · Cited by 30
Wang, X., Wu, J. T., Liu, C., Wang, S., & Niu, W. (2016) · Quality and Reliability Engineering International · doi:10.1002/qre.2098 · Cited by 27
Time series prediction using dynamic Bayesian network
Xiao, Q., Chu, C., & Li, Z. (2017) · Optik · doi:10.1016/j.ijleo.2017.01.073 · Cited by 26
Stacked Denoising Auto-Encoders for Short-Term Time Series Forecasting
Romeu, P., Zamora-Martínez, F., Botella-Rocamora, P., et al. (2014) · Springer series in bio-/neuroinformatics · doi:10.1007/978-3-319-09903-3_23 · Cited by 24
LSTM for diagnosis of neurodegenerative diseases using gait data
Zhao, A., Dong, J., Li, J., Qi, L., & Yu, H. L. (2018) · International Conference on Graphics and Image Processing (ICGIP) · doi:10.1117/12.2305277 · Cited by 24
Time series prediction for evolutions of complex systems: A deep learning approach
Jiang, P., Chen, C., & Liu, X. (2016) · International Conference on Control and Robotics Engineering (ICCRE) · doi:10.1109/iccre.2016.7476150 · Cited by 21
Cited by
Artificial intelligence for modeling and understanding extreme weather and climate events
Camps-Valls, G., Fernández-Torres, M.-Á., Cohrs, K.-H., Höhl, A., Castelletti, A., Pacal, A., Robin, C., Martinuzzi, F., Papoutsis, I., Prapas, I., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-56573-8 · Cited by 288
Metadata
- Authors
- Han, Z., Zhao, J., Leung, H., Ma, K. F., & Wang, W.
- Venue
- IEEE Sensors Journal
- Published
- 2021-03-15
- Volume
- 21
- Issue
- 6
- Pages
- 7833-7848
- ISSN
- 1530-437X (ISSN-L)
- 1558-1748
- 2379-9153
- OpenAlex
- W2949449669
- Cited by
- 501
- References
- 208
- FWCI
- 14.62
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.