The DOI matches its Crossref record; 86 of the 86 references it cites were found in a registry or an index.
Deep learning for time series forecasting: The electric load case
Open accessAbstract
Management and efficient operations in critical infrastructures such as smart grids take huge advantage of accurate power load forecasting, which, due to its non‐linear nature, remains a challenging task. Recently, deep learning has emerged in the machine learning field achieving impressive performance in a vast range of tasks, from image classification to machine translation. Applications of deep learning models to the electric load forecasting problem are gaining interest among researchers as well as the industry, but a comprehensive and sound comparison among different—also traditional—architectures is not yet available in the literature. This work aims at filling the gap by reviewing and experimentally evaluating four real world datasets on the most recent trends in electric load forecasting, by contrasting deep learning architectures on short‐term forecast (one‐day‐ahead prediction). Specifically, the focus is on feedforward and recurrent neural networks, sequence‐to‐sequence models and temporal convolutional neural networks along with architectural variants, which are known in the signal processing community but are novel to the load forecasting one.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations
Rumelhart, D. E., McClelland, J. L., & AU (1986) · doi:10.7551/mitpress/5236.001.0001 · Cited by 15,686
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network
Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., Wang, Z., et al. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.19 · Cited by 12,696
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Pattern Recognition and Machine Learning
(2006) · doi:10.1007/978-0-387-45528-0 · Cited by 9,824
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
Learning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248
(2006) · Springer eBooks · Cited by 8,123
Greff, K., Srivastava, R. K., Koutnik, J., Steunebrink, B. R., & Schmidhuber, J. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2582924 · Cited by 6,955
ADADELTA: An Adaptive Learning Rate Method
Zeiler, M. D. (2012) · arXiv · doi:10.48550/arxiv.1212.5701 · Cited by 5,322
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., et al. (2016) · arXiv · doi:10.48550/arxiv.1609.08144 · Cited by 5,319
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911
Backpropagation through time: what it does and how to do it
Werbos, P. J. (1990) · Proceedings of the IEEE · doi:10.1109/5.58337 · Cited by 4,879
An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
Bai, S., Kolter, J. Z., & Koltun, V. (2018) · arXiv · doi:10.48550/arxiv.1803.01271 · Cited by 4,655
A Learning Algorithm for Continually Running Fully Recurrent Neural Networks
Williams, R. J., & Zipser, D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.2.270 · Cited by 4,369
On the difficulty of training recurrent neural networks
Pascanu, R., Mikolov, T., & Bengio, Y. (2012) · arXiv · doi:10.48550/arxiv.1211.5063 · Cited by 4,310
Smart Grid — The New and Improved Power Grid: A Survey
Fang, X., Misra, S., Xue, G., & Yang, D. (2012) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2011.101911.00087 · Cited by 3,405
Convolutional Sequence to Sequence Learning
Gehring, J., Auli, M., Grangier, D., Yarats, D., & Dauphin, Y. N. (2017) · arXiv · doi:10.48550/arxiv.1705.03122 · Cited by 2,850
Short-Term Residential Load Forecasting Based on LSTM Recurrent Neural Network
Kong, W., Dong, Z. Y., Jia, Y., Hill, D. J., Xu, Y., & Zhang, Y. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2017.2753802 · Cited by 2,645
Neural networks for short-term load forecasting: a review and evaluation
Hippert, H. S., Pedreira, C. E., & Souza, R. C. (2001) · IEEE Transactions on Power Systems · doi:10.1109/59.910780 · Cited by 2,221
Attention-Based Models for Speech Recognition
Chorowski, J., Bahdanau, D., Serdyuk, D., Cho, K., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1506.07503 · Cited by 2,021
Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks
Bengio, S., Vinyals, O., Jaitly, N., & Shazeer, N. (2015) · arXiv · doi:10.48550/arxiv.1506.03099 · Cited by 1,621
Electric load forecasting using an artificial neural network
Park, D.-C., El-Sharkawi, M. A., Marks, R. J., Atlas, L., & Damborg, M. J. (1991) · IEEE Transactions on Power Systems · doi:10.1109/59.76685 · Cited by 1,440
Sequence Level Training with Recurrent Neural Networks
Ranzato, M., Chopra, S., Auli, M., & Zaremba, W. (2015) · arXiv · doi:10.48550/arxiv.1511.06732 · Cited by 1,426
A guide to convolution arithmetic for deep learning
Dumoulin, V., & Visin, F. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.07285 · Cited by 1,172
End-to-end attention-based large vocabulary speech recognition
Bahdanau, D., Chorowski, J., Serdyuk, D., Brakel, P., & Bengio, Y. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472618 · Cited by 1,096
Probabilistic energy forecasting: Global Energy Forecasting Competition 2014 and beyond
Hong, T., Pinson, P., Fan, S., Zareipour, H., Troccoli, A., & Hyndman, R. J. (2016) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2016.02.001 · Cited by 1,044
Bouktif, S., Fiaz, A., Ouni, A., & Serhani, M. (2018) · Energies · doi:10.3390/en11071636 · Cited by 915
Comparative Study of CNN and RNN for Natural Language Processing
Yin, W., Kann, K., Yu, M., & Schütze, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.01923 · Cited by 861
Ben Taieb, S., Bontempi, G., Atiya, A. F., & Sorjamaa, A. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2012.01.039 · Cited by 734
Huang, S.-J., & Shih, K.-R. (2003) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2003.811010 · Cited by 675
Short-Term Load Forecasting With Deep Residual Networks
Chen, K., Chen, K., Wang, Q., He, Z., Hu, J., & He, J. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2844307 · Cited by 674
(2014) · International Conference on Learning Representations · Cited by 634
Deep learning for estimating building energy consumption
Mocanu, E., Nguyen, P. H., Gibescu, M., & Kling, W. L. (2016) · Sustainable Energy, Grids and Networks · doi:10.1016/j.segan.2016.02.005 · Cited by 622
Short-term load forecasting using an artificial neural network
Lee, K. Y., Cha, Y. T., & Park, J. H. (1992) · IEEE Transactions on Power Systems · doi:10.1109/59.141695 · Cited by 602
An Efficient Gradient-Based Algorithm for On-Line Training of Recurrent Network Trajectories
Williams, R. J., & Peng, J. (1990) · Neural Computation · doi:10.1162/neco.1990.2.4.490 · Cited by 577
Sequence Level Training with Recurrent Neural Networks
Ranzato, M., Chopra, S., Auli, M., & Zaremba, W. (2016) · International Conference on Learning Representations · Cited by 572
Global Energy Forecasting Competition 2012
Hong, T., Pinson, P., & Fan, S. (2014) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2013.07.001 · Cited by 564
The Time Series Approach to Short Term Load Forecasting
Hagan, M. T., & Behr, S. M. (1987) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.1987.4335210 · Cited by 546
Building energy load forecasting using Deep Neural Networks
Marino, D. L., Amarasinghe, K., & Manic, M. (2016) · IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society · doi:10.1109/iecon.2016.7793413 · Cited by 522
Training and Analysing Deep Recurrent Neural Networks
Hermans, M., & Schrauwen, B. (2013) · neural information processing systems · Cited by 488
Learning Complex, Extended Sequences Using the Principle of History Compression
Schmidhuber, J. (1992) · Neural Computation · doi:10.1162/neco.1992.4.2.234 · Cited by 398
Probabilistic forecasting with temporal convolutional neural network
Chen, Y., Kang, Y., Chen, Y., & Wang, Z. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.03.011 · Cited by 393
Tian, C., Ma, J., Zhang, C., & Zhan, P. (2018) · Energies · doi:10.3390/en11123493 · Cited by 384
Conditional Time Series Forecasting with Convolutional Neural Networks
Borovykh, A., Bohté, S. M., & Oosterlee, C. W. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.04691 · Cited by 362
Electric load forecasting in smart grids using Long-Short-Term-Memory based Recurrent Neural Network
Zheng, J., Xu, C., Zhang, Z., & Li, X. (2017) · 2017 51st Annual Conference on Information Sciences and Systems (CISS) · doi:10.1109/ciss.2017.7926112 · Cited by 341
Deep neural networks for energy load forecasting
Amarasinghe, K., Marino, D. L., & Manic, M. (2017) · 2017 IEEE 26th International Symposium on Industrial Electronics (ISIE) · doi:10.1109/isie.2017.8001465 · Cited by 336
A High Precision Artificial Neural Networks Model for Short-Term Energy Load Forecasting
Kuo, P.-H., & Huang, C.-J. (2018) · Energies · doi:10.3390/en11010213 · Cited by 332
Professor Forcing: A New Algorithm for Training Recurrent Networks
Lamb, A., Goyal, A., Zhang, Y., Zhang, S., Courville, A. C., & Bengio, Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.09038 · Cited by 290
Load Forecasting via Deep Neural Networks
He, W. (2017) · Procedia Computer Science · doi:10.1016/j.procs.2017.11.374 · Cited by 287
Recurrent Neural Networks for Short-Term Load Forecasting: An Overview and Comparative Analysis
Bianchi, F. M., Maiorino, E., Kampffmeyer, M. C., Rizzi, A., & Jenssen, R. (2017) · SpringerBriefs in Computer Science · doi:10.1007/978-3-319-70338-1 · Cited by 280
A methodology for Electric Power Load Forecasting
Almeshaiei, E., & Soltan, H. (2011) · Alexandria Engineering Journal · doi:10.1016/j.aej.2011.01.015 · Cited by 271
A Particle Swarm Optimization to Identifying the ARMAX Model for Short-Term Load Forecasting
Huang, C.-M., Huang, C.-J., & Wang, M.-L. (2005) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2005.846106 · Cited by 260
Chen, J.-F., Wang, W.-M., & Huang, C.-M. (1995) · Electric Power Systems Research · doi:10.1016/0378-7796(95)00977-1 · Cited by 253
A Review of Deep Learning Methods Applied on Load Forecasting
Almalaq, A., & Edwards, G. (2017) · 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA) · doi:10.1109/icmla.2017.0-110 · Cited by 253
Pixel Recursive Super Resolution
Dahl, R., Norouzi, M., & Shlens, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.581 · Cited by 246
Deep Reinforcement Learning for Sequence-to-Sequence Models
Keneshloo, Y., Shi, T., Ramakrishnan, N., & Reddy, C. K. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2929141 · Cited by 230
Weather sensitive short-term load forecasting using nonfully connected artificial neural network
Chen, S.-T., Yu, D. C., & Moghaddamjo, A. R. (1992) · IEEE Transactions on Power Systems · doi:10.1109/59.207323 · Cited by 228
Deep Learning for Load Forecasting: Sequence to Sequence Recurrent Neural Networks With Attention
Sehovac, L., & Grolinger, K. (2020) · IEEE Access · doi:10.1109/access.2020.2975738 · Cited by 209
An overview and comparative analysis of Recurrent Neural Networks for Short Term Load Forecasting
Bianchi, F. M., Maiorino, E., Kampffmeyer, M., Rizzi, A., & Jenssen, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.04378 · Cited by 182
Identification of ARMAX model for short term load forecasting: an evolutionary programming approach
Yang, H.-T., Huang, C.-M., & Huang, C.-L. (1996) · IEEE Transactions on Power Systems · doi:10.1109/59.486125 · Cited by 176
Jin, X.-B., Zheng, W.-Z., Kong, J.-L., Wang, X.-Y., Bai, Y.-T., Su, T.-L., & Lin, S. (2021) · Energies · doi:10.3390/en14061596 · Cited by 171
Short-Term Electric Load Forecasting Using Echo State Networks and PCA Decomposition
Bianchi, F. M., De Santis, E., Rizzi, A., & Sadeghian, A. (2015) · IEEE Access · doi:10.1109/access.2015.2485943 · Cited by 166
Building-level occupancy data to improve ARIMA-based electricity use forecasts
Newsham, G. R., & Birt, B. J. (2010) · doi:10.1145/1878431.1878435 · Cited by 138
Short-term load forecasting with local ANN predictors
Drezga, I., & Rahman, S. (1999) · IEEE Transactions on Power Systems · doi:10.1109/59.780894 · Cited by 135
Short-Term Load Forecasting with Multi-Source Data Using Gated Recurrent Unit Neural Networks
Wang, Y., Liu, M., Bao, Z., & Zhang, S. (2018) · Energies · doi:10.3390/en11051138 · Cited by 121
Forecasting Building Energy Consumption with Deep Learning: A Sequence to Sequence Approach
Sehovac, L., Nesen, C., & Grolinger, K. (2019) · IEEE International Congress on Internet of Things (ICIOT) · doi:10.1109/iciot.2019.00029 · Cited by 94
A neural network short-term load forecaster
Srinivasan, D., Liew, A. C., & Chang, C. S. (1994) · Electric Power Systems Research · doi:10.1016/0378-7796(94)90037-x · Cited by 92
Residential electrical demand forecasting in very small scale: An evaluation of forecasting methods
Marinescu, A., Harris, C., Dusparić, I., et al. (2013) · doi:10.1109/se4sg.2013.6596108 · Cited by 82
Long-term prediction of time series by combining direct and MIMO strategies
Taieb, S. B., Bontempi, G., Antti Sorjamaa, B., & Lendasse, A. (2009) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2009.5178802 · Cited by 81
Using Recurrent Artificial Neural Networks to Forecast Household Electricity Consumption
Marvuglia, A., & Messineo, A. (2012) · Energy Procedia · doi:10.1016/j.egypro.2011.12.895 · Cited by 80
PowerLSTM: Power Demand Forecasting Using Long Short-Term Memory Neural Network
Cheng, Y., Xu, C., Mashima, D., Thing, V. L. L., & Wu, Y. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-69179-4_51 · Cited by 70
Short-Term Load Forecasting Using Encoder-Decoder WaveNet: Application to the French Grid
Rueda, F. D., Durán, J., & del Real, A. J. (2021) · Energies · doi:10.3390/en14092524 · Cited by 56
Wilms, H., Cupelli, M., & Monti, A. (2018) · IEEE International Conference on Industrial Informatics (INDIN) · doi:10.1109/indin.2018.8471953 · Cited by 20
Cluster-based Aggregate Load Forecasting with Deep Neural Networks
Cini, A., Luković, S., & Alippi, C. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207503 · Cited by 16
Self-citation
Cited by
Farsi, B., Amayri, M., Bouguila, N., & Eicker, U. (2021) · IEEE Access · doi:10.1109/access.2021.3060290 · Cited by 292
Metadata
- Authors
- Gasparin, A., Lukovic, S., & Alippi, C.
- Venue
- CAAI Transactions on Intelligence Technology
- Published
- 2021-09-22
- Volume
- 7
- Issue
- 1
- Pages
- 1-25
- ISSN
- 2468-2322 (ISSN-L)
- 2468-6557
- OpenAlex
- W2963868857
- Cited by
- 293
- References
- 86
- FWCI
- 11.59
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.