Neural basis expansion analysis with exogenous variables: Forecasting electricity prices with NBEATSx
Open accessThe DOI matches its Crossref record; 86 of the 86 references it cites were found in a registry or an index.
Abstract
We extend neural basis expansion analysis (NBEATS) to incorporate exogenous factors. The resulting method, called NBEATSx, improves on a well-performing deep learning model, extending its capabilities by including exogenous variables and allowing it to integrate multiple sources of useful information. To showcase the utility of the NBEATSx model, we conduct a comprehensive study of its application to electricity price forecasting tasks across a broad range of years and markets. We observe state-of-the-art performance, significantly improving the forecast accuracy by nearly 20% over the original NBEATS model, and by up to 5% over other well-established statistical and machine learning methods specialized for these tasks. Additionally, the proposed neural network has an interpretable configuration that can structurally decompose time series, visualizing the relative impact of trend and seasonal components and revealing the modeled processes’ interactions with exogenous factors. To assist related work, we made the code available in a dedicated repository.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Multivariate Adaptive Regression Splines
Friedman, J. H. (1991) · The Annals of Statistics · doi:10.1214/aos/1176347963 · Cited by 8,000
How transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061
Another look at measures of forecast accuracy
Hyndman, R. J., & Koehler, A. B. (2006) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2006.03.001 · Cited by 5,757 · cited 1×
“The sMAPE is used as an alternative to MAPE, which in the presence of values close to zero may degenerate (Hyndman & Koehler, 2006).”
Diebold, F., & Mariano, R. (1994) · National Bureau of Economic Research · doi:10.3386/t0169 · Cited by 5,185
Diebold, F. X., & Mariano, R. S. (1995) · Journal of Business & Economic Statistics · doi:10.1080/07350015.1995.10524599 · Cited by 5,130
WaveNet: a generative model for raw audio
Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911
Backpropagation through time: what it does and how to do it
Werbos, P. J. (1990) · Proceedings of the IEEE · doi:10.1109/5.58337 · Cited by 4,879 · cited 1×
“For a long time, sequence modeling with neural networks and Recurrent Neural Networks ( RNN s; Elman 1990) were treated as synonyms.”
Learning to forget: Continual prediction with LSTM
Gers, F. A., Schmidhuber, J., & Cummins, F. (2000) · Neural Computation · doi:10.1162/089976600300015015 · Cited by 4,823
An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
Bai, S., Kolter, J. Z., & Koltun, V. (2018) · arXiv · doi:10.48550/arxiv.1803.01271 · Cited by 4,655
Adapting to Unknown Smoothness via Wavelet Shrinkage
Donoho, D. L., & Johnstone, I. M. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476626 · Cited by 4,630
(2011) · Cited by 3,939
5th International Conference on Learning Representations (ICLR 17)
Havrylov, S., & Titov, I. (2017) · Cited by 3,503
Hastie, T., & Tibshirani, R. (1986) · Statistical Science · doi:10.1214/ss/1177013604 · Cited by 3,409
Generating Sequences With Recurrent Neural Networks
Graves, A. (2013) · arXiv · doi:10.48550/arxiv.1308.0850 · Cited by 2,894
DeepAR: Probabilistic forecasting with autoregressive recurrent networks
Salinas, D., Flunkert, V., Gasthaus, J., & Januschowski, T. (2020) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2019.07.001 · Cited by 2,661
The information bottleneck method
Tishby, N., Pereira, F. C., & Bialek, W. (2000) · arXiv · doi:10.48550/arxiv.physics/0004057 · Cited by 2,626
Deep Learning of Representations for Unsupervised and Transfer Learning.
Bengio, Y. (2011) · Cited by 1,702
The M3-Competition: results, conclusions and implications
Makridakis, S., & Hibon, M. (2000) · International Journal of Forecasting · doi:10.1016/s0169-2070(00)00057-1 · Cited by 1,695
PRINCIPLES OF NEURODYNAMICS. PERCEPTRONS AND THE THEORY OF BRAIN MECHANISMS
ROSENBLATT, F. (1961) · doi:10.21236/ad0256582 · Cited by 1,691
Electricity price forecasting: A review of the state-of-the-art with a look into the future
Weron, R. (2014) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2014.08.008 · Cited by 1,646 · cited 2×
“We conducted an empirical study involving two types of Autoregressive Models ( AR1 and ARx1 ; Weron 2014), the Lasso Estimated Auto-Regressive ( LEARx ; Uniejewski et al. 2016), a parsimonious Deep Neural Network ( DNN ; Lago et al. 2018a, 2021a), the original Neural Basis Expansion Analysis…”
Self-citationTests of Conditional Predictive Ability
Giacomini, R., & White, H. (2006) · Econometrica · doi:10.1111/j.1468-0262.2006.00718.x · Cited by 1,646
Statistical and machine learning forecasting methods: Concerns and ways forward
Makridakis, S., Spiliotis, E., & Assimakopoulos, V. (2018) · PLOS ONE · doi:10.1371/journal.pone.0194889 · Cited by 1,528
A review of unsupervised feature learning and deep learning for time-series modeling
Längkvist, M., Karlsson, L., & Loutfi, A. (2014) · Pattern Recognition Letters · doi:10.1016/j.patrec.2014.01.008 · Cited by 1,243
Regularization Networks and Support Vector Machines
Evgeniou, T., Pontil, M., & Poggio, T. (2000) · Advances in Computational Mathematics · doi:10.1023/a:1018946025316 · Cited by 1,197
Forecasting Time Series With Complex Seasonal Patterns Using Exponential Smoothing
De Livera, A. M., Hyndman, R. J., & Snyder, R. D. (2011) · Journal of the American Statistical Association · doi:10.1198/jasa.2011.tm09771 · Cited by 1,049
Probabilistic energy forecasting: Global Energy Forecasting Competition 2014 and beyond
Hong, T., Pinson, P., Fan, S., Zareipour, H., Troccoli, A., & Hyndman, R. J. (2016) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2016.02.001 · Cited by 1,044
On Early Stopping in Gradient Descent Learning
Yao, Y., Rosasco, L., & Caponnetto, A. (2007) · Constructive Approximation · doi:10.1007/s00365-006-0663-2 · Cited by 970
The M4 Competition: 100,000 time series and 61 forecasting methods
Makridakis, S., Spiliotis, E., & Assimakopoulos, V. (2020) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2019.04.014 · Cited by 969
LeCun, Y., Bottou, L., Orr, G. B., & Müller, K. R. (1998) · Lecture Notes in Computer Science · doi:10.1007/3-540-49430-8_2 · Cited by 919
Neural Networks: Tricks of the Trade
(1998) · Lecture Notes in Computer Science · doi:10.1007/3-540-49430-8 · Cited by 810
A hybrid method of exponential smoothing and recurrent neural networks for time series forecasting
Smyl, S. (2020) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2019.03.017 · Cited by 761
(2017) · International Conference on Machine Learning · Cited by 758
New Capabilities and Methods of the X-12-ARIMA Seasonal-Adjustment Program
Findley, D. F., Monsell, B. C., Bell, W. R., Otto, M. C., & Chen, B.-C. (1998) · Journal of Business & Economic Statistics · doi:10.1080/07350015.1998.10524743 · Cited by 671
Lago, J., De Ridder, F., & De Schutter, B. (2018) · Applied Energy · doi:10.1016/j.apenergy.2018.02.069 · Cited by 642
Training and Analysing Deep Recurrent Neural Networks
Hermans, M., & Schrauwen, B. (2013) · neural information processing systems · Cited by 631
Recent advances in electricity price forecasting: A review of probabilistic forecasting
Nowotarski, J., & Weron, R. (2018) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2017.05.234 · Cited by 552
Self-citationLago, J., Marcjasz, G., De Schutter, B., & Weron, R. (2021) · Applied Energy · doi:10.1016/j.apenergy.2021.116983 · Cited by 524
Self-citationPrinciples of Neurodynamics. Perceptrons and the Theory of Brain Mechanisms.
Orbach, J. (1962) · Archives of General Psychiatry · doi:10.1001/archpsyc.1962.01720030064010 · Cited by 512
Neural Machine Translation in Linear Time
Kalchbrenner, N., Espeholt, L., Simonyan, K., Oord, A. V. D., Graves, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1610.10099 · Cited by 414 · cited 1×
“Nowadays, Seq2Seq models and their derivatives can learn complex nonlinear temporal dependencies efficiently; its use in the time series analysis domain has been a great success.”
Bagging exponential smoothing methods using STL decomposition and Box–Cox transformation
Bergmeir, C., Hyndman, R. J., & Benítez, J. M. (2016) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2015.07.002 · Cited by 328
Transfer learning for time series classification
Ismail Fawaz, H., Forestier, G., Weber, J., Idoumghar, L., & Muller, P.-A. (2018) · 2018 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata.2018.8621990 · Cited by 319
Electricity Price Forecasting Using Recurrent Neural Networks
Ugurlu, U., Oksuz, I., & Tas, O. (2018) · Energies · doi:10.3390/en11051255 · Cited by 299
The tourism forecasting competition
Athanasopoulos, G., Hyndman, R. J., Song, H., & Wu, D. C. (2011) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2010.04.009 · Cited by 281
Unsupervised Pretraining for Sequence to Sequence Learning
Ramachandran, P., Liu, P., & Le, Q. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1039 · Cited by 251
A Multi-Horizon Quantile Recurrent Forecaster
Wen, R., Torkkola, K., Narayanaswamy, B., & Madeka, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.11053 · Cited by 236
A Hybrid Residual Dilated LSTM and Exponential Smoothing Model for Midterm Electric Load Forecasting
Dudek, G., Pelka, P., & Smyl, S. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3046629 · Cited by 231
The Spectral Analysis of Time Series
Percival, D. B. (1998) · Technometrics · doi:10.1080/00401706.1998.10485571 · Cited by 223
Forecasting day-ahead electricity prices in Europe: The importance of considering market integration
Lago, J., De Ridder, F., Vrancx, P., & De Schutter, B. (2018) · Applied Energy · doi:10.1016/j.apenergy.2017.11.098 · Cited by 222
An Electricity Price Forecasting Model by Hybrid Structured Deep Neural Networks
Kuo, P.-H., & Huang, C.-J. (2018) · Sustainability · doi:10.3390/su10041280 · Cited by 199
Short-Term Electricity Price Forecasting With Stacked Denoising Autoencoders
Wang, L., Zhang, Z., & Chen, J. (2017) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2016.2628873 · Cited by 190
The Spectral Analysis of Time Series
(1995) · Elsevier eBooks · doi:10.1016/b978-0-12-419251-5.x5000-5 · Cited by 189
Li, W., & Becker, D. M. (2021) · Energy · doi:10.1016/j.energy.2021.121543 · Cited by 174
Automated Variable Selection and Shrinkage for Day-Ahead Electricity Price Forecasting
Uniejewski, B., Nowotarski, J., & Weron, R. (2016) · Energies · doi:10.3390/en9080621 · Cited by 170
Self-citationProbabilistic mid- and long-term electricity price forecasting
Ziel, F., & Steinert, R. (2018) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2018.05.038 · Cited by 164
An empirical comparison of alternative schemes for combining electricity spot price forecasts
Nowotarski, J., Raviv, E., Trück, S., & Weron, R. (2014) · Energy Economics · doi:10.1016/j.eneco.2014.07.014 · Cited by 159
Self-citationAn Optimized Heterogeneous Structure LSTM Network for Electricity Price Forecasting
Zhou, S., Zhou, L., Mao, M., Tai, H., & Wan, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2932999 · Cited by 155
Variance Stabilizing Transformations for Electricity Spot Price Forecasting
Uniejewski, B., Weron, R., & Ziel, F. (2017) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2017.2734563 · Cited by 154
Self-citationSTConvS2S: Spatiotemporal Convolutional Sequence to Sequence Network for weather forecasting
Castro, R., Souto, Y. M., Ogasawara, E., Porto, F. A. M., & Bezerra, E. A. D. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.09.060 · Cited by 148
Jahangir, H., Tayarani, H., Baghali, S., Ahmadian, A., Elkamel, A., Golkar, M. A., & Castilla, M. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2933009 · Cited by 139
Multi-agent microgrid energy management based on deep learning forecaster
Afrasiabi, M., Mohammadi, M., Rastegar, M., & Kargarian, A. (2019) · Energy · doi:10.1016/j.energy.2019.115873 · Cited by 131
Electricity markets around the world
Mayer, K., & Trück, S. (2018) · Journal of commodity markets · doi:10.1016/j.jcomm.2018.02.001 · Cited by 122
Deep Long Short-Term Memory: A New Price and Load Forecasting Scheme for Big Data in Smart Cities
Mujeeb, S., Javaid, N., Ilahi, M., Wadud, Z., Ishmanov, F., & Afzal, M. K. (2019) · Sustainability · doi:10.3390/su11040987 · Cited by 121
Macaulay, F. R. (1931) · RePEc: Research Papers in Economics · Cited by 116
Dilated Recurrent Neural Networks
Chang, S., Zhang, Y., Han, W., Yu, M., Guo, X., Tan, W. Q., Cui, X., Witbrock, M., Hasegawa‐Johnson, M., & Huang, T. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.02224 · Cited by 109
Econometric modelling and forecasting of intraday electricity prices
Narajewski, M., & Ziel, F. (2019) · Journal of commodity markets · doi:10.1016/j.jcomm.2019.100107 · Cited by 109
A Deep Learning Based Hybrid Framework for Day-Ahead Electricity Price Forecasting
Zhang, R., Li, G., & Ma, Z. (2020) · IEEE Access · doi:10.1109/access.2020.3014241 · Cited by 109
Electricity Price Forecasting for Operational Scheduling of Behind-the-Meter Storage Systems
Chitsaz, H., Zamani-Dehkordi, P., Zareipour, H., & Parikh, P. P. (2017) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2017.2717282 · Cited by 100
Neural forecasting: Introduction and literature overview.Preprint
Benidis, K., Rangapuram, S. S., Flunkert, V., Wang, B., Maddix, D. C., Türkmen, A. C., Gasthaus, J. A., Bohlke‐Schneider, M., Salinas, D., Stella, L., et al. (2020) · arXiv (Cornell University) · Cited by 95
Regularized quantile regression averaging for probabilistic electricity price forecasting
Uniejewski, B., & Weron, R. (2021) · Energy Economics · doi:10.1016/j.eneco.2021.105121 · Cited by 88
Self-citationA Note on Averaging Day-Ahead Electricity Price Forecasts Across Calibration Windows
Hubicka, K., Marcjasz, G., & Weron, R. (2018) · IEEE Transactions on Sustainable Energy · doi:10.1109/tste.2018.2869557 · Cited by 79
Self-citationZhang, F., Fleyeh, H. A., & Bales, C. (2020) · Journal of the Operational Research Society · doi:10.1080/01605682.2020.1843976 · Cited by 78
Gianfreda, A., Ravazzolo, F., & Rossini, L. (2020) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2019.11.002 · Cited by 77
Forecasting Electricity Prices Using Deep Neural Networks: A Robust Hyper-Parameter Selection Scheme
Marcjasz, G. (2020) · Energies · doi:10.3390/en13184605 · Cited by 29
Self-citationHe, H. X., Lu, N., Jiang, Y., Chen, B., & Jiao, R. (2020) · Energy Reports · doi:10.1016/j.egyr.2020.11.057 · Cited by 21
HFNet: Forecasting Real-Time Electricity Price via Novel GRU Architectures
Yang, H., & Schell, K. R. (2020) · International Conference on Probabilistic Methods Applied to Power Systems (PMAPS) · doi:10.1109/pmaps47429.2020.9183697 · Cited by 19
de Simón‐Martín, M., Bracco, S., Rosales-Asensio, E., Piazza, G., Delfino, F., & Giribone, P. G. (2020) · IEEE International Conference on Environment and Electrical Engineering and IEEE Industrial and Commercial Power Systems Europe (EEEIC / I&CPS Europe) · doi:10.1109/eeeic/icpseurope49358.2020.9160587 · Cited by 17
Short-Term Electricity Price Forecasting
Amjady, N. (2012) · CRC Press eBooks · doi:10.1201/b11649-4 · Cited by 11
Comparative Studies of Different Methods for Short-term Locational Marginal Price Forecasting
Hong, Y., & Pula, R. A. (2020) · International Conference on Green Technology and Sustainable Development (GTSD) · doi:10.1109/gtsd50082.2020.9303121 · Cited by 4
Research works printed but not linked: 2
- Atiya, 2020, Why does forecast combination work so well?, International Journal of Forecasting, 36, 197, 10.1016/j.ijforecast.2019.03.010 · doi:10.1016/j.ijforecast.2019.03.010
- Nazar, 2018, Hybrid model using three-stage algorithm for simultaneous load and price forecasting, Electric Power Systems Research, 165, 214, 10.1016/j.epsr.2018.09.004 · doi:10.1016/j.epsr.2018.09.004
Cited by
NHITS: Neural Hierarchical Interpolation for Time Series Forecasting
Challu, C., Olivares, K. G., Oreshkin, B. N., Garza Ramirez, F., Mergenthaler Canseco, M., & Dubrawski, A. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i6.25854 · Cited by 537
Self-citationDiffLoad: Uncertainty Quantification in Electrical Load Forecasting With the Diffusion Model
Wang, Z., Wen, Q., Zhang, C., Sun, L., & Wang, Y. (2025) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2024.3449032 · Cited by 34
“Note that here we consider the influence of covariates and use the version from [45], denoted as NBEATSX.”
Metadata
- Authors
- Olivares, K. G., Challu, C., Marcjasz, G., Weron, R., & Dubrawski, A.
- Venue
- International Journal of Forecasting
- Publisher
- Elsevier BV
- Published
- 2023-04
- Volume
- 39
- Issue
- 2
- Pages
- 884-900
- ISSN
- 0169-2070 (ISSN-L)
- OpenAlex
- W3154291377
- Cited by
- 262
- References
- 86
- FWCI
- 12.45
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- creativecommons.org/licenses/by/4.0/ (vor)
- Funders
- National Science Foundation (2038612)
- National Aeronautics and Space Administration
- U.S. Department of Homeland Security (18DN-ARI-00031)
- Defense Advanced Research Projects Agency (FA8750-17-2-0130)
- Narodowe Centrum Nauki (2018/30/A/HS4/00444)
- Ministry of Education and Science (0219/DIA/2019/48)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.