Multi-Sequence LSTM-RNN Deep Learning and Metaheuristics for Electric Load Forecasting
Open accessThe DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Short term electric load forecasting plays a crucial role for utility companies, as it allows for the efficient operation and management of power grid networks, optimal balancing between production and demand, as well as reduced production costs. As the volume and variety of energy data provided by building automation systems, smart meters, and other sources are continuously increasing, long short-term memory (LSTM) deep learning models have become an attractive approach for energy load forecasting. These models are characterized by their capabilities of learning long-term dependencies in collected electric data, which lead to accurate prediction results that outperform several alternative statistical and machine learning approaches. Unfortunately, applying LSTM models may not produce acceptable forecasting results, not only because of the noisy electric data but also due to the naive selection of its hyperparameter values. Therefore, an optimal configuration of an LSTM model is necessary to describe the electric consumption patterns and discover the time-series dynamics in the energy domain. Finding such an optimal configuration is, on the one hand, a combinatorial problem where selection is done from a very large space of choices; on the other hand, it is a learning problem where the hyperparameters should reflect the energy consumption domain knowledge, such as the influential time lags, seasonality, periodicity, and other temporal attributes. To handle this problem, we use in this paper metaheuristic-search-based algorithms, known by their ability to alleviate search complexity as well as their capacity to learn from the domain where they are applied, to find optimal or near-optimal values for the set of tunable LSTM hyperparameters in the electrical energy consumption domain. We tailor both a genetic algorithm (GA) and particle swarm optimization (PSO) to learn hyperparameters for load forecasting in the context of energy consumption of big data. The statistical analysis of the obtained result shows that the multi-sequence deep learning model tuned by the metaheuristic search algorithms provides more accurate results than the benchmark machine learning models and the LSTM model whose inputs and hyperparameters were established through limited experience and a discounted number of experimentations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures












Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Bouktif et al. [43] optimized the LSTM hyperparameters in their prediction model using GA and PSO.”
From Prediction of Heat and Cold Loads of Factory Mushroom Houses Based on EWT Decomposition (2023) · cites this paper as [43]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 1×
“In particular, LSTM networks, deep learning variations proposed by Hochreiter and Schmidhuber [8], were designed specially to learn long-term dependencies present in sequential data.”
BackgroundKennedy, J., & Eberhart, R. (2002) · Proceedings of ICNN'95 - International Conference on Neural Networks · doi:10.1109/icnn.1995.488968 · Cited by 58,192
Particle swarm optimization: An overview
Poli, R., Kennedy, J., & Blackwell, T. (2007) · Swarm Intelligence · doi:10.1007/s11721-007-0002-0 · Cited by 21,101 · cited 1×
“It is evolved by imitating the social behavior of a school of fishes and a flock of birds that collectively search for the best locations and are likely to move close to an optimum fitness function [39].”
BackgroundA new optimizer using particle swarm theory
Eberhart, R., & Kennedy, J. (2002) · MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science · doi:10.1109/mhs.1995.494215 · Cited by 16,067 · cited 1×
“Particle swarm optimization developed by Kennedy and Eberhart in 1995 was inspired by the social behavior [38].”
Method(2012) · Cited by 8,009
Neural Networks and the Bias/Variance Dilemma
Geman, S., Bienenstock, E., & Doursat, R. (1992) · Neural Computation · doi:10.1162/neco.1992.4.1.1 · Cited by 3,578 · cited 1×
“A deeper neural network with more layers will have a greater capacity, but more layers can eventually result in a decrease in the performance due to high variance and model overfitting and thus a reduced generalization power for the electricity dataset [43].”
BackgroundTime series analysis forecasting and control
Janacek, G. (2010) · Journal of Time Series Analysis · doi:10.1111/j.1467-9892.2009.00643.x · Cited by 2,584 · cited 1×
“Traditional linear statistical models such as autoregressive (AR), moving average (MA) and autoregressive integrated moving average (ARIMA) have remained the baseline for time-series predictions, with extensive use in several industrial applications [3,4].”
BackgroundA Comparative Analysis of Selection Schemes Used in Genetic Algorithms
Goldberg, D. E., & Deb, K. (1991) · Foundations of Genetic Algorithms · doi:10.1016/b978-0-08-050684-5.50008-2 · Cited by 2,407 · cited 1×
“A large tournament value results in a stronger selective pressure, and the population can converge to a faster solution, at the cost of the solution being potentially not as good [44].”
BackgroundEngineering Optimization: An Introduction with Metaheuristic Applications
Yang, X. (2010) · Wiley eBooks · doi:10.1002/9780470640425 · Cited by 1,248 · cited 1×
“In our case, metaheuristics will select from an infinite number of configurations the appropriate lags as well as the best parameter setting for an accurate time series analysis using deep learning [13].”
BackgroundApplied Time Series Econometrics
(2004) · Cambridge University Press eBooks · doi:10.1017/cbo9780511606885 · Cited by 1,196 · cited 1×
“If the selected lags are not relevant, this may unnecessarily increase the curse of dimensionality, slow down the training process, and lead to model overfitting [41].”
BackgroundEngineering Optimization: An Introduction with Metaheuristic Applications
Yang, X. (2010) · Middlesex University Research Repository (Middlesex University Of London) · Cited by 1,063
Bouktif, S., Fiaz, A., Ouni, A., & Serhani, M. (2018) · Energies · doi:10.3390/en11071636 · Cited by 915
Self-citationForecasting with Exponential Smoothing
Hyndman, R., Koehler, A., Ord, K., & Snyder, R. (2008) · Springer Series in Statistics · doi:10.1007/978-3-540-71918-2 · Cited by 818 · cited 1×
“Traditional linear statistical models such as autoregressive (AR), moving average (MA) and autoregressive integrated moving average (ARIMA) have remained the baseline for time-series predictions, with extensive use in several industrial applications [3,4].”
BackgroundAn Empirical Comparison of Machine Learning Models for Time Series Forecasting
Ahmed, N. K., Atiya, A. F., Gayar, N. E., & El-Shishiny, H. (2010) · Econometric Reviews · doi:10.1080/07474938.2010.481556 · Cited by 789 · cited 1×
“The most commonly used models are support vector regression (SVR) and the artificial neural networks (ANNs), which can model complex, mostly nonlinear relationships between electric load and related factors to achieve higher precision in energy consumption [5,6].”
MethodAn artificial neural network (p,d,q) model for timeseries forecasting
Khashei, M., & Bijari, M. (2010) · Expert Systems with Applications · doi:10.1016/j.eswa.2009.05.044 · Cited by 785 · cited 1×
“Although neural network architectures offer numerous advantages compared to ARIMA models in addressing nonlinear and non-normal-distributed data, mostly encountered in real-world problems [7], they have the drawback of assuming that all inputs and outputs are independent of each other, even when dealing with sequentia…”
BackgroundLago, J., De Ridder, F., & De Schutter, B. (2018) · Applied Energy · doi:10.1016/j.apenergy.2018.02.069 · Cited by 642
Recent Advances in Recurrent Neural Networks
Salehinejad, H., Sankar, S., Barfett, J., Colak, E., & Valaee, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.01078 · Cited by 562 · cited 1×
“LSTM models belong to the family of deep recurrent neural networks that have been widely used across di ff erent domains such as language modeling, sentiment analysis, speech recognition, and time-series models [30].”
Yildiz, B., Bilbao, J. I., & Sproul, A. B. (2017) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2017.02.023 · Cited by 560 · cited 1×
“…parameters, such as the length of lag sequences and their positions in the history of consumption, can implicitly bring information that is originally contained within implicit variables, such as the weather as well as the occupancy characteristics for di ff erent horizons of load forecasts [11].”
BackgroundMachine Learning Strategies for Time Series Forecasting
Bontempi, G., Ben Taieb, S., & Le Borgne, Y.-A. (2013) · Lecture Notes in Business Information Processing · doi:10.1007/978-3-642-36318-4_3 · Cited by 531 · cited 1×
“The most commonly used models are support vector regression (SVR) and the artificial neural networks (ANNs), which can model complex, mostly nonlinear relationships between electric load and related factors to achieve higher precision in energy consumption [5,6].”
MethodBuilding energy load forecasting using Deep Neural Networks
Marino, D. L., Amarasinghe, K., & Manic, M. (2016) · IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society · doi:10.1109/iecon.2016.7793413 · Cited by 522 · cited 1×
“energy load forecasting, a standard LSTM, and an LSTM with sequence-to-sequence architecture that produced good results [17].”
BackgroundSimulation of Genetic Systems by Automatic Digital Computers I. Introduction
Fraser, A. (1957) · Australian Journal of Biological Sciences · doi:10.1071/bi9570484 · Cited by 452 · cited 2×
“Initially, the first papers presenting the idea of GAs were published by Alex Fraser [36], and they were then developed by Holland at the University of Michigan [37].”
MethodBandara, K., Bergmeir, C., & Smyl, S. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.112896 · Cited by 435
Electric load forecasting in smart grids using Long-Short-Term-Memory based Recurrent Neural Network
Zheng, J., Xu, C., Zhang, Z., & Li, X. (2017) · 2017 51st Annual Conference on Information Sciences and Systems (CISS) · doi:10.1109/ciss.2017.7926112 · Cited by 341
Srivastava, S., & Lessmann, S. (2018) · Solar Energy · doi:10.1016/j.solener.2018.01.005 · Cited by 320
Wind Power Short-Term Prediction Based on LSTM and Discrete Wavelet Transform
Liu, Y., Guan, L., Hou, C., Han, H., Liu, Z., Sun, Y., & Zheng, M. (2019) · Applied Sciences · doi:10.3390/app9061108 · Cited by 273
Multi-Timescale Long Short-Term Memory Neural Network for Modelling Sentences and Documents
Liu, P., Qiu, X., Chen, X., Wu, S., & Huang, X. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1280 · Cited by 174 · cited 1×
“This can allow the LSTM model to capture the valuable information contained with different timescales [31].”
BackgroundChou, J.-S., & Ngo, N.-T. (2016) · Applied Energy · doi:10.1016/j.apenergy.2016.05.074 · Cited by 170 · cited 1×
“Electricity consumption usage is typically highly random due to the operation of several electrical appliances and consumer behavior, which makes the identification of these time series consumption patterns more di ffi cult [2].”
BackgroundEvolutionary algorithms + domain knowledge = real-world evolutionary computation
Bonissone, P. P., Subbu, R., Eklund, N. H. W., & Kiehl, T. R. (2006) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2005.857695 · Cited by 155 · cited 2×
“Compared to traditional gradient-based methods that can become stuck at the local optima, metaheuristics can find optimal or near-optimal solutions to complex problems made of many peaks and valleys [14].”
BackgroundHansen, J. V., McDonald, J. B., & Nelson, R. D. (1999) · Computational Intelligence · doi:10.1111/0824-7935.00090 · Cited by 137 · cited 1×
“However, with energy data, which has a complex pattern, the selection may not be obvious, so several options may have to be considered before landing on an optimal choice of the best past periods in the time series [12].”
BackgroundSingle and Multi-Sequence Deep Learning Models for Short and Medium Term Electric Load Forecasting
Bouktif, S., Fiaz, A., Ouni, A., & Serhani, M. A. (2019) · Energies · doi:10.3390/en12010149 · Cited by 91 · cited 3×
“Our approach is compared to alternative baseline approaches that use state-of-the-art machine learning techniques as well as a multi-sequence LSTM model with manually tuned parameters through extensive experimentation [9,10].”
BackgroundMethodInfluentialSelf-citationSecond Order Intelligent Proportional-Integral Fuzzy Control of Twin Rotor Aerodynamic Systems
Roman, R., Precup, R., & David, R. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.10.277 · Cited by 85 · cited 1×
“Roman et al. used fuzzy logic and a metaheuristic optimizer, namely a Grey Wolf Optimizer, to address a non-linear process control problem [27].”
MethodDecomposition and statistical analysis for regional electricity demand forecasting
Wang, C., Grozev, G., & Seo, S. (2012) · Energy · doi:10.1016/j.energy.2012.03.011 · Cited by 81 · cited 1×
“…is upward, downward, or absent, (2) seasonality, which is the periodic fluctuation in time series within a certain period, (3) cycles, where rises and falls are not of a fixed period, and finally (4) irregular movement, which is left after explaining the trend, seasonal, and cyclical movements [1].”
BackgroundHybrid LSTM Neural Network for Short-Term Traffic Flow Prediction
Xiao, Y., & Yin, Y. (2019) · Information · doi:10.3390/info10030105 · Cited by 76
Long short term memory networks for short-term electric load forecasting
Narayan, A., & Hipel, K. W. (2017) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2017.8123012 · Cited by 70 · cited 1×
“Narayan & Hipel used the LSTM model for short-term electric load forecasting using ten years of historical data for the province of Ontario in Canada and reported very reliable and robust results [16].”
Optimization of neural network architecture using genetic algorithm for load forecasting
Islam, B. U., Baharudin, Z., Raza, M. Q., & Nallagownden, P. (2014) · International Conference on Intelligent and Advanced Systems · doi:10.1109/icias.2014.6869528 · Cited by 40 · cited 1×
“Mean absolute percentage error (MAPE) and model computational time was significantly reduced after optimizing ANN topology [21].”
BackgroundShort term load forecasting using particle swarm optimization neural network
Özerdem, Ö. C., Olaniyi, E. O., & Oyedotun, O. K. (2017) · Procedia Computer Science · doi:10.1016/j.procs.2017.11.254 · Cited by 40 · cited 2×
“Values of c 1 = c 2 = 2 have shown fast global convergence to the optimum solution for most of the problems [19].”
BackgroundBandara, K., Bergmeir, C., & Smyl, S. (2017) · arXiv (Cornell University) · Cited by 22
Swarm Intelligence‐Based Hybrid Models for Short‐Term Power Load Prediction
Wang, J., Jin, S., Qin, S., & Jiang, H. (2014) · Mathematical Problems in Engineering · doi:10.1155/2014/712417 · Cited by 21 · cited 1×
“Wang et al. used hybrid intelligent forecasting models utilizing cuckoo search and particle swarm optimization for tuning parameters of SARIMA and SVR models for improving short-term load forecasting [18].”
MethodPower load forecasting based on support vector machine and particle swarm optimization
Ren, G., Wen, S., Yan, Z., Hu, R., Zeng, Z., & Cao, Y. (2016) · World Congress on Intelligent Control and Automation · doi:10.1109/wcica.2016.7578535 · Cited by 20 · cited 1×
“used an integrated prediction approach for the annual electricity consumption of Beijing, and PSO was used to find the best parameters for the SVM model [20].”
MethodGSP: an automatic programming technique with gravitational search algorithm
Mahanipour, A., & Nezamabadi–pour, H. (2018) · Applied Intelligence · doi:10.1007/s10489-018-1327-7 · Cited by 20 · cited 1×
“Mahanipour et al. proposed a gravitational search algorithm (GSA), a population-based algorithm to automatically create computer programs and applied it to symbolic regression (SR) and the problem of feature construction (FC) [28].”
BackgroundDefilippo, S. B., Neto, G. G., & Hippert, H. S. (2015) · El Servicio de Difusión de la Creación Intelectual (National University of La Plata) · Cited by 5
Research works printed but not linked: 5
- Defilippo, S.B.; Neto, G.G.; Hippert, H.S. Short-term load forecasting by artificial neural networks specified by genetic algorithms-a simulation study over a Brazilian dataset. In Proceedings of the XIII Simposio Argentino de Investigación Operativa (SIO)-JAIIO 44, Rosario, Santa Fe, Argentina, 31 August-1 September 2015.
- Brownlee, J. Clever Algorithms: Nature-Inspired Programming Recipes; Lulu Press: Morrisville, NY, USA, 2011.
- Holland, J.H.; Goldberg, D. Genetic Algorithms in Search, Optimization and Machine Learning; Addison-Wesley: Boston, MA, USA, 1989.
- Holland, J.H. Adaptation in Natural and Artificial Systems; University of Michigan Press: Ann Arbor, MI, USA, 1975.
- Meyer-Baese, A.; Schmid, V.J. Pattern Recognition and Signal Analysis in Medical Imaging; Elsevier: Amsterdam, The Netherlands, 2014.
Cited by
Fan, Z., Yan, Z., & Wen, S. (2023) · Sustainability · doi:10.3390/su151813493 · Cited by 346
“Bouktif et al. [90] emphasized the importance of short-term electric load forecasting for efficient power grid management.”
BackgroundArtificial Intelligence Techniques in Smart Grid: A Survey
Omitaomu, O. A., & Niu, H. (2021) · Smart Cities · doi:10.3390/smartcities4020029 · Cited by 371
Multimodal Emotion Recognition using Deep Learning
Abdullah, S. M. S. A., Ameen, S. Y. A., M. Sadeeq, M. A., & Zeebaree, S. (2021) · Journal of Applied Science and Technology Trends · doi:10.38094/jastt20291 · Cited by 347
“In [60], to boost the efficiency of the multimodal fusion, a new algorithm and new architecture using the kernel matrix and a deep neural network are proposed.”
BackgroundMethodEsenogho, E., Djouani, K., & Kurien, A. M. (2022) · IEEE Access · doi:10.1109/access.2022.3140595 · Cited by 247
Ullah, K., Ahsan, M., Hasanat, S. M., Haris, M., Yousaf, H., Raza, S. F., Tandon, R., Abid, S., & Ullah, Z. (2024) · IEEE Access · doi:10.1109/access.2024.3440631 · Cited by 219
Metadata
- Authors
- Bouktif, S., Fiaz, A., Ouni, A., & Serhani, M. A.
- Affiliations
- United Arab Emirates University (AE)
- École de Technologie Supérieure (CA)
- Corresponding author
- Bouktif, Salah
- Venue
- Energies
- Publisher
- MDPI AG
- Published
- 2020-01-13
- Volume
- 13
- Issue
- 2
- Pages
- 391
- ISSN
- 1996-1073 (ISSN-L)
- OpenAlex
- W2999869395
- Cited by
- 256
- References
- 39
- Citations by year
- 2026: 29 · 2025: 42 · 2024: 48 · 2023: 46 · 2022: 44 · 2021: 37 · 2020: 10
- FWCI
- 11.75
- Type
- journal article
- Language
- en
- Open access
- gold
- dx.doi.org
- Licence
- Locations
- Energies (publishedVersion, cc-by)
- Espace ÉTS (ETS) (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- United Arab Emirates University (G00002211)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Energy Load and Power Forecasting
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Smart Grid Energy Management
- Social Sciences › Decision Sciences › Management Science and Operations Research › Stock Market Forecasting Methods
- Keywords
- short-term load forecasting, LSTM hyperparameter optimization, genetic algorithm, particle swarm optimization, metaheuristic search, energy consumption time series, power grid management, smart meter data
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.