The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Study on deep reinforcement learning techniques for building energy consumption forecasting
Abstract
Abstract Reliable and accurate building energy consumption prediction is becoming increasingly pivotal in building energy management. Currently, data-driven approach has shown promising performances and gained lots of research attention due to its efficiency and flexibility. As a combination of reinforcement learning and deep learning, deep reinforcement learning (DRL) techniques are expected to solve nonlinear and complex issues. However, very little is known about DRL techniques in forecasting building energy consumption. Therefore, this paper presents a case study of an office building using three commonly-used DRL techniques to forecast building energy consumption, namely Asynchronous Advantage Actor-Critic (A3C), Deep Deterministic Policy Gradient (DDPG) and Recurrent Deterministic Policy Gradient (RDPG). The objective is to investigate the potential of DRL techniques in building energy consumption prediction field. A comprehensive comparison between DRL models and common supervised models is also provided. The results demonstrate that the proposed DDPG and RDPG models have obvious advantages in forecasting building energy consumption compared to common supervised models, while accounting for more computation time for model training. Their prediction performances measured by mean absolute error (MAE) can be improved by 16%-24% for single-step ahead prediction, and 19%-32% for multi-step ahead prediction. The results also indicate that A3C performs poor prediction accuracy and shows much slower convergence speed than DDPG and RDPG. However, A3C is still the most efficient technique among these three DRL methods. The findings are enlightening and the proposed DRL methodologies can be positively extended to other prediction problems, e.g., wind speed prediction and electricity load prediction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
LOF: identifying density-based local outliers
Breunig, M. M., Kriegel, H.-P., Ng, R. T., & Sander, J. (2000) · ACM SIGMOD Record · doi:10.1145/335191.335388 · Cited by 5,207
Advances in neural information processing systems 11
Peter Sollich, A. (1999) · Cited by 3,168
Konda, V. R., & Tsitsiklis, J. N. (2002) · Cited by 2,202
A review of data-driven building energy consumption prediction studies
Amasyali, K., & El-Gohary, N. M. (2018) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2017.04.095 · Cited by 1,874
Cao, X., Dai, X., & Liu, J. (2016) · Energy and Buildings · doi:10.1016/j.enbuild.2016.06.089 · Cited by 1,436
A review on applications of ANN and SVM for building electrical energy consumption forecasting
Ahmad, A. S., Hassan, M. Y., Abdullah, M. P., Rahman, H. A., Hussin, F., Abdullah, H., & Saidur, R. (2014) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2014.01.069 · Cited by 954
Rahman, A., Srikumar, V., & Smith, A. D. (2018) · Applied Energy · doi:10.1016/j.apenergy.2017.12.051 · Cited by 743
2015 IEEE International Conference on Robotics and Automation (ICRA)
(2015) · doi:10.1109/icra30979.2015 · Cited by 725
A short-term building cooling load prediction method using deep learning algorithms
Fan, C., Xiao, F., & Zhao, Y. (2017) · Applied Energy · doi:10.1016/j.apenergy.2017.03.064 · Cited by 692
Deep learning for estimating building energy consumption
Mocanu, E., Nguyen, P. H., Gibescu, M., & Kling, W. L. (2016) · Sustainable Energy, Grids and Networks · doi:10.1016/j.segan.2016.02.005 · Cited by 622
A decision tree method for building energy demand modeling
Yu, Z., Haghighat, F., Fung, B. C. M., & Yoshino, H. (2010) · Energy and Buildings · doi:10.1016/j.enbuild.2010.04.006 · Cited by 621
Neto, A. H., & Fiorelli, F. A. S. (2008) · Energy and Buildings · doi:10.1016/j.enbuild.2008.06.013 · Cited by 611
Fan, C., Xiao, F., & Wang, S. (2014) · Applied Energy · doi:10.1016/j.apenergy.2014.04.016 · Cited by 565
Applying support vector machine to predict hourly cooling load in the building
Li, Q., Meng, Q., Cai, J., Yoshino, H., & Mochida, A. (2009) · Applied Energy · doi:10.1016/j.apenergy.2008.11.035 · Cited by 485
Learning driving styles for autonomous vehicles from demonstration
Kuderer, M., Gulati, S., & Burgard, W. (2015) · 2015 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2015.7139555 · Cited by 459
Huo, T., Ren, H., Zhang, X., Cai, W., Feng, W., Zhou, N., & Wang, X. (2018) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2018.02.283 · Cited by 309
2016 International Joint Conference on Neural Networks (IJCNN)
(2016) · doi:10.1109/ijcnn38550.2016 · Cited by 303
Deep learning-based feature engineering methods for improved building energy prediction
Fan, C., Sun, Y., Zhao, Y., Song, M., & Wang, J. (2019) · Applied Energy · doi:10.1016/j.apenergy.2019.02.052 · Cited by 301
Purposive behavior acquisition for a real robot by vision-based reinforcement learning
Asada, M., Noda, S., Tawaratsumida, S., & Hosoda, K. (1996) · Machine Learning · doi:10.1007/bf00117447 · Cited by 274
Load profiling and its application to demand response: A review
Wang, Y., Chen, Q., Kang, C., Zhang, M., Wang, K., & Zhao, Y. (2015) · Tsinghua Science and Technology · doi:10.1109/tst.2015.7085625 · Cited by 268
Meta-learning for time series forecasting and forecast combination
Lemke, C., & Gabrys, B. (2010) · Neurocomputing · doi:10.1016/j.neucom.2009.09.020 · Cited by 244
Memory-based control with recurrent neural networks
Heess, N., Hunt, J. J., Lillicrap, T. P., & Silver, D. (2015) · arXiv · doi:10.48550/arxiv.1512.04455 · Cited by 211
A novel ensemble learning approach to support building energy use prediction
Wang, Z., Wang, Y., & Srinivasan, R. S. (2018) · Energy and Buildings · doi:10.1016/j.enbuild.2017.10.085 · Cited by 205
Reinforcement learning for energy conservation and comfort in buildings
Dalamagkidis, K., Kolokotsa, D. D., Kalaitzakis, K. C., & Stavrakakis, G. S. (2006) · Building and Environment · doi:10.1016/j.buildenv.2006.07.010 · Cited by 203
An interactive building power demand management strategy for facilitating smart grid optimization
Xue, X., Wang, S., Sun, Y., & Xiao, F. (2014) · Applied Energy · doi:10.1016/j.apenergy.2013.11.064 · Cited by 188
Reinforcement learning for optimal control of low exergy buildings
Yang, L., Nagy, Z., Goffin, P., & Schlueter, A. (2015) · Applied Energy · doi:10.1016/j.apenergy.2015.07.050 · Cited by 182
Deep belief network based ensemble approach for cooling load forecasting of air-conditioning system
Fu, G. (2018) · Energy · doi:10.1016/j.energy.2018.01.180 · Cited by 181
Data driven parallel prediction of building energy consumption using generative adversarial nets
Tian, C., Li, C., Zhang, G., & Lv, Y. (2019) · Energy and Buildings · doi:10.1016/j.enbuild.2019.01.034 · Cited by 168
Energy Forecasting for Event Venues: Big Data and Prediction Accuracy
Grolinger, K., L’Heureux, A., Capretz, M. A. M., & Seewald, L. (2016) · Energy and Buildings · doi:10.1016/j.enbuild.2015.12.010 · Cited by 164
Yan, K., Ji, Z., & Shen, W. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.09.076 · Cited by 154
Monthly energy consumption forecast: A deep learning approach
Berriel, R. F., Lopes, A. T., Rodrigues, A. L., Varejão, F. M., & Oliveira-Santos, T. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966398 · Cited by 135
Solutions to reduce energy consumption in the management of large buildings
Colmenar‐Santos, A., de Lober, L. N. T., Borge-Díez, D., & Castro-Gil, M. (2012) · Energy and Buildings · doi:10.1016/j.enbuild.2012.10.004 · Cited by 107
Liu, T., Xu, C., Guo, Y., & Chen, H. (2019) · International Journal of Refrigeration · doi:10.1016/j.ijrefrig.2019.07.018 · Cited by 97
Self-citationGao, D.-C., Wang, S., Shan, K., & Yan, C. (2015) · Applied Energy · doi:10.1016/j.apenergy.2015.02.025 · Cited by 87
Chen, Y., & Wu, W. (2018) · Natural Resources Research · doi:10.1007/s11053-018-9375-6 · Cited by 80
Deep Reinforcement Learning for Optimal Control of Space HeatingPreprint
Nagy, A., Kazmi, H., Cheaib, F., & Driesen, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.03777 · Cited by 74
Shan, K., Wang, S., Gao, D.-C., & Xiao, F. (2016) · Automation in Construction · doi:10.1016/j.autcon.2016.01.005 · Cited by 68
Diez-Olivan, A., Pagan, J. A., Sanz, R., & Sierra, B. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.02.024 · Cited by 59
GA3C: GPU-based A3C for Deep Reinforcement Learning
Babaeizadeh, M., Frosio, I., Tyree, S., Clemons, J., & Kautz, J. (2016) · Cited by 50
Liu, J., Wang, J., Li, G., Chen, H., Shen, L., & Xing, L. (2017) · Applied Energy · doi:10.1016/j.apenergy.2017.09.116 · Cited by 50
Self-citationModal decomposition based ensemble learning for ground source heat pump systems load forecasting
Xu, C., Chen, H., Xun, W., Zhou, Z., Liu, T., Zeng, Y., & Ahmad, T. (2019) · Energy and Buildings · doi:10.1016/j.enbuild.2019.04.018 · Cited by 49
Self-citationSun, S., Li, G., Chen, H., Guo, Y., Wang, J., Huang, Q., & Hu, W. (2017) · Energy and Buildings · doi:10.1016/j.enbuild.2017.06.056 · Cited by 39
Self-citationControlling bicycle using deep deterministic policy gradient algorithm
Le, T. P., & Chung, T. (2017) · International Conference on Ubiquitous Robots and Ambient Intelligence · doi:10.1109/urai.2017.7992765 · Cited by 37
Cited by
Pan, Y., & Zhang, L. (2021) · Automation in Construction · doi:10.1016/j.autcon.2020.103517 · Cited by 1,336
Himeur, Y., Ghanem, K., Alsalemi, A., Bensaali, F., & Amira, A. (2021) · Applied Energy · doi:10.1016/j.apenergy.2021.116601 · Cited by 660
A Novel CNN-GRU-Based Hybrid Approach for Short-Term Residential Load Forecasting
Sajjad, M., Khan, Z. A., Ullah, A., Hussain, T., Ullah, W., Lee, M. Y., & Baik, S. W. (2020) · IEEE Access · doi:10.1109/access.2020.3009537 · Cited by 528
A deep learning framework for building energy consumption forecast
Somu, N., Raman M R, G., & Ramamritham, K. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.110591 · Cited by 500
Khalil, M., McGough, A. S., Pourmirza, Z., Pazhoohesh, M., & Walker, S. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105287 · Cited by 299
Metadata
- Authors
- Liu, T., Tan, Z., Xu, C., Chen, H., & Li, Z.
- Venue
- Energy and Buildings
- Publisher
- Elsevier BV
- Published
- 2020-02
- Volume
- 208
- Pages
- 109675
- ISSN
- 0378-7788 (ISSN-L)
- OpenAlex
- W2994209110
- Cited by
- 274
- References
- 50
- FWCI
- 18.40
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.