The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Deep Reinforcement Learning for Smart Home Energy Management
Open accessAbstract
We investigate an energy cost minimization problem for a smart home in the absence of a building thermal dynamics model with the consideration of a comfortable temperature range. Due to the existence of model uncertainty, parameter uncertainty (e.g., renewable generation output, nonshiftable power demand, outdoor temperature, and electricity price), and temporally coupled operational constraints, it is very challenging to design an optimal energy management algorithm for scheduling heating, ventilation, and air conditioning systems and energy storage systems in the smart home. To address the challenge, we first formulate the above problem as a Markov decision process, and then propose an energy management algorithm based on deep deterministic policy gradients. It is worth mentioning that the proposed algorithm does not require the prior knowledge of uncertain parameters and building the thermal dynamics model. The simulation results based on real-world traces demonstrate the effectiveness and robustness of the proposed algorithm.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Reinforcement Learning: An Introduction
Johnson, J. D., Li, J., & Chen, Z. (2000) · Neurocomputing · doi:10.1016/s0925-2312(00)00324-6 · Cited by 8,414
Reinforcement learning for demand response: A review of algorithms and modeling techniques
Vázquez-Canteli, J. R., & Nagy, Z. (2019) · Applied Energy · doi:10.1016/j.apenergy.2018.11.002 · Cited by 883
Robust Energy Management for Microgrids With High-Penetration Renewables
Zhang, Y., Gatsis, N., & Giannakis, G. B. (2013) · IEEE Transactions on Sustainable Energy · doi:10.1109/tste.2013.2255135 · Cited by 798
Self-citationDeep Reinforcement Learning for Building HVAC Control
Wei, T., Wang, Y., & Zhu, Q. (2017) · Proceedings of the 54th Annual Design Automation Conference 2017 · doi:10.1145/3061639.3062224 · Cited by 478
Lu, R., Hong, S. H., & Yu, M. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2019.2909266 · Cited by 389
Residential Demand Response of Thermostatically Controlled Loads Using Batch Reinforcement Learning
Ruelens, F., Claessens, B. J., Vandael, S., De Schutter, B., Babuska, R., & Belmans, R. (2017) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2517211 · Cited by 333
Optimal Home Energy Management Under Dynamic Electrical and Thermal Constraints
De Angelis, F., Boaro, M., Fuselli, D., Squartini, S., Piazza, F., & Wei, Q. (2013) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2012.2230637 · Cited by 269
An Optimal and Learning-Based Demand Response and Home Energy Management System
Zhang, D., Li, S., Sun, M., & O'Neill, Z. (2016) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2552169 · Cited by 261
Self-citationValladares, W., Galindo, M., Gutiérrez, J., Wu, W.-C., Liao, K.-K., Liao, J.-C., Lu, K.-C., & Wang, C.-C. (2019) · Building and Environment · doi:10.1016/j.buildenv.2019.03.038 · Cited by 200
Online Energy Management for a Sustainable Smart Home With an HVAC Load and Random Occupancy
Yu, L., Jiang, T., & Zou, Y. (2017) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2017.2775209 · Cited by 153
Self-citationConstantopoulos, P., Schweppe, F. C., & Larson, R. C. (1991) · Computers & Operations Research · doi:10.1016/0305-0548(91)90013-h · Cited by 146
Distributed Real-Time Energy Management in Data Center Microgrids
Yu, L., Jiang, T., & Zou, Y. (2016) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2640453 · Cited by 146
Self-citationSurvey on Prediction Algorithms in Smart Homes
Wu, S., Rendall, J. B., Smith, M. J., Zhu, S., Xu, J., Wang, H., Yang, Q. B., & Qin, P. (2017) · IEEE Internet of Things Journal · doi:10.1109/jiot.2017.2668061 · Cited by 136
Smart Home Energy Management Including Renewable Sources: A QoE-driven Approach
Pilloni, V., Floris, A., Meloni, A., & Atzori, L. (2016) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2605182 · Cited by 131
Zhang, Z., & Lam, K. P. (2018) · ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys) · doi:10.1145/3276774.3276775 · Cited by 131
Yang, B., Cheng, X., Dai, D., Olofsson, T., Li, H., & Meier, A. (2019) · Building and Environment · doi:10.1016/j.buildenv.2019.106284 · Cited by 103
Butler, Not Servant: A Human-Centric Smart Home Energy Management System
Chen, S., Liu, T., Gao, F., Ji, J., Xu, Z., Qian, B., Wu, H., & Guan, X. (2017) · IEEE Communications Magazine · doi:10.1109/mcom.2017.1600699cm · Cited by 95
Reinforcement Learning in Markovian and Non-Markovian Environments
Schmidhuber, J. (1990) · Cited by 89
NIDL: A pilot study of contactless measurement of skin temperature for intelligent building
Cheng, X., Yang, B., Hedman, A., Olofsson, T., Li, H., & Gool, L. V. (2019) · Energy and Buildings · doi:10.1016/j.enbuild.2019.06.007 · Cited by 73
Energy-Efficient Thermal Comfort Control in Smart Buildings via Deep Reinforcement LearningPreprint
Gao, G., Li, J., & Wen, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.04693 · Cited by 71
Identification and Estimation for Electric Water Heaters in Direct Load Control Programs
Zolpirani, M. S., Momeni, A., Errouissi, R., Diduch, C. P., Kaye, M. E., & Chang, L. (2015) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2015.2492950 · Cited by 70
Optimal scheduling and operation of load aggregator with electric energy storage in power markets
Xu, Y., Xie, L., & Singh, C. (2010) · North American Power Symposium (NAPS) · doi:10.1109/naps.2010.5619601 · Cited by 67
Cheng, X., Yang, B., Olofsson, T., Liu, G., & Li, H. (2017) · Building and Environment · doi:10.1016/j.buildenv.2017.05.021 · Cited by 66
Residential Energy Management with Deep Reinforcement Learning
Wan, Z., Li, H., & He, H. (2018) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489210 · Cited by 60
An Event-Triggered Online Energy Management Algorithm of Smart Home: Lyapunov Optimization Approach
Fan, W., Liu, N., & Zhang, J. (2016) · Energies · doi:10.3390/en9050381 · Cited by 39
Arbitrage of Energy Storage in Electricity Markets with Deep Reinforcement LearningPreprint
Xu, H., Li, X., Zhang, X., & Zhang, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.12232 · Cited by 33
A thermal comfort model for the non-uniform thermal environments
Wang, Y., & Lian, Z. (2018) · Energy and Buildings · doi:10.1016/j.enbuild.2018.04.029 · Cited by 29
Reinforcement learning in non-stationary environments
Lecarpentier, E. (2020) · theses.fr (ABES) · doi:10.70675/0c2168aaz74edz47a7z87b1z55403db85295 · Cited by 16
Franceschelli, M., Pilloni, A., & Gaspam, A. (2018) · European Control Conference (ECC) · doi:10.23919/ecc.2018.8550337 · Cited by 11
Non-Markovian Control with Gated End-to-End Memory Policy NetworksPreprint
Pérez, J., & Silander, T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.10993 · Cited by 3
Cited by
A Review of Deep Reinforcement Learning for Smart Building Energy Management
Yu, L., Qin, S., Zhang, M., Shen, C., Jiang, T., & Guan, X. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3078462 · Cited by 476
Self-citationChen, X., Qu, G., Tang, Y., Low, S., & Li, N. (2022) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2022.3154718 · Cited by 415
Energetics Systems and artificial intelligence: Applications of industry 4.0
Ahmad, T., Zhu, H., Zhang, D., Tariq, R., Bassam, A., Ullah, F., AlGhamdi, A. S., & Alshamrani, S. S. (2022) · Energy Reports · doi:10.1016/j.egyr.2021.11.256 · Cited by 369
Self-citationMulti-Agent Deep Reinforcement Learning for HVAC Control in Commercial Buildings
Yu, L., Sun, Y., Xu, Z., Shen, C., Yue, D., Jiang, T., & Guan, X. (2021) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2020.3011739 · Cited by 353
Self-citationA Comprehensive Review of Deep Learning: Architectures, Recent Advances, and Applications
Mienye, I. D., & Swart, T. G. (2024) · Information · doi:10.3390/info15120755 · Cited by 330
Metadata
- Authors
- Yu, L., Xie, W., Xie, D., Zou, Y., Zhang, D., Sun, Z., Zhang, L., Zhang, Y., & Jiang, T.
- Venue
- IEEE Internet of Things Journal
- Published
- 2020-04
- Volume
- 7
- Issue
- 4
- Pages
- 2751-2762
- ISSN
- 2327-4662 (ISSN-L)
- 2372-2541
- OpenAlex
- W2974232099
- Cited by
- 471
- References
- 33
- FWCI
- 13.57
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.