The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
A Multi-Agent Reinforcement Learning-Based Data-Driven Method for Home Energy Management
Open accessAbstract
This paper proposes a novel framework for home energy management (HEM) based on reinforcement learning in achieving efficient home-based demand response (DR). The concerned hour-ahead energy consumption scheduling problem is duly formulated as a finite Markov decision process (FMDP) with discrete time steps. To tackle this problem, a data-driven method based on neural network (NN) and Q-learning algorithm is developed, which achieves superior performance on cost-effective schedules for HEM system. Specifically, real data of electricity price and solar photovoltaic (PV) generation are timely processed for uncertainty prediction by extreme learning machine (ELM) in the rolling time windows. The scheduling decisions of the household appliances and electric vehicles (EVs) can be subsequently obtained through the newly developed framework, of which the objective is dual, i.e., to minimize the electricity bill as well as the DR induced dissatisfaction. Simulations are performed on a residential house level with multiple home appliances, an EV and several PV panels. The test results demonstrate the effectiveness of the proposed data-driven based HEM framework.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“When paired with fuzzy Q-learning adaptations [43], agents can navigate uncertain partner behaviors or incomplete operational data by adjusting policy confidence based on interaction outcomes.”
From Explainable AI and Multi-Agent Systems for Energy Management in IoT-Edge Environments: A State of the Art Review (2026) · cites this paper as [43]
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Introduction to Reinforcement Learning
Sutton, R. S., & Barto, A. G. (1998) · The MIT Press eBooks · Cited by 6,855
Solar cells—Operating principles, technology and system applications
(1982) · Solar Energy · doi:10.1016/0038-092x(82)90265-1 · Cited by 1,730
Reinforcement learning for demand response: A review of algorithms and modeling techniques
Vázquez-Canteli, J. R., & Nagy, Z. (2019) · Applied Energy · doi:10.1016/j.apenergy.2018.11.002 · Cited by 883
Evaluating MPPT Converter Topologies Using a Matlab PV Model
Walker, G. R. (2001) · QUT ePrints (Queensland University of Technology) · Cited by 871
Koza, J. R. (1992) · Medical Entomology and Zoology · Cited by 825
Rezvanizaniani, S. M., Liu, Z., Chen, Y., & Lee, J. (2014) · Journal of Power Sources · doi:10.1016/j.jpowsour.2014.01.085 · Cited by 714
On-Line Building Energy Optimization Using Deep Reinforcement Learning
Mocanu, E., Mocanu, D. C., Nguyen, P. H., Liotta, A., Webber, M. E., Gibescu, M., & Slootweg, J. G. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2834219 · Cited by 649
Model-Free Real-Time EV Charging Scheduling Based on Deep Reinforcement Learning
Wan, Z., Li, H., He, H., & Prokhorov, D. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2879572 · Cited by 548 · cited 1×
“[14], Wan et al. use deep RL algorithms to determine the optimal solutions of the EV charging/discharging scheduling problem.”
A Dynamic pricing demand response algorithm for smart grid: Reinforcement learning approach
Lu, R., Hong, S. H., & Zhang, X. (2018) · Applied Energy · doi:10.1016/j.apenergy.2018.03.072 · Cited by 441
Lu, R., Hong, S. H., & Yu, M. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2019.2909266 · Cited by 402
Du, Y., & Li, F. F. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2019.2930299 · Cited by 396
Shareef, H., Ahmed, M. S., Mohamed, A., & Hassan, E. A. (2018) · IEEE Access · doi:10.1109/access.2018.2831917 · Cited by 385
Residential Demand Response of Thermostatically Controlled Loads Using Batch Reinforcement Learning
Ruelens, F., Claessens, B., Vandael, S., Schutter, B. D., Babuška, R., & Belmans, R. J. M. (2016) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2517211 · Cited by 361
Stochastic Optimal Energy Management of Smart Home With PEV Energy Storage
Wu, X., Hu, X., Yin, X., et al. (2016) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2606442 · Cited by 307
Reinforcement Learning Approach for Optimal Distributed Energy Management in a Microgrid
Foruzan, E., Soh, L., & Asgarpoor, S. (2018) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2018.2823641 · Cited by 304
Yu, M., & Hong, S. H. (2017) · Applied Energy · doi:10.1016/j.apenergy.2017.06.010 · Cited by 220
Value-Difference Based Exploration: Adaptive Control between Epsilon-Greedy and Softmax
Tokic, M., & Palm, G. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-24455-1_33 · Cited by 218
Chance Constrained Optimization in a Home Energy Management System
Huang, Y., Wang, L., Guo, W., Kang, Q., & Wu, Q. (2016) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2550031 · Cited by 197
Artificial intelligence based smart energy community management: A reinforcement learning approach
Zhou, S., Hu, Z., Gu, W., et al. (2019) · CSEE Journal of Power and Energy Systems · doi:10.17775/cseejpes.2018.00840 · Cited by 190
Fu, W., Wang, K., Li, C., & Tan, J. (2019) · Energy Conversion and Management · doi:10.1016/j.enconman.2019.02.086 · Cited by 175
Rafiei, M., Niknam, T., Aghaei, J., et al. (2018) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2807845 · Cited by 169
Luo, F., Kong, W., Ranzi, G., et al. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2019.2915679 · Cited by 152
Online Energy Management for a Sustainable Smart Home With an HVAC Load and Random Occupancy
Yu, L., Jiang, T., & Zou, Y. (2017) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2017.2775209 · Cited by 147
A Fast Technique for Smart Home Management: ADP With Temporal Difference Learning
Keerthisinghe, C., Verbič, G., & Chapman, A. C. (2016) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2629470 · Cited by 134
Smart Home Energy Management Including Renewable Sources: A QoE-driven Approach
Pilloni, V., Floris, A., Meloni, A., & Atzori, L. (2016) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2605182 · Cited by 131
Remani, T., Jasmin, E. A., & Ahamed, T. P. I. (2019) · IEEE Systems Journal · doi:10.1109/jsyst.2018.2855689 · Cited by 106
Hierarchical Energy Management System for Home Microgrids
Luo, F., Ranzi, G., Wang, S., et al. (2018) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2884323 · Cited by 101
Demand Response Management for Industrial Facilities: A Deep Reinforcement Learning Approach
Huang, X., Hong, S. H., Yu, M., Ding, Y., & Jiang, J. (2019) · IEEE Access · doi:10.1109/access.2019.2924030 · Cited by 85
Time-Coordinated Multienergy Management of Smart Buildings Under Uncertainties
Sharma, S., Xu, Y. H., Verma, A., et al. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2901120 · Cited by 76
Self-citationPDE Modeling and Control of Electric Vehicle Fleets for Ancillary Services: A Discrete Charging Case
Floch, C. L., Kara, E. C., & Moura, S. J. (2016) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2556643 · Cited by 71
Conditional Density Forecast of Electricity Price Based on Ensemble ELM and Logistic EMOS
Chai, S., Xu, Z., & Jia, Y. (2018) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2817284 · Cited by 64
Self-citationOptimal control theory and the linear Bellman equation
Kappen, H. J. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511984679.018 · Cited by 54
Social housing and renewable energy: Community energy in a supporting role
McCabe, A., Pojani, D., & van Groenou, A. B. (2018) · Energy Research & Social Science · doi:10.1016/j.erss.2018.02.005 · Cited by 51
Optimally coordinated dispatch of combined‐heat‐and‐electrical network with demand response
Chen, Y., Xu, Y. H., Li, Z., et al. (2019) · IET Generation Transmission & Distribution · doi:10.1049/iet-gtd.2018.6992 · Cited by 48
Self-citationAttar, M., Homaee, O., Falaghi, H., et al. (2017) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2017.09.028 · Cited by 37
Cited by
Sorted by citations
Ahmad, T., Madonski, R., Zhang, D., Huang, C., & Mujeeb, A. (2022) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2022.112128 · Cited by 711
Reinforcement Learning and Its Applications in Modern Power and Energy Systems: A Review
Cao, D., Hu, W., Zhao, J., Zhang, G., Zhang, B., Liu, Z., Chen, Z., & Blaabjerg, F. (2020) · Journal of Modern Power Systems and Clean Energy · doi:10.35833/mpce.2020.000552 · Cited by 460
“Reference [105] [106] [107] [108] [109] [110] [111] [112] [113] Field Demand-side management Distribution network Demand-side management Operational control Operational control Operational control Distribution network Demand response Distribution network Algorithm DQN DQN Q-learning DQN MADDPG MADDPG MADDPG + attentio…”
MethodChen, X., Qu, G., Tang, Y., Low, S. H., & Li, N. (2022) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2022.3154718 · Cited by 465
“Some Q -learning-based work [133] discretizes the continuous action space to fit the algorithm framework.”
BackgroundEnergetics Systems and artificial intelligence: Applications of industry 4.0
Ahmad, T., Zhu, H., Zhang, D., Tariq, R., Bassam, A., Ullah, F., AlGhamdi, A. S., & Alshamrani, S. S. (2021) · Energy Reports · doi:10.1016/j.egyr.2021.11.256 · Cited by 399
A Review of Technical Standards for Smart Cities
Lai, C. S., Jia, Y., Dong, Z., Wang, D., Tao, Y., Lai, Q. H., Wong, R. T. K., Zobaa, A. F., Wu, R., & Lai, L. L. (2020) · Clean Technologies · doi:10.3390/cleantechnol2030019 · Cited by 352
Self-citation
Metadata
- Authors
- Xu, X., Jia, Y., Xu, Y., Xu, Z., Chai, S., & Lai, C. S.
- Affiliations
- Nanyang Technological University (SG)
- Southern University of Science and Technology (CN)
- Hong Kong Polytechnic University (HK)
- Guangdong University of Technology (CN)
- Venue
- IEEE Transactions on Smart Grid
- Published
- 2020-07
- Volume
- 11
- Issue
- 4
- Pages
- 3201-3211
- ISSN
- 1949-3053 (ISSN-L)
- 1949-3061
- OpenAlex
- W3005335721
- Semantic Scholar
- 8d06a30a270ff6dc763458dcedeea500fbf249e0
- Cited by
- 420
- References
- 37
- Citations by year
- 2026: 46 · 2025: 77 · 2024: 70 · 2023: 71 · 2022: 74 · 2021: 61 · 2020: 21
- FWCI
- 19.50
- Type
- journal article
- Language
- en
- Open access
- green
- bura.brunel.ac.uk
- Licence
- Locations
- IEEE Transactions on Smart Grid (publishedVersion)
- Brunel University Research Archive (BURA) (Brunel University London) (submittedVersion)
- Funders
- SUSTech Faculty Startup Funding (Y01236135, Y01236235)
- Young Talent Program (2018KQNCX223)
- Nanyang Assistant Professorship from Nanyang Technological University, Singapore
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Smart Grid Energy Management
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Electric Vehicles and Infrastructure
- Physical Sciences › Engineering › Electrical and Electronic Engineering › IoT-based Smart Home Systems
- Keywords
- home energy management systems, demand response, multi-agent reinforcement learning, Q-learning, finite Markov decision processes, extreme learning machine, uncertainty prediction, solar photovoltaic generation, electric vehicle scheduling, home appliance scheduling, electricity price forecasting, cost minimization, user dissatisfaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
