The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
A Multi-Agent Reinforcement Learning-Based Data-Driven Method for Home Energy Management
Open accessAbstract
This paper proposes a novel framework for home energy management (HEM) based on reinforcement learning in achieving efficient home-based demand response (DR). The concerned hour-ahead energy consumption scheduling problem is duly formulated as a finite Markov decision process (FMDP) with discrete time steps. To tackle this problem, a data-driven method based on neural network (NN) and Q-learning algorithm is developed, which achieves superior performance on cost-effective schedules for HEM system. Specifically, real data of electricity price and solar photovoltaic (PV) generation are timely processed for uncertainty prediction by extreme learning machine (ELM) in the rolling time windows. The scheduling decisions of the household appliances and electric vehicles (EVs) can be subsequently obtained through the newly developed framework, of which the objective is dual, i.e., to minimize the electricity bill as well as the DR induced dissatisfaction. Simulations are performed on a residential house level with multiple home appliances, an EV and several PV panels. The test results demonstrate the effectiveness of the proposed data-driven based HEM framework.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“When paired with fuzzy Q-learning adaptations [43], agents can navigate uncertain partner behaviors or incomplete operational data by adjusting policy confidence based on interaction outcomes.”
From Explainable AI and Multi-Agent Systems for Energy Management in IoT-Edge Environments: A State of the Art Review (2026) · cites this paper as [43]
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Introduction to Reinforcement Learning
Sutton, R. S., & Barto, A. G. (1998) · The MIT Press eBooks · Cited by 6,855
Solar cells—Operating principles, technology and system applications
(1982) · Solar Energy · doi:10.1016/0038-092x(82)90265-1 · Cited by 1,730
Reinforcement learning for demand response: A review of algorithms and modeling techniques
Vázquez-Canteli, J. R., & Nagy, Z. (2019) · Applied Energy · doi:10.1016/j.apenergy.2018.11.002 · Cited by 883
Evaluating MPPT Converter Topologies Using a Matlab PV Model
Walker, G. R. (2001) · QUT ePrints (Queensland University of Technology) · Cited by 871
Koza, J. R. (1992) · Medical Entomology and Zoology · Cited by 825
Rezvanizaniani, S. M., Liu, Z., Chen, Y., & Lee, J. (2014) · Journal of Power Sources · doi:10.1016/j.jpowsour.2014.01.085 · Cited by 714
On-Line Building Energy Optimization Using Deep Reinforcement Learning
Mocanu, E., Mocanu, D. C., Nguyen, P. H., Liotta, A., Webber, M. E., Gibescu, M., & Slootweg, J. G. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2834219 · Cited by 649
Model-Free Real-Time EV Charging Scheduling Based on Deep Reinforcement Learning
Wan, Z., Li, H., He, H., & Prokhorov, D. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2879572 · Cited by 548 · cited 1×
“[14], Wan et al. use deep RL algorithms to determine the optimal solutions of the EV charging/discharging scheduling problem.”
Cited by
Sorted by citations
Items 401–419 of 419
Alfaverh, F., & Mporas, I. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6957140
Alfaverh, F., & Mporas, I. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6992497
Zaytoun, A. M., & Rabia, S. I. (2026) · International Conference on Machine Intelligence and Smart Innovation (ICMISI) · doi:10.1109/icmisi69868.2026.11584200
“As in [12], we assume that the real-time PV generation power, P pv ( t ) , can be measured at time t using a smart meter and this value is split into used and exported power, defined as The interactive power exchange between home and grid is governed by Total grid export is described as Grid limits…”
A Multi-Agent Reinforcement Learning Based Home Energy Management System for Demand Response
Ahmed, F., Arshad, A., & Rehman, A. U. (2026) · International Conference on Computing, Mathematics and Engineering Technologies (iCoMET) · doi:10.1109/icomet69771.2026.11591896
Michailidis, P., Minelli, F., Çoban, H. H., Michailidis, I., & Kosmatopoulos, E. B. (2026) · Infrastructures · doi:10.3390/infrastructures11070240 · Cited by 2
AI and blockchain supported Internet-of-vehicles for net-zero
Ayaz, F., & Nekovee, M. (2026) · Elsevier eBooks · doi:10.1016/b978-0-44-334009-3.00011-5
BOZKURT, H., Çelık, Ö., & Teke, A. (2026) · Electric Power Systems Research · doi:10.1016/j.epsr.2026.113917
Smart Home Energy Management With EV-Aware Scheduling Under PV And Dynamic Pricing
Aouni, A. E., & Naimi, S. E. (2026) · EPJ Web of Conferences · doi:10.1051/epjconf/202638302004
Behavior-based hybrid-action deep reinforcement learning for intelligent building energy management
Jia, B., Sun, B., Gao, L., et al. (2026) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2026.116148
Xu, M., Zhao, T., Li, G., et al. (2026) · IEEE/IAS Industrial and Commercial Power System Asia (I&CPS Asia) · doi:10.1109/icpsasia70813.2026.11692251
“The growing penetration of flexible demand and distributed energy resources (DERs) has made market-based coordination indispensable for mitigating short-term supply-demand mismatches [1-3].”
Qin, C., Wang, Q., & Wu, Z. (2026) · IEEE Power & Energy Society General Meeting (PESGM) · doi:10.1109/pesgm58988.2026.11693313
“2) Reward for HVAC Load Agent: The customer’s dissatisfaction with changes in HVAC load power can be represented by a quadratic function [18].”
Rajendiran, P., & Vijayakumar, K. (2026) · Journal of Energy Storage · doi:10.1016/j.est.2026.124744
Atik, Ş., Doguc, K., Arslan, D., et al. (2026) · International Journal of Energy Research · doi:10.1155/er/8515168
Global insights into machine learning-enabled smart grids: Challenges and solutions
SOURO, T. A., & Farrok, O. (2026) · Energy Reports · doi:10.1016/j.egyr.2026.109784
Deep Reinforcement Learning for Solar-Powered Electric Vehicle Charging Stations
Ntombela, M. (2026) · Solar · doi:10.3390/solar6050065
“The EV charging demand model enables the DRL controller to schedule charging according to vehicle availability, energy requirements, charger limits, electricity prices, PV generation, and network operating conditions [41].”
Alfaverh, F., & Mporas, I. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7576745
Pant, O. Z. U. V., & Singh, A. B. S. K. (2026) · International Journal of Advanced Research in Science Communication and Technology · doi:10.48175/ijarsct-38915
Shohan, M. J. A., Owais, S., Islam, M. M., et al. (2026) · Energies · doi:10.3390/en19204896
The Nexus of AI, Energy, and Climate Carbon-Aware Computing
Selvakumar, P., Mukhopadhyay, A. K., Singh, C., Subramanyan, L., Giriprasad, S., & Chitranshi, R. (2026) · IGI Global eBooks · doi:10.4018/979-8-2600-2025-8.ch010
Metadata
- Authors
- Xu, X., Jia, Y., Xu, Y., Xu, Z., Chai, S., & Lai, C. S.
- Affiliations
- Nanyang Technological University (SG)
- Southern University of Science and Technology (CN)
- Hong Kong Polytechnic University (HK)
- Guangdong University of Technology (CN)
- Venue
- IEEE Transactions on Smart Grid
- Published
- 2020-07
- Volume
- 11
- Issue
- 4
- Pages
- 3201-3211
- ISSN
- 1949-3053 (ISSN-L)
- 1949-3061
- OpenAlex
- W3005335721
- Semantic Scholar
- 8d06a30a270ff6dc763458dcedeea500fbf249e0
- Cited by
- 420
- References
- 37
- Citations by year
- 2026: 46 · 2025: 77 · 2024: 70 · 2023: 71 · 2022: 74 · 2021: 61 · 2020: 21
- FWCI
- 19.50
- Type
- journal article
- Language
- en
- Open access
- green
- bura.brunel.ac.uk
- Licence
- Locations
- IEEE Transactions on Smart Grid (publishedVersion)
- Brunel University Research Archive (BURA) (Brunel University London) (submittedVersion)
- Funders
- SUSTech Faculty Startup Funding (Y01236135, Y01236235)
- Young Talent Program (2018KQNCX223)
- Nanyang Assistant Professorship from Nanyang Technological University, Singapore
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Smart Grid Energy Management
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Electric Vehicles and Infrastructure
- Physical Sciences › Engineering › Electrical and Electronic Engineering › IoT-based Smart Home Systems
- Keywords
- home energy management systems, demand response, multi-agent reinforcement learning, Q-learning, finite Markov decision processes, extreme learning machine, uncertainty prediction, solar photovoltaic generation, electric vehicle scheduling, home appliance scheduling, electricity price forecasting, cost minimization, user dissatisfaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
