Cited by 420Smart Grid Energy ManagementElectric Vehicles and InfrastructureIoT-based Smart Home Systems

The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.

A Multi-Agent Reinforcement Learning-Based Data-Driven Method for Home Energy Management

Open access

Xu, Xu, Jia, Youwei, Xu, Yan, Xu, Zhao, Chai, Songjian, Lai, Chun Sing·2020·IEEE Transactions on Smart Grid

DOI 10.1109/tsg.2020.2971427

Open this paper in CoChat — free account Open PDF

Abstract

This paper proposes a novel framework for home energy management (HEM) based on reinforcement learning in achieving efficient home-based demand response (DR). The concerned hour-ahead energy consumption scheduling problem is duly formulated as a finite Markov decision process (FMDP) with discrete time steps. To tackle this problem, a data-driven method based on neural network (NN) and Q-learning algorithm is developed, which achieves superior performance on cost-effective schedules for HEM system. Specifically, real data of electricity price and solar photovoltaic (PV) generation are timely processed for uncertainty prediction by extreme learning machine (ELM) in the rolling time windows. The scheduling decisions of the household appliances and electric vehicles (EVs) can be subsequently obtained through the newly developed framework, of which the objective is dual, i.e., to minimize the electricity bill as well as the DR induced dissatisfaction. Simulations are performed on a residential house level with multiple home appliances, an EV and several PV panels. The test results demonstrate the effectiveness of the proposed data-driven based HEM framework.

Integrity signals

Registry

Crossref · 10.1109/tsg.2020.2971427

Cites

37 of 37 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Q-learning
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Introduction to Reinforcement Learning
Sutton, R. S., & Barto, A. G. (1998) · The MIT Press eBooks · Cited by 6,855
Solar cells—Operating principles, technology and system applications
(1982) · Solar Energy · doi:10.1016/0038-092x(82)90265-1 · Cited by 1,730
Reinforcement learning for demand response: A review of algorithms and modeling techniques
Vázquez-Canteli, J. R., & Nagy, Z. (2019) · Applied Energy · doi:10.1016/j.apenergy.2018.11.002 · Cited by 883
Evaluating MPPT Converter Topologies Using a Matlab PV Model
Walker, G. R. (2001) · QUT ePrints (Queensland University of Technology) · Cited by 871
Genetic Programming II
Koza, J. R. (1992) · Medical Entomology and Zoology · Cited by 825
Review and recent advances in battery health monitoring and prognostics technologies for electric vehicle (EV) safety and mobility
Rezvanizaniani, S. M., Liu, Z., Chen, Y., & Lee, J. (2014) · Journal of Power Sources · doi:10.1016/j.jpowsour.2014.01.085 · Cited by 714
On-Line Building Energy Optimization Using Deep Reinforcement Learning
Mocanu, E., Mocanu, D. C., Nguyen, P. H., Liotta, A., Webber, M. E., Gibescu, M., & Slootweg, J. G. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2834219 · Cited by 649
Model-Free Real-Time EV Charging Scheduling Based on Deep Reinforcement Learning
Wan, Z., Li, H., He, H., & Prokhorov, D. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2879572 · Cited by 548 · cited 1×
“[14], Wan et al. use deep RL algorithms to determine the optimal solutions of the EV charging/discharging scheduling problem.”

Show all 37 references

Sorted by citations

Items 301–400 of 419

A deep q-networks model for optimising decision-making process in the context of energy transition modelling
Tănăsescu, A., Bucur, C., Andrei, J. V., Tudorică, B.-G., Paraschiv, D., & Dușmănescu, D. (2025) · Environmental Research Communications · doi:10.1088/2515-7620/adf530 · Cited by 3
Smart home's energy management applying the deep deterministic policy gradient and clustering
Zenginis, I., Vardakas, J. S., Ramantas, K., et al. (2022) · IEEE International Workshop on Computer Aided Modeling and Design of Communication Links and Networks (CAMAD) · doi:10.1109/camad55695.2022.9966887 · Cited by 2
“The Q-learning and the Deep Q-learning (DQN) algorithms are utilized in [13]-[15] and in [16]-[17], respectively, for minimizing the energy costs of smart buildings through their controllable appliances’ smart scheduling.”
Method
Q-Learning-Oriented Distributed Energy Management of Grid-Connected Microgrid
Samadi, E., Badri, A., & Ebrahimpour, R. (2021) · Iranian Conference on Electrical Engineering · doi:10.1109/icee52715.2021.9544152 · Cited by 2
Efficient utilization of demand side resources behind the meter: Assessment, profiling and scheduling
Jin, F., Huang, X., & Shao, C. (2022) · The Electricity Journal · doi:10.1016/j.tej.2022.107123 · Cited by 2
Optimization of Cloud Datacenters’ Benefit Using Monte Carlo Algorithm
Darshi, R., Shamaghdari, S., & Nasiri, A. A. (2023) · Lecture notes in electrical engineering · doi:10.1007/978-981-99-0416-7_47 · Cited by 2
Multi-Armed Bandits Learning for Optimal Decentralized Control of Electric Vehicle Charging
Zafar, S., Féraud, R., Blavette, A., et al. (2023) · doi:10.1109/powertech55446.2023.10202971 · Cited by 2
“In [5], [6], multi-agent systems combined with RL have been proposed to control the functioning of a variety of elements in distribution networks.”
Background
A Review of Data-Driven Smart Energy Management Systems for Distribution Networks
Asghar, E., Hill, M., & Lynch, C. (2023) · doi:10.1109/gtd49768.2023.00100 · Cited by 2
“[34] proposed an hourahead energy consumption framework which is directing the schedule of home appliances and EV charging / discharging.”
MAPPO-based Energy Trading in Intelligent Community with Double Auction
Cao, R., Chen, M., & Zhang, G. (2023) · International Conference on Communications · doi:10.1109/icc45041.2023.10279659 · Cited by 2
“Many works have done a considerable quantity of researches on single HEMS [2], [3] but have not taken multiple home system into account.”
Background
On the Optimality of Procrastination Policy for EV Charging Under Net Energy Metering
Jeon, M.-J., Tong, L., & Zhao, Q. Q. (2023) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc49753.2023.10383822 · Cited by 2
“A considerable amount of research has also been conducted on the joint scheduling of BTM ESS with an EV [5]–[10] and flexible demands [11]–[15], along with DER.”
BackgroundMethodInfluential
A two-stage data-driven multi-energy management considering demand response
Zhao, P., Gu, C., Cao, Z., et al. (2020) · Adjunct ACM International Joint Conference on Pervasive and Ubiquitous Computing and ACM International Symposium on Wearable Computers (UbiComp/ISWC) · doi:10.1145/3410530.3414587 · Cited by 2
“A reinforcement learning-based data-driven optimization is designed for optimal operation of MESs [12].”
MethodInfluential
Transactive Local Energy Markets Enable Community-Level Resource Coordination Using Individual RewardsPreprint
May, D., & Musı́lek, P. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4559023 · Cited by 2
English Education Course Performance Management Method Based on Hierarchical Analysis
Zhang, Z. (2022) · Mathematical Problems in Engineering · doi:10.1155/2022/1244686 · Cited by 1
Energy-Saving Technique in Smart Grid Through Machine Learning
Dharmadhikari, S., Vasukidevi, G., Babu, C. N. K., et al. (2022) · IEEE Mysore Sub Section International Conference (MysuruCon) · doi:10.1109/mysurucon55714.2022.9972667 · Cited by 1
“Both aspects were carefully reviewed to satisfy the MRPS deployment criteria [18].”
Background
A State-of-Art Review on Applications of Machine Learning Based Approaches on DSM Programs
Shrivastava, A., & Paliwal, P. (2023) · IEEE International Students' Conference on Electrical, Electronics and Computer Science (SCEECS) · doi:10.1109/sceecs57921.2023.10063027 · Cited by 1
“[31] proposes a multi-agent model involving Q-learning and ANN.”
BackgroundMethod
Research on Algorithm Driven Intelligent Management and Control Technology for Future Power Grid
Li, J., Fu, Q., & Ruan, P. (2024) · EAI Endorsed Transactions on Energy Web · doi:10.4108/ew.5824 · Cited by 1
“The paper [16] provided an in-depth introduction to AI, its applications in fault detection, stability control, security evaluation and stability assessment in smart grids, highlighting practical issues like large data requirements, unbalanced learning, AI interpretability, transfer learning…”
Background
Active Planning of Flexible and Cohesive Virtual Microgrids
Piao, L., Xue, F., Wang, X., et al. (2024) · International Scientific Conference on Electric Power Engineering · doi:10.1109/epe61521.2024.10559557 · Cited by 1
Hierarchical Charging and Computation Scheduling for Connected Electric Vehicles via Safe Reinforcement Learning
Li, L., Xu, L., Liu, X., et al. (2024) · IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) · doi:10.1109/infocomwkshps61880.2024.10620839 · Cited by 1
“To tackle these challenges, some researchers have turned to deep reinforcement learning (DRL) techniques for energy management in MGs, allowing systems to learn optimal decision-making policies through interactions with the environment [1].”
Background
Knowledge-based real-time scheduling for gas supply network using cooperative multi-agent reinforcement learning and predictive functional range control
Zhou, P., Xu, Z., Fang, J., Zhao, J., Song, C., & Shao, Z. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.110206 · Cited by 1
Self-citation
Data-Driven Home Energy Management Optimization Using Reinforcement Learning
Aouni, A. E., Naimi, S. E., Ayat, Y., et al. (2025) · Lecture notes in electrical engineering · doi:10.1007/978-981-96-0644-3_53 · Cited by 1
Yenilenebilir Enerji Difüzyon Patikası ve Bilgi Difüzyonu Temelinde Sosyoekonomik Etkileşimler: Türkiye’de Fotovoltaik Sistem
Fikirli, Ö., & Şahin, H. (2025) · Sosyoekonomi · doi:10.17233/sosyoekonomi.2025.02.16 · Cited by 1
“Literatürdeki çalışmalar incelendiğinde enerji alanında da çok sayıda ajan bazlı modelleme çalışması bulunmaktadır (Xu et al., 2020; Karimi & Vaez-Zadeh, 2021; Fouladvand et al., 2022).”
A Hybrid Heuristic Solution for Packetized Energy Transactions in Smart Homes
Hussain, H. M., Ahmad, A., & Nardelli, P. H. J. (2025) · International Journal of Energy Research · doi:10.1155/er/3241856 · Cited by 1
“…Xu et al. [18] employed deep learning – based methods such as a combination of deep reinforcement learning (DRL), Q-learning, and deep neural network (DNN) in [16], DRL with Q-learning [17], and DNN and Q-learning [18] to accomplish the goal of ef ﬁ cient energy allocation in residential buildings.”
Influential
Short-term residential electricity consumption forecast considering the cumulative effect of temperature, dual decomposition technology and integrated deep learning
Wang, L., Lin, Y. M., Song, T., et al. (2025) · Energy Informatics · doi:10.1186/s42162-025-00552-2 · Cited by 1
“Xu et al. demonstrated that in energy management, ELM’s effect in household demand response prediction is significantly better than SVR and SVM models [16].”
Microgrid Operation Optimization Strategy Based on CMDP-D3QN-MSRM Algorithm
Kang, J., Zeng, Y., & Wei, Q. (2025) · Electronics · doi:10.3390/electronics14183654 · Cited by 2
Safe Deep Reinforcement Learning Based Energy Management for Educational Buildings With Guaranteed Constraints
Jiang, X., & Xu, Q. (2025) · Proceedings of the Annual Conference of the IEEE Industrial Electronics Society · doi:10.1109/iecon58223.2025.11221142 · Cited by 1
“[5] applies Q-learning for scheduling household appliances and EVs, although its discrete action space limits flexibility.”
SolExplore: A Successive Refinement Approach for Sizing of PV and Storage Systems in EV-Enabled Homes
Gschwind, J. O., & Keshav, S. (2025) · ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys) · doi:10.1145/3736425.3770101 · Cited by 1
“Reinforcement learning has been used for energy flow control [26, 32], and LSTM and other neural networks have shown strong performance in forecasting PV generation [20, 28] and residential load [31].”
A review of deep reinforcement learning algorithms for grid services in grid-interactive efficient buildings
Amer, A. A., Bayhan, S., Abu‐Rub, H., Massoud, A. M., & Ehsani, M. (2025) · Energy Reports · doi:10.1016/j.egyr.2025.12.037 · Cited by 2
A Parallel PPO-Based Federated Transfer Reinforcement Learning Method for Multiple Home Energy Management via Cross-Domain Adaption
Zhang, Y., Mei, Z. X., Jiang, H., et al. (2025) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2025.3636941 · Cited by 1
A Review on Reinforcement Learning-Based Energy Scheduling Strategies for Smart Home Energy Management System
Kharkwal, V. S., & Gupta, S. C. (2026) · Lecture notes in electrical engineering · doi:10.1007/978-981-95-2419-8_27 · Cited by 1
Bio-inspired puma optimization algorithm for time-series energy consumption forecasting
Elkenawy, S., Alhussan, A. A., Khafaga, D. S., et al. (2026) · Energy Reports · doi:10.1016/j.egyr.2025.109022 · Cited by 1
Intelligent multi-agent Q-learning-based energy management of the grid-tied multi-carrier microgrid
Samadi, E., & Setareh, M. (2026) · Results in Engineering · doi:10.1016/j.rineng.2026.109007 · Cited by 1
Foreseeable Implicit Training for ESS Operation Based on Deep Reinforcement Learning
Son, M., Song, K., Kim, M., et al. (2026) · IEEE Access · doi:10.1109/access.2026.3653261 · Cited by 1
“Hence,unlike approaches that rely on predicted values [19], [20], [21] or incorporate LSTM cells [22], our method does not increase the complexity or the additional uncertainties induced by predicted values.”
Reinforcement learning-driven optimization of incentive-based demand response in distribution network with optimal placement of DG
Shantanu, K., Choudhary, N. K., & Singh, N. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-00891-3 · Cited by 1
Knowledge-Informed Multiagent Deep Reinforcement Learning Strategy for Charging Stations Coordination in Distribution Systems
Zhang, J., Hu, C., Che, L., et al. (2026) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2025.3635920 · Cited by 1
The impact of battery scheduling strategies on profitability considering battery usage costs and dynamic electricity pricing in Nordic residential PV–battery system
Karttunen, L., Jouttijärvi, S., Jasielec, J. J., et al. (2026) · Journal of Energy Storage · doi:10.1016/j.est.2026.121301 · Cited by 1
SD-LSTM Based Demand Response Framework for Prosumer Energy Management Systems
Mussakhanova, M., Nunna, H. S. V. S. K., & Srinivasan, D. (2020) · Annual Conference of the IEEE Industrial Electronics Society (IECON) · doi:10.1109/iecon43393.2020.9254615 · Cited by 1
“The algorithm ﬁnds an optimal policy of actions to undertake in a given state so that the reward obtained is the maximum [9].”
BackgroundMethodInfluential
Application of Reinforcement Learning to Power System Operation
Takayama, S. (2021) · IEEJ Transactions on Power and Energy · doi:10.1541/ieejpes.141.608 · Cited by 1
A Cybersecurity Framework for Home Energy Management Systems using Artificial Intelligence
Gunasekara, L., Moraliyage, H., Silva, D. D., et al. (2023) · IEEE International Symposium on Industrial Electronics (ISIE) · doi:10.1109/isie51358.2023.10227961 · Cited by 1
Go-Explore for Residential Energy Management
Lu, J., Mannion, P., & Mason, K. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-50485-3_11 · Cited by 1
“In most RL applications in residential energy management, saving energy cost is always one of the most important tasks [5,8,16,17].”
Background
An Autonomous Distributed Coordination Strategy for Sustainable Consumption in a Microgrid Based on a Bio-Inspired Approach
García, M., Aguilar, J., & R-Moreno, M. D. (2024) · Energies · doi:10.3390/en17030757 · Cited by 1
An Autonomous Energy Management Concept for Sustainable Smart Cities
Ludolfinger, U., & Martens, M. (2023) · IEEE European Technology and Engineering Management Summit (E-TEMS) · doi:10.1109/e-tems57541.2023.10424573 · Cited by 1
“Controlling flexible loads of consumers according to a dynamic price signal is known as demand response (DR) [7].”
Background
Hybrid learning algorithm with pairwise scatter plotting features for utility-scale energy systems
Wang, S., Alonso, D. P., & Long, C. (2024) · Energy Reports · doi:10.1016/j.egyr.2024.11.022 · Cited by 1
Residential Electricity Pricing Based on Multi-Agent Simulation
Zhou, K., & Wen, L. (2022) · Springer eBooks · doi:10.1007/978-981-16-9360-1_8 · Cited by 1
A Talent Training Model for Electrical Courses considering Diverse Constraint Models and Knowledge Recognition Algorithms
Min, F. (2022) · Advances in Multimedia · doi:10.1155/2022/5947573 · Cited by 1
Retracted
MIRROR: Methodological Innovation to Remodel the Electric Loads to Reduce Economic OR Environmental Impact of User
Chimienti, M., Danzi, I., Impedovo, D., Pirlo, G., Semeraro, G., & Veneto, D. (2022) · Algorithms · doi:10.3390/a16010001 · Cited by 1
An Overview of Home Energy Management Systems for a Fully Coordinated Approach
Thummalacherla, V. B., Vijay, R., & Mathuria, P. (2022) · National Power Systems Conference · doi:10.1109/npsc57038.2022.10068935 · Cited by 1
“Reference [5] proposed DR program using Multi-agent ML for scheduling appliances while [6] used Multi-agent Qlearning for scheduling and K-means clustering process is used in [7] to create more homogeneous training datasets, but it hasn’t considered discrete loads.”
Method
Home Energy Recommendation System (HERS): A Deep Reinforcement Learning Method for Electricity Optimization in Smart HomesPreprint
Shuvo, S. S., & Yılmaz, Y. (2021) · doi:10.36227/techrxiv.16574711.v1 · Cited by 1
Deep Reinforcement Learning Based Approach for Multi-Agent Control of Residential Electric Water Heaters for Distribution Load Management
Abraham, K. (2021) · UWSpace (University of Waterloo) · Cited by 1
Home Energy Recommendation System (HERS): A Deep Reinforcement Learning Method for Electricity Optimization in Smart HomesPreprint
Shuvo, S. S., & Yılmaz, Y. (2021) · doi:10.36227/techrxiv.16574711 · Cited by 1
A Home Energy Management System Optimization Model Based on DNN and RL Adapting to Users’ Uncertain BehaviorsPreprint
Ren, K., Liu, J., & Wu, Z. (2022) · doi:10.46855/energy-proceedings-9232 · Cited by 1
What Is Smart City?
Lai, C. S., Lai, L. L., & Lai, Q. H. (2022) · doi:10.1002/9781119790402.ch1 · Cited by 1
Self-citation
Reinforcement Learning for Intelligent Building Energy Management System Control *
Kotevska, O., & Andelfinger, P. (2022) · doi:10.1002/9781119834052.ch18 · Cited by 1
A Novel‐Based Smart Home Energy Management System for Energy Consumption Prediction Using a Machine Learning Algorithm
Deepa, N., Devi., T., Kumar, S. R., et al. (2024) · doi:10.1002/9781394166923.ch4 · Cited by 1
IMPROVED PARTICLE SWAM OPTIMIZATION FOR CROWD SIMULATION USING HYBRID AGENT REINFORCEMENT LEARNING ALGORITHM
Pavithra, G. R. K. (2021) · INFORMATION TECHNOLOGY IN INDUSTRY · doi:10.17762/itii.v9i2.318
Does Explicit Prediction Matter in Energy Management Based on Deep Reinforcement LearningPreprint
Qin, Z., Zhang, H., Zhao, Y., Xie, H. L., & Cao, J. (2021) · arXiv (Cornell University)
Machine Learning in Photovoltaic Systems
Fierro, G., & Felipe, J. (2021)
Cooperative Multi-Agent Actor-Critic for Privacy-Preserving Load Scheduling in a Residential MicrogridPreprint
Qin, Z., Dong, N., Xing, E. P., & Cao, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.02784
A Supervised-Learning based Hour-Ahead Demand Response of a Behavior-based HEMS approximating MILP OptimizationPreprint
Dinh, H. T., Lee, K.-H., & Kim, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.01978
Feature Papers of Forecasting
Leva, S. (2021) · MDPI eBooks · doi:10.3390/books978-3-0365-1031-6
Power Demand and Probability Density Forecasting Based on Deep Learning
Zhou, K., & Wen, L. (2022) · Springer eBooks · doi:10.1007/978-981-16-9360-1_5
Multi-agent System with an Optimized Heuristic Algorithm for Energy Management Solutions
Lin, B., Tlili, I., & Baseer, M. A. (2022) · Journal of Interconnection Networks · doi:10.1142/s0219265921440072
Data-driven operation and control for power systems with high-level renewable energy resources
Yan, Z. (2021) · doi:10.32657/10356/161731
Extensions to PEVs Charging/Discharging Scheduling
Qin, J., Wan, Y., Li, F., Kang, Y., & Fu, W. (2023) · Studies in systems, decision and control · doi:10.1007/978-981-19-8594-2_5
Economic Dispatch of CHP Multi-Microgrid Based on Double-Layer Reinforcement Learning
杨, 子. (2023) · Smart Grid · doi:10.12677/sg.2023.131002
Household Electricity Scheduling Strategy Solution Based on SA-α-QLearning
Wu, Y. W. Y., Wu, D.-N. Z. Y., Zhang, J.-M. Y. D.-N., et al. (2023) · 電腦學刊 · doi:10.53106/199115992023063403014
A 5G NB-IoT Infrastructure for Secured Demand-Side Information Transmission and Predictive Analyses in Smarter Grids
Ramana, K. S., Priyadarshini, Y. I., Jambukesh, H. J., Singh, R., Kandasamy, M., & Kumar, B. V. (2023) · International Conference on Advance Computing and Innovative Technologies in Engineering (ICACITE) · doi:10.1109/icacite57410.2023.10182463
A New Customer Selection Framework for Time-Based Pricing Program Considering UncertaintiesPreprint
Xie, Y., Xiao, J., Wang, Y., et al. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4575021
Data-driven control and operation of cyber-physical microgrid systems
Xia, Y. (2023) · doi:10.32657/10356/171084
Multi-Agent Reinforcement Learning Based User-Centric Demand Response via Non-Intrusive Load Monitoring
Ashraf, M. (2023) · doi:10.22215/etd/2023-15858
Multi-agent Reinforcement Learning-Based Energy Orchestrator for Cyber-Physical Systems
Robles-Enciso, A., Robles-Enciso, R., & Skármeta, A. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-49361-4_6
Cyber-Physical Power Systems: A Comprehensive Review About Drivers, Standards, and Future PerspectivesPreprint
Alvarez‐Alvarado, M. S., Apolo-Tinoco, C., Ramirez-Prado, M. J., Alban-Chacón, F. E., Pico, N., Aviles-Cedeno, J., Recalde, A. A., Moncayo-Rea, F., Velásquez, W., & Rengifo, J. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4687769
ADMM based distributed energy scheduling of grid connected microgrid by considering the demand responsePreprint
Reddy, P. K. M., & Sandeep, V. (2024) · Research Square · doi:10.21203/rs.3.rs-3936003/v1
A Security Awareness Multi-Agent Deep Reinforcement Learning Method for Home Energy Management Under Various UncertaintiesPreprint
Zhang, Y., Lin, R., Mei, Z., Lyu, M., Jiang, H., Xue, Y. W., Zhang, J., & Gao, W. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4791649
A Systematic Survey on the Application of Artificial Intelligence (ai) Baseline Networks on Grid Computing Techniques - Challenges, Novelty and Prospects
Gonten, F. N., Jakawa, J. N., Emmanuel, D. U., Pandok, D. A., Maikano, P. C., & ICT Unit, P. S. P. (2024) · International Journal of Soft Computing and Engineering · doi:10.35940/ijsce.d3643.14040924
Leveraging data analytics and ML for enhanced renewable energy resource management
Saikia, A. P., Dey, K., Gill, A., & Gantra, A. (2025) · International Journal of Systems Assurance Engineering and Management · doi:10.1007/s13198-024-02668-2
Nonlinear autoregressive prediction model for VAWT power supply network energy management
Alqahtani, M. F. (2025) · Energy Reports · doi:10.1016/j.egyr.2025.04.009
Home Energy Management Systems: Motivations, Trends, and Challenges
Faddel, S., Melese, A., & Gong, H. (2024) · Annual Meeting of the IEEE Industry Applications Society · doi:10.1109/ias55788.2024.11023666
“Also in [31] multi-agent reinforcement learning was used for HEM to reduce the cost and dissatisfaction levels simultaneously.”
Application of Human-Machine Learning System in Demand Side Management for Commercial Buildings
Wang, J., Mishra, D. K., Zhu, R., et al. (2024) · Conference record · doi:10.1109/ias55788.2024.11023770
“2 is drawn to illustrate the PV power prediction accuracy of the proposed HCE-ELM system against the traditional PV prediction model using ELM [10].”
Multi-Timescale On-Demand Home Energy Management with Energy Resource Control Action DecompositionPreprint
Du, X., Luo, F., Liao, J., Zhou, W. H., & Wen, J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5340688
Home Energy Management System Based on Multi-Agent Deep Reinforcement Learning Handling the User'S Thermal Preferences
Shahabi, A., Delkhosh, H., & Moghaddam, M. P. (2025) · International Conference on Technology and Energy Management (ICTEM) · doi:10.1109/ictem66196.2025.11063514
“Moreover, the human feedbacks are integrated into the HEMS based on the MARL to incorporate the user preferences into the energy management decisions [12].”
Reinforcement Learning Challenges in Power Grid Management: A Case Study with City Learn Simulator
Shakir, W. A. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-7238-7_24
Physical layer-based safe reinforcement learning control for energy systems with accurate formula of hard operation constraints
Zhang, H., Song, Y., Chen, G., & Yu, P. (2025) · Elsevier eBooks · doi:10.1016/b978-0-44-336492-1.00015-0
Multi-agent deep reinforcement learning-enhanced optimal scheduling for transmission-constrained pelagic island groups considering environmental disturbances
Yang, L., Shi, C., Sun, Q., et al. (2025) · Electric Power Systems Research · doi:10.1016/j.epsr.2025.112053
Minimum EVCS Aggregation Requirements for Reliable Customer Baseline Load in Electricity Markets
Jee, Y., & Kim, J. (2025) · IEEE Access · doi:10.1109/access.2025.3596545
“…studies have explored the potential of EVs in demand-side management, they have primarily focused on individual EV charging patterns or employed advanced forecasting techniques— such as machine learning or deep learning—to improve prediction accuracy at the device level [9], [10], [32], [33].”
Lightweight Distributional Q-Learning for Robust Smart Appliance SchedulingPreprint
Pereira, N., & Martínez‐Ramón, M. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5472579
Boosting Power Grid Efficiency: Meta-RL Approaches
Batchu, S., Vanguru, C. R., Yashwanth, G., & Das, S. (2025) · Power systems · doi:10.1007/978-3-031-89459-6_2
MSIF-SAC: A Deep Reinforcement Learning Approach for Building Energy Management Integrating Multi-Step Interval Forecasts
Ding, H., & Xu, Y. H. (2025) · doi:10.1109/pesgm52009.2025.11225158
“Current research often employs simplistic state representations, using past time series data [3] or actual future data for training and predicted future data for online testing [4].”
Self-citation
Can Forecasts Enhance the Performance of RL for Home Energy Management?
Li, Y., & Wang, Y. (2025) · doi:10.1109/pesgm52009.2025.11225645
Decentralized multi-agent multi-armed bandits for smart electric vehicles charging
Zafar, S., Féraud, R., Blavette, A., et al. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.113088
“In recent years, decentralized algorithms applied to the management of electrical distribution networks using reinforcement learning (RL) have been proposed [18, 19, 20, 21, 22, 23].”
Optimizing Household Energy Management Using Fuzzy Logic for Enhanced Electricity Cost Reduction
Stegman, L. C., Stroe, D., & Iov, F. (2025) · doi:10.1109/ecce58356.2025.11259842
“Nevertheless, most of the proposed strategies heavily depend on cumbersome optimization algorithms and complex dynamic BESS models [10], [11].”
Post-Disaster Home Energy Management with Prioritized HVAC and Synthetic Load Modeling
Ali, A. M., Hansen, T. M., & Hussain, T. (2025) · North American Power Symposium (NAPS) · doi:10.1109/naps66256.2025.11272393
“As a result, residential buildings have become a focal point for energy management (EM) and demand response (DR) programs, which offer benefits such as grid stability, cost savings, improved power supply-demand balance, and enhanced system efficiency [2], [3].”
AGOD: Enhancing Multi-Agent Generalization via Attribution-Guided Observation Dropout
Wei, W., Ma, B., Li, L., Song, H., Zhang, L., & Li, F. (2025) · International Conference on Distributed Artificial Intelligence (DAI) · doi:10.1145/3772429.3772435
“…[19] has shown great promise in addressing high-complexity tasks across a range of real-world domains, such as autonomous vehicle fleet coordination [18], intelligent powergrid scheduling [38], post-disaster search and rescue [28], multi-robot control [41], and automated machine learning [27].”
Causally Aligned Multiagent Reinforcement Learning for Coordinated Control of Heterogeneous Home Energy Devices
Du, X., Luo, F., Hu, J., et al. (2026) · IEEE Internet of Things Journal · doi:10.1109/jiot.2026.3668848
“DRL has been applied to a variety of HEMS objectives, including cost minimization [10], load shifting [11], user comfort control [2], and renewable energy integration [12].”
Optimization and Management of Solar Photovoltaic Driven Electric Vehicle System
Durga, M. V., Самандаров, А. И., Sabirov, S., et al. (2025) · doi:10.1109/sisimpact67725.2025.11439365
Designing smart home services using machine learning and knowledge-based approaches
Qiu, M. (2023) · theses.fr (ABES) · doi:10.70675/91d484b0z239bz4bcbz939cze37dcafb860a
Contributing to the Energy Efficiency of Smart Homes : An Automated Management Framework
Kanso, H. (2022) · doi:10.70675/c3d79137zb588z4414z9d43z2e1f93601ae6
Limited prior Knowledge-Aided reinforcement learning for optimal energy management in active distribution networks
Ren, Z., Sun, X., Ding, L., et al. (2026) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2026.111850
D2PG-SHEMS: Integrating Ensemble Photovoltaic Forecasting and Deep Reinforcement Learning for Smart Home Energy Management Systems
Guo, Q., Fu, Q., Chen, J., et al. (2026) · Journal of Dynamic Systems Measurement and Control · doi:10.1115/1.4071772
A Bi-Stage Distributed Model-Free Adaptive Control Approach for Heterogeneous Nonlinear Multi-Agent Systems Under Measurement Disturbance
Sun, W., Li, D., Jia, Z., et al. (2026) · Journal of Physics Conference Series · doi:10.1088/1742-6596/3249/1/012007
“Nevertheless, massive quantities of data, both online and offline, accumulated in MAS has elevated data-driven control (DDC) to a prominent research area [12].”
Energy management for renewable power-to-ammonia in networked multi-energy microgrids: A multi-agent Soft Actor–Critic approach
Song, D., Yan, L., Zhu, D., Wang, S., Li, Z., Pouresmaeil, E., & Zhai, J. (2026) · International Journal of Hydrogen Energy · doi:10.1016/j.ijhydene.2026.155742
A new energy ladder electricity price prediction method based on improved Variational Mode Decomposition-Dung Beetle Optimizer-Inception-Scalar Long Short-Term Memory
Ye, W., & Liu, S. (2026) · International Journal of Low-Carbon Technologies · doi:10.1093/ijlct/ctag051

Authors: Xu, X., Jia, Y., Xu, Y., Xu, Z., Chai, S., & Lai, C. S.
Affiliations: Nanyang Technological University (SG)
Southern University of Science and Technology (CN)
Hong Kong Polytechnic University (HK)
Guangdong University of Technology (CN)
ORCID: Xu, Xu
Jia, Youwei
Xu, Yan
Xu, Zhao
Chai, Songjian
Lai, Chun Sing
Venue: IEEE Transactions on Smart Grid
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
Published: 2020-07
Volume: 11
Issue: 4
Pages: 3201-3211
ISSN: 1949-3053 (ISSN-L)
1949-3061
DOI: 10.1109/tsg.2020.2971427
OpenAlex: W3005335721
Semantic Scholar: 8d06a30a270ff6dc763458dcedeea500fbf249e0
Cited by: 420
References: 37
Citations by year: 2026: 46 · 2025: 77 · 2024: 70 · 2023: 71 · 2022: 74 · 2021: 61 · 2020: 21
FWCI: 19.50
Type: journal article
Language: en
Open access: green
bura.brunel.ac.uk
Licence: ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html (vor)
doi.org/10.15223/policy-029 (stm-asf)
doi.org/10.15223/policy-037 (stm-asf)
Locations: IEEE Transactions on Smart Grid (publishedVersion)
Brunel University Research Archive (BURA) (Brunel University London) (submittedVersion)
Funders: SUSTech Faculty Startup Funding (Y01236135, Y01236235)
Young Talent Program (2018KQNCX223)
Nanyang Assistant Professorship from Nanyang Technological University, Singapore
Topics: Physical Sciences › Engineering › Electrical and Electronic Engineering › Smart Grid Energy Management
Physical Sciences › Engineering › Electrical and Electronic Engineering › Electric Vehicles and Infrastructure
Physical Sciences › Engineering › Electrical and Electronic Engineering › IoT-based Smart Home Systems
Keywords: home energy management systems, demand response, multi-agent reinforcement learning, Q-learning, finite Markov decision processes, extreme learning machine, uncertainty prediction, solar photovoltaic generation, electric vehicle scheduling, home appliance scheduling, electricity price forecasting, cost minimization, user dissatisfaction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

A Multi-Agent Reinforcement Learning-Based Data-Driven Method for Home Energy Management

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks