A multi-agent deep reinforcement learning based energy management for behind-the-meter resources
Open accessIntegrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Mitigation strategies such as redundancy, cybersecurity hardening, and backup infrastructures add complexity without eliminating fundamental vulnerabilities of centralized systems.
“Mitigation strategies-redundancy, cybersecurity hardening, and backup infrastructures-add complexity without eliminating fundamental vulnerabilities [11].”
From Explainable AI and Multi-Agent Systems for Energy Management in IoT-Edge Environments: A State of the Art Review (2026) · cites this paper as [11]
External factors such as weather-driven solar changes or unpredictable human activity can quickly render preset schedules ineffective.
“External factors-such as weather-driven solar changes or unpredictable human activity-can quickly render preset schedules ineffective [11].”
From Explainable AI and Multi-Agent Systems for Energy Management in IoT-Edge Environments: A State of the Art Review (2026) · cites this paper as [11]
Traditional centralized optimization methods struggle to handle the computational overhead and communication delays inherent in large-scale, geographically dispersed grids.
“Traditional centralized optimization methods struggle to handle the computational overhead and communication delays inherent in large-scale, geographically dispersed grids [10,11].”
From Explainable AI and Multi-Agent Systems for Energy Management in IoT-Edge Environments: A State of the Art Review (2026) · cites this paper as [11]
Pareto front optimization is frequently employed to scalarize multiple objectives using operator-defined weights, enabling solutions that balance individual agent preferences with global performance requirements.
“Pareto front optimization is frequently employed to scalarize multiple objectives using operator-defined weights, enabling solutions that balance individual agent preferences with global performance requirements [11].”
From Explainable AI and Multi-Agent Systems for Energy Management in IoT-Edge Environments: A State of the Art Review (2026) · cites this paper as [11]
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357 · see citing works
Tranfield, D., Denyer, D., & Smart, P. (2003) · British Journal of Management · doi:10.1111/1467-8551.00375 · Cited by 15,386 · see citing works
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001 · see citing works
Deep Reinforcement Learning: A Brief Survey
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2743240 · Cited by 4,733 · see citing works
Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments
Lowe, R., Wu, Y., Tamar, A., Harb, J., Abbeel, P., & Mordatch, I. (2017) · arXiv · doi:10.48550/arxiv.1706.02275 · Cited by 3,377 · see citing works
The Impact of Charging Plug-In Hybrid Electric Vehicles on a Residential Distribution Grid
Clement-Nyns, K., Haesen, E., & Driesen, J. (2010) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2009.2036481 · Cited by 2,847 · see citing works
The Arcade Learning Environment: An Evaluation Platform for General Agents
Bellemare, M. G., Naddaf, Y., Veness, J., & Bowling, M. (2013) · Journal of Artificial Intelligence Research · doi:10.1613/jair.3912 · Cited by 2,161 · see citing works
Temporal Difference Learning and TD-Gammon
Tesauro, G. (1995) · ICGA Journal · doi:10.3233/icg-1995-18207 · Cited by 770 · see citing works
Policy gradient reinforcement learning for fast quadrupedal locomotion
Kohl, N., & Stone, P. (2004) · IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004 · doi:10.1109/robot.2004.1307456 · Cited by 676 · see citing works
A Review of Deep Reinforcement Learning for Smart Building Energy Management
Yu, L., Qin, S., Zhang, M., Shen, C. Q., Jiang, T., & Guan, X. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3078462 · Cited by 532 · see citing works
A Multi-Agent Reinforcement Learning-Based Data-Driven Method for Home Energy Management
Xu, X., Jia, Y., Xu, Y., Xu, Z., Chai, S., & Lai, C. S. (2020) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2020.2971427 · Cited by 420 · cited 1× · see citing works
“In (Xu et al., 2020) the author proposed a fully distributed multi-agent Q-learning algorithm with no observation for hour-ahead energy consumption and EV charging decisions.”
Schulze, M., Nehler, H., Ottosson, M., & Thollander, P. (2015) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2015.06.060 · Cited by 404 · see citing works
Deep Reinforcement Learning for Internet of Things: A Comprehensive Survey
Chen, W., Qiu, X., Cai, T., Dai, H., Zheng, Z., & Zhang, Y. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3073036 · Cited by 318 · see citing works
Reinforcement Learning Approach for Optimal Distributed Energy Management in a Microgrid
Foruzan, E., Soh, L., & Asgarpoor, S. (2018) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2018.2823641 · Cited by 295 · see citing works
Deep reinforcement learning for power system: An overview
Zhang, Z., Zhang, D., & Qiu, R. C. (2019) · CSEE Journal of Power and Energy Systems · doi:10.17775/cseejpes.2019.00920 · Cited by 276 · see citing works
Reinforcement Learning Based EV Charging Management Systems–A Review
Abdullah, H. M., Gastli, A., & Ben‐Brahim, L. (2021) · IEEE Access · doi:10.1109/access.2021.3064354 · Cited by 249 · see citing works
Shin, M., Choi, D., & Kim, J. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2944183 · Cited by 201 · see citing works
Reinforcement Learning-Based Plug-in Electric Vehicle Charging with Forecasted Price
Chis, A., Lundén, J., & Koivunen, V. (2016) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2016.2603536 · Cited by 180 · see citing works
Reinforcement Learning Based Energy Management Algorithm for Smart Energy Buildings
Kim, S., & Lim, H. (2018) · Energies · doi:10.3390/en11082010 · Cited by 169 · see citing works
Arwa, E. O., & Folly, K. A. (2020) · IEEE Access · doi:10.1109/access.2020.3038735 · Cited by 147 · see citing works
DSO-TSO cooperation issues and solutions for distribution grid congestion management
Hadush, S. Y., & Meeus, L. (2018) · Energy Policy · doi:10.1016/j.enpol.2018.05.065 · Cited by 135 · see citing works
Multiagent Reinforcement Learning for Energy Management in Residential Buildings
Ahrarinouri, M., Rastegar, M., & Seifi, A. R. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.2977104 · Cited by 132 · see citing works
The Surprising Effectiveness of MAPPO in Cooperative, Multi-Agent GamesPreprint
Yu, C., Velu, A., Vinitsky, E., Wang, Y., Bayen, A. M., & Wu, Y. (2021) · arXiv (Cornell University) · Cited by 121 · see citing works
Reinforcement and deep reinforcement learning for wireless Internet of Things: A survey
Frikha, M. S., Gammar, S. M., Lahmadi, A., & Andrey, L. (2021) · Computer Communications · doi:10.1016/j.comcom.2021.07.014 · Cited by 107 · see citing works
Remani, T., Jasmin, E. A., & Ahamed, T. P. I. (2019) · IEEE Systems Journal · doi:10.1109/jsyst.2018.2855689 · Cited by 106 · see citing works
Fang, X., Zhao, Q., Wang, J., Han, Y., & Li, Y. (2021) · Sustainable Cities and Society · doi:10.1016/j.scs.2021.103163 · Cited by 98 · see citing works
Zhu, D., Yang, B., Liu, Y., Wang, Z., Ma, K., & Guan, X. (2022) · Applied Energy · doi:10.1016/j.apenergy.2022.118636 · Cited by 94 · see citing works
Guo, C., Wang, X., Zheng, Y., & Zhang, F. (2021) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2021.107048 · Cited by 93 · see citing works
Chen, S.-J., Chiu, W., & Liu, W.-J. (2021) · IEEE Access · doi:10.1109/access.2021.3132962 · Cited by 55 · see citing works
Nie, H., Chen, Y., Xia, Y., Huang, S., & Liu, B. (2020) · IEEE Access · doi:10.1109/access.2020.3018142 · Cited by 54 · see citing works
Testbed implementation of reinforcement learning-based demand response energy management system
Zhang, X., Lu, R., Jiang, J., Hong, S. H., & Song, W. S. (2021) · Applied Energy · doi:10.1016/j.apenergy.2021.117131 · Cited by 44 · see citing works
Diyan, M., Silva, B. N., & Han, K. (2020) · Italian National Conference on Sensors · doi:10.3390/s20123450 · Cited by 41 · see citing works
Reinforcement Learning for Building Energy Optimization Through Controlling of Central HVAC System
Hao, J., Gao, W., & Zhang, J. J. (2020) · IEEE Open Access Journal of Power and Energy · doi:10.1109/oajpe.2020.3023916 · Cited by 34 · see citing works
Dong, J., Wang, H., Yang, J., Lu, X., Liu, G., & Zhou, X. (2021) · IEEE Access · doi:10.1109/access.2021.3114335 · Cited by 31 · see citing works
Yoldaş, Y., Gören, S., & Önen, A. (2020) · Journal of Modern Power Systems and Clean Energy · doi:10.35833/mpce.2020.000506 · Cited by 31 · see citing works
Demand-Side Scheduling Based on Multi-Agent Deep Actor-Critic Learning for Smart Grids
Lee, J., Wang, W., & Niyato, D. T. (2020) · IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm) · doi:10.1109/smartgridcomm47815.2020.9302935 · Cited by 22 · see citing works
Virtual Generation Alliance Automatic Generation Control Based on Deep Reinforcement Learning
Li, J., & Yu, T. (2020) · IEEE Access · doi:10.1109/access.2020.3029189 · Cited by 14 · see citing works
Self-citationSmart Buildings, Smart Communities and Demand Response
(2021) · Wiley eBooks · doi:10.1002/9781119804246 · Cited by 3 · see citing works
Sequence Level Training with Recurrent Neural Networks
Ranzato, M., Chopra, S., Auli, M., & Zaremba, W. (2015) · arXiv · doi:10.48550/arxiv.1511.06732
Flagged first, then by citations
Cited by
Sorted by citations
Álvarez-López, C., González-Briones, A., & Li, T. (2026) · Electronics · doi:10.3390/electronics15020385 · Cited by 23 · see citing works
Online Distributed Coordination Operation for Grid-Interactive Efficient Residential Buildings
Yu, L., Yue, D., Tan, Y., Zhang, S., Yu, Y., Dou, C., & Kuzin, V. (2023) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2023.3339761 · Cited by 14 · see citing works
Abdalla, A. N., Ji, R., Awad, O. I., Wang, A., Tang, Y., Liu, Y., & Mahdi, M. A. (2025) · Energy and Buildings · doi:10.1016/j.enbuild.2025.116644 · Cited by 13 · see citing works
Bachoumis, A., Mylonas, C., Plakas, K. A., Birbas, M., & Birbas, A. N. (2023) · IEEE Access · doi:10.1109/access.2023.3335191 · Cited by 12 · see citing works
Stennikov, V. A., Алексеевич, Б. Е., & Сергеевич, М. Г. (2022) · Energy Reports · doi:10.1016/j.egyr.2022.11.117 · Cited by 11 · see citing works
Optimal Design of Drying Process of the Potatoes with Multi-Agent Reinforced Deep Learning
Jamalabadi, M. Y. A. (2024) · Frontiers in Heat and Mass Transfer · doi:10.32604/fhmt.2024.051004 · Cited by 8 · see citing works
Mouzakitis, S., Markaki, O. I., Papapostolou, K., Karakolis, E., Pelekis, S., & Psarras, J. E. (2024) · Lecture notes in networks and systems · doi:10.1007/978-3-031-47724-9_5 · Cited by 5 · see citing works
Mirhoseini, S. P., Nazari, M. H., & Fallahi, F. (2026) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2026.116790 · Cited by 3 · see citing works
Real-Time Power Dispatch in Grid-Connected Microgrids using Deep Q-Learning
Cambambi, C. A. C., Yang, R. L., Milani, I. P., Rangel, C. A. S., Canha, L. N., & Wolter, M. (2024) · International Universities Power Engineering Conference (UPEC) · doi:10.1109/upec61344.2024.10892513 · Cited by 1 · see citing works
He, J., Yu, L., Qiu, D., Zhang, M., Ye, Y., Wang, Y., Štrbac, G., & Yue, D. (2026) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2026.3715858
- Authors
- Wilk, P., Wang, N., & Li, J.
- Affiliations
- Rowan University (US)
- Corresponding author
- Li, Jie
- Venue
- The Electricity Journal
- Publisher
- Elsevier BV
- Published
- 2022-06
- Volume
- 35
- Issue
- 5
- Pages
- 107129
- ISSN
- 1040-6190 (ISSN-L)
- OpenAlex
- W4229378486
- Cited by
- 9
- References
- 39
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 3 · 2023: 2 · 2022: 1
- FWCI
- 0.48
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- www.elsevier.com/open-access/userlicense/1.0/ (am, 337 d)
- doi.org/10.15223/policy-017 (stm-asf)
- doi.org/10.15223/policy-037 (stm-asf)
- doi.org/10.15223/policy-012 (stm-asf)
- doi.org/10.15223/policy-029 (stm-asf)
- doi.org/10.15223/policy-004 (stm-asf)
- Locations
- The Electricity Journal (acceptedVersion)
- Funders
- National Science Foundation
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Smart Grid Energy Management
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Electric Vehicles and Infrastructure
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Optimal Power Flow Distribution
- Keywords
- multi-agent deep reinforcement learning, energy management, electric vehicles, smart buildings, distributed renewable energy, distributed energy management, electric vehicle charging, demand management, community energy systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review