The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Multi-agent hierarchical reinforcement learning for energy management
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Strategies inspired by consensus algorithms provide fallback pathways: even if fresh global updates stall, agents converge on safe default behaviors, such as limiting output swings, to prevent instabilities until synchronization resumes [23].”
From Explainable AI and Multi-Agent Systems for Energy Management in IoT-Edge Environments: A State of the Art Review (2026) · cites this paper as [23]
Citations
Cites
Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments
Lowe, R., Wu, Y., Tamar, A., Harb, J., Abbeel, P., & Mordatch, I. (2017) · arXiv · doi:10.48550/arxiv.1706.02275 · Cited by 3,377
An Introduction to Deep Reinforcement Learning
François-Lavet, V., Henderson, P., Islam, R., Bellemare, M. G., & Pineau, J. (2018) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000071 · Cited by 1,512
Nguyen, T. T., Nguyen, N. D., & Nahavandi, S. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.2977374 · Cited by 1,306
Recent Advances in Hierarchical Reinforcement Learning
Barto, A. G., & Mahadevan, S. (2003) · Discrete Event Dynamic Systems · doi:10.1023/a:1022140919877 · Cited by 1,059
Multi-Agent Deep Reinforcement Learning for Large-Scale Traffic Signal Control
Chu, T., Wang, J., Codeca, L., & Li, Z. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2901791 · Cited by 1,046
The Option-Critic Architecture
Bacon, P., Harb, J., & Precup, D. (2017) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v31i1.10916 · Cited by 779
Multi-agent Reinforcement Learning: An Overview
Buşoniu, L., Babuška, R., & Schutter, B. D. (2010) · Studies in computational intelligence · doi:10.1007/978-3-642-14435-6_7 · Cited by 772
A Review of Deep Reinforcement Learning for Smart Building Energy Management
Yu, L., Qin, S., Zhang, M., Shen, C. Q., Jiang, T., & Guan, X. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3078462 · Cited by 556
Peer-to-peer energy sharing through a two-stage aggregated battery control in a community Microgrid
Long, C., Wu, J., Zhou, Y., & Jenkins, N. (2018) · Applied Energy · doi:10.1016/j.apenergy.2018.05.097 · Cited by 519
Chen, X., Qu, G., Tang, Y., Low, S. H., & Li, N. (2022) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2022.3154718 · Cited by 465
Reinforcement Learning and Its Applications in Modern Power and Energy Systems: A Review
Cao, D., Hu, W., Zhao, J., Zhang, G., Zhang, B., Liu, Z., Chen, Z., & Blaabjerg, F. (2020) · Journal of Modern Power Systems and Clean Energy · doi:10.35833/mpce.2020.000552 · Cited by 460
Applications of reinforcement learning in energy systems
Perera, A. T. D., & Kamalaruban, P. (2020) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.110618 · Cited by 457
Multi-Agent Reinforcement Learning: A Review of Challenges and Applications
Canese, L., Cardarilli, G. C., Nunzio, L. D., Fazzolari, R., Giardino, D., Re, M., & Spanò, S. (2021) · Applied Sciences · doi:10.3390/app11114948 · Cited by 454
Optimizing deep learning hyper-parameters through an evolutionary algorithm
Young, S. R., Rose, D. C., Karnowski, T. P., Lim, S., & Patton, R. M. (2015) · doi:10.1145/2834892.2834896 · Cited by 435
A Multi-Agent Reinforcement Learning-Based Data-Driven Method for Home Energy Management
Xu, X., Jia, Y., Xu, Y., Xu, Z., Chai, S., & Lai, C. S. (2020) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2020.2971427 · Cited by 420
Lu, R., Hong, S. H., & Yu, M. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2019.2909266 · Cited by 402
Reinforcement Learning Approach for Optimal Distributed Energy Management in a Microgrid
Foruzan, E., Soh, L., & Asgarpoor, S. (2018) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2018.2823641 · Cited by 304
Real-Time Energy Management of a Microgrid Using Deep Reinforcement Learning
Ji, Y., Wang, J., Xu, J., Fang, X., & Zhang, H. (2019) · Energies · doi:10.3390/en12122291 · Cited by 292
Benchmarking Multi-Agent Deep Reinforcement Learning Algorithms in Cooperative TasksPreprint
Papoudakis, G., Christianos, F., Schäfer, L., & Albrecht, S. V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.07869 · Cited by 271
Reinforcement learning in sustainable energy and electric systems: a survey
Yang, T., Zhao, L., Li, W., & Zomaya, A. Y. (2020) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2020.03.001 · Cited by 248
IEEE PES Innovative Smart Grid Technologies, Europe
(2014) · doi:10.1109/isgteurope32333.2014 · Cited by 247
Glavic, M., Fonteneau, R., & Ernst, D. (2017) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2017.08.1217 · Cited by 241
Coelho, V. N., Cohen, M. W., Coelho, I. M., Liu, N., & Guimarães, F. G. (2016) · Applied Energy · doi:10.1016/j.apenergy.2016.10.056 · Cited by 219
Demand side management to reduce Peak-to-Average Ratio using game theory in smart grid
Nguyen, H. K., Song, J. B., & Han, Z. (2012) · IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) · doi:10.1109/infcomw.2012.6193526 · Cited by 183
IEEE Canadian Conference on Electrical and Computer Engineering
(2002) · doi:10.1109/ccece.2002.1015156 · Cited by 169
Glavic, M. (2019) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2019.09.008 · Cited by 163
Arwa, E. O., & Folly, K. A. (2020) · IEEE Access · doi:10.1109/access.2020.3038735 · Cited by 154
Multiagent Reinforcement Learning for Energy Management in Residential Buildings
Ahrarinouri, M., Rastegar, M., & Seifi, A. R. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.2977104 · Cited by 132
Innovations in Multi-Agent Systems and Applications - 1
Srinivasan, D., & Jain, L. C. (2010) · Studies in computational intelligence · doi:10.1007/978-3-642-14435-6 · Cited by 129
Deep Reinforcement Learning Solutions for Energy Microgrids Management
François-Lavet, V., Taralla, D., Ernst, D., & Raphael Fonteneau, D. (2016) · ORBi (University of Liège) · Cited by 128
Comprehensive overview of multi-agent systems for controlling smart grids
Mahela, O. P., Khosravy, M., Gupta, N., Khan, B., Alhelou, H. H., Mahla, R., Patel, N. V., & Siano, P. (2020) · CSEE Journal of Power and Energy Systems · doi:10.17775/cseejpes.2020.03390 · Cited by 120
Karavas, C.-S. G., Arvanitis, K. G., & Papadakis, G. (2017) · Energies · doi:10.3390/en10111756 · Cited by 111
(2019) · doi:10.1109/powerafrica46609.2019 · Cited by 111
Efficient Hyperparameter Optimization in Deep Learning Using a Variable Length Genetic AlgorithmPreprint
Xiao, X., Yan, M., Basodi, S., Ji, C., & Pan, Y. F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.12703 · Cited by 87
Multi-agent Deep Reinforcement Learning for Zero Energy Communities
Prasad, A., & Dusparić, I. (2019) · IEEE PES Innovative Smart Grid Technologies Europe · doi:10.1109/isgteurope.2019.8905628 · Cited by 71
2012 Proceedings IEEE INFOCOM Workshops
(2012) · doi:10.1109/infocomwkshps20483.2012 · Cited by 71
Multi-time scale energy management framework for smart PV systems mixing fast and slow dynamics
Watari, D., Taniguchi, I., Goverde, H., Manganiello, P., Shirazi, E., Catthoor, F., & Onoye, T. (2021) · Applied Energy · doi:10.1016/j.apenergy.2021.116671 · Cited by 59
Rahim, S., Javaid, N., Khan, R. D., Nawaz, N., & Iqbal, M. N. (2019) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2019.117688 · Cited by 58
Why Does Hierarchy (Sometimes) Work So Well in Reinforcement Learning?Preprint
Nachum, O., Tang, H., Lu, X., Gu, S., Lee, H., & Levine, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.10618 · Cited by 53
Challenges of Reinforcement Learning
Ding, Z., & Dong, H. (2020) · Springer eBooks · doi:10.1007/978-981-15-4095-0_7 · Cited by 52
Demand-Side Scheduling Based on Multi-Agent Deep Actor-Critic Learning for Smart Grids
Lee, J., Wang, W., & Niyato, D. T. (2020) · IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm) · doi:10.1109/smartgridcomm47815.2020.9302935 · Cited by 22
When Waiting Is Not an Option: Learning Options With a Deliberation Cost
Harb, J., Bacon, P., Klissarov, M., & Precup, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11831 · Cited by 19
Control system in the smart grid: State of the art and opportunities
Meliani, M., Barkany, A. E., Abbassi, I. E., Darcherif, A., & Mahmoudi, M. (2020) · International Colloquium on Logistics and Supply Chain Management (LOGISTIQUA) · doi:10.1109/logistiqua49782.2020.9353878 · Cited by 18
Multi-Agent Reinforcement Learning for the Energy Optimization of Cyber-Physical Production Systems
Bakakeu, J., Kißkalt, D., Franke, J. E., Baer, S., Klos, H.-H., & Peschke, J. (2020) · Conference proceedings - Canadian Conference on Electrical and Computer Engineering · doi:10.1109/ccece47787.2020.9255795 · Cited by 15
Stochastic Optimization for Distributed Energy Resources in Smart Grids
Guo, Y., Fang, Y. M., & Khargonekar, P. P. (2017) · Springer briefs in electrical and computer engineering · doi:10.1007/978-3-319-59529-0 · Cited by 11
Review of Multi-Agent Micro-Grid Systems
Zarma, T. A., Galadima, A. A., Modibbo, A., & Hussein, S. U. (2020) · IEEE PES/IAS PowerAfrica Conference (PowerAfrica) · doi:10.1109/powerafrica49420.2020.9219942 · Cited by 5
Hierarchical Reinforcement Learning
Huang, Y. H. (2020) · Springer eBooks · doi:10.1007/978-981-15-4095-0_10 · Cited by 3
Cited by
Sorted by citations
Safe reinforcement learning for power system control: A review
Yu, P., Zhang, H., Song, Y., Wang, Z., Dong, H., & Ji, L. (2025) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2025.116022 · Cited by 117
Multi-agent reinforcement learning for resources allocation optimization: a survey
Hady, M. A., Hu, S., Pratama, M., Cao, Z., & Kowalczyk, R. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11340-5 · Cited by 131
Hua, M., Zhang, C., Zhang, F., Li, Z., Yu, X., Xu, H., & Zhou, Q. (2023) · Applied Energy · doi:10.1016/j.apenergy.2023.121526 · Cited by 75
Wu, H., Qiu, D., Zhang, L., & Sun, M. (2024) · Applied Energy · doi:10.1016/j.apenergy.2024.123998 · Cited by 73
Liu, J., Li, Y., Ma, Y., Qin, R., Meng, X., & Wu, J. (2023) · Energy Conversion and Management · doi:10.1016/j.enconman.2023.117728 · Cited by 69
Metadata
- Authors
- Jendoubi, I., & Bouffard, F.
- Affiliations
- Group for Research in Decision Analysis (CA)
- Corresponding author
- Bouffard, François
- Venue
- Applied Energy
- Publisher
- Elsevier BV
- Published
- 2023-02
- Volume
- 332
- Pages
- 120500
- ISSN
- 0306-2619 (ISSN-L)
- OpenAlex
- W3207692912
- Cited by
- 123
- References
- 48
- Citations by year
- 2026: 47 · 2025: 44 · 2024: 23 · 2023: 9
- FWCI
- 5.13
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- Applied Energy (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- Trottier Institute for Sustainability in Engineering and Design
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Smart Grid Energy Management
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Electric Power System Optimization
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Keywords
- multi-agent reinforcement learning, hierarchical reinforcement learning, energy management, energy scheduling, power systems, multi-objective optimization, partially observed systems, distributed control, energy dispatch
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review