The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Reinforcement Learning Approach for Optimal Distributed Energy Management in a Microgrid
Abstract
In this paper, a multiagent-based model is used to study distributed energy management in a microgrid (MG). The suppliers and consumers of electricity are modeled as autonomous agents, capable of making local decisions in order to maximize their own profit in a multiagent environment. For every supplier, a lack of information about customers and other suppliers creates challenges to optimal decision making in order to maximize its return. Similarly, customers face difficulty in scheduling their energy consumption without any information about suppliers and electricity prices. Additionally, there are several uncertainties involved in the nature of MGs due to variability in renewable generation output power and continuous fluctuation of customers' consumption. In order to prevail over these challenges, a reinforcement learning algorithm was developed to allow generation resources, distributed storages, and customers to develop optimal strategies for energy management and load scheduling without prior information about each other and the MG system. Case studies are provided to show how the overall performance of all entities converges as an emergent behavior to the Nash equilibrium, benefiting all agents.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
Farhangi, H. (2010) · IEEE Power and Energy Magazine · doi:10.1109/mpe.2009.934876 · Cited by 2,870
Markov games as a framework for multi-agent reinforcement learning
Littman, M. L. (1994) · Machine Learning Proceedings 1994 · doi:10.1016/b978-1-55860-335-6.50027-1 · Cited by 2,614
Reinforcement Learning: An Introduction
(1998) · Kybernetes · doi:10.1108/k.1998.27.9.1093.3 · Cited by 1,472
Lopes, J. A. P., Hatziargyriou, N., Mutale, J., Djapic, P., & Jenkins, N. (2007) · Electric Power Systems Research · doi:10.1016/j.epsr.2006.08.016 · Cited by 1,413
Optimal Renewable Resources Mix for Distribution System Energy Loss Minimization
Atwa, Y. M., El-Saadany, E. F., Salama, M. M. A., & Seethapathy, R. (2010) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2009.2030276 · Cited by 1,387
Nash Q-Learning for General-Sum Stochastic Games
Hu, J., Wellman, M. P., & Boutilier, C. (2003) · Cited by 923
Robust Energy Management for Microgrids With High-Penetration Renewables
Zhang, Y., Gatsis, N., & Giannakis, G. B. (2013) · IEEE Transactions on Sustainable Energy · doi:10.1109/tste.2013.2255135 · Cited by 798
Basak, P., Chowdhury, S., Halder nee Dey, S., & Chowdhury, S. P. (2012) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2012.05.043 · Cited by 508
Dynamic Pricing and Energy Consumption Scheduling With Reinforcement Learning
Kim, B.-G., Zhang, Y., van der Schaar, M., & Lee, J.-W. (2016) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2015.2495145 · Cited by 299
Reinforcement learning for microgrid energy management
Kuznetsova, E., Li, Y.-F., Ruiz, C., Zio, E., Ault, G., & Bell, K. (2013) · Energy · doi:10.1016/j.energy.2013.05.060 · Cited by 274
Reinforcement Learning to Play an Optimal Nash Equilibrium in Team Markov Games
Wang, X., & Sandholm, T. (2002) · Cited by 251
Multi-Agent System for Distributed Management of Microgrids
Foo. Eddy, Y. S., Gooi, H. B., & Chen, S. X. (2015) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2014.2322622 · Cited by 230
Reinforcement Learning of Heuristic EV Fleet Charging in a Day-Ahead Electricity Market
Vandael, S., Claessens, B., Ernst, D., Holvoet, T., & Deconinck, G. (2015) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2015.2393059 · Cited by 208
Cintuglu, M. H., Martin, H., & Mohammed, O. A. (2015) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2014.2387215 · Cited by 169
Economic Dispatch for an Agent-Based Community Microgrid
Shamsi, P., Xie, H., Longe, A., & Joo, J. (2015) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2015.2487422 · Cited by 125
Top-down vs bottom-up methodologies in multi-agent system design
Crespi, V., Galstyan, A., & Lerman, K. (2008) · Autonomous Robots · doi:10.1007/s10514-007-9080-5 · Cited by 122
A Population Dynamics Approach for the Dispatch of Distributed Generators
Pantoja, A. D., & Quijano, N. (2011) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2011.2107714 · Cited by 116
Rahimiyan, M., & Mashhadi, H. R. (2010) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/tsmcc.2010.2044174 · Cited by 96
A Distributed Feedforward Approach to Cooperative Control of AC Microgrids
Cai, H. G., Hu, G., Lewis, F. L., & Davoudi, A. A. (2015) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2015.2507199 · Cited by 95
Distributed Smart-Home Decision-Making in a Hierarchical Interactive Smart Grid Architecture
Li, D., & Jayaweera, S. K. (2014) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2014.2308204 · Cited by 77
Belgana, A., Rimal, B. P., & Maier, M. (2014) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2014.2363119 · Cited by 71
Population Games Methods for Distributed Control of Microgrids
Mojica‐Nava, E., Barreto, C., & Quijano, N. (2015) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2015.2444399 · Cited by 45
Agent-Based Modeling of Distributed Generation in Power System Control
Divényi, D. P., & Dan, A. M. (2013) · IEEE Transactions on Sustainable Energy · doi:10.1109/tste.2013.2253811 · Cited by 37
Cited by
Enabling Massive IoT Toward 6G: A Comprehensive Survey
Guo, F., Yu, F. R., Zhang, H., Li, X., Ji, H., & Leung, V. C. M. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3063686 · Cited by 701
Applications of reinforcement learning in energy systems
Perera, A. T. D., & Kamalaruban, P. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.110618 · Cited by 420
A Multi-Agent Reinforcement Learning-Based Data-Driven Method for Home Energy Management
Xu, X., Jia, Y., Xu, Y., Xu, Z., Chai, S., & Lai, C. S. (2020) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2020.2971427 · Cited by 420
Li, J., Herdem, M. S., Nathwani, J., & Wen, J. Z. (2023) · Energy and AI · doi:10.1016/j.egyai.2022.100208 · Cited by 409
Artificial Intelligence Techniques in Smart Grid: A Survey
Omitaomu, O. A., & Niu, H. (2021) · Smart Cities · doi:10.3390/smartcities4020029 · Cited by 371
Metadata
- Authors
- Foruzan, E., Soh, L.-K., & Asgarpoor, S.
- Venue
- IEEE Transactions on Power Systems
- Published
- 2018-09
- Volume
- 33
- Issue
- 5
- Pages
- 5749-5758
- ISSN
- 0885-8950 (ISSN-L)
- 1558-0679
- OpenAlex
- W2795578496
- Cited by
- 294
- References
- 26
- FWCI
- 13.34
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.