The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Intelligent Multi-Microgrid Energy Management Based on Deep Neural Network and Model-Free Reinforcement Learning
Abstract
In this paper, an intelligent multi-microgrid (MMG) energy management method is proposed based on deep neural network (DNN) and model-free reinforcement learning (RL) techniques. In the studied problem, multiple microgrids are connected to a main distribution system and they purchase power from the distribution system to maintain local consumption. From the perspective of the distribution system operator (DSO), the target is to decrease the demand-side peak-to-average ratio (PAR), and to maximize the profit from selling energy. To protect user privacy, DSO learns the MMG response by implementing a DNN without direct access to user's information. Further, the DSO selects its retail pricing strategy via a Monte Carlo method from RL, which optimizes the decision based on prediction. The simulation results from the proposed data-driven deep learning method, as well as comparisons with conventional model-based methods, substantiate the effectiveness of the proposed approach in solving power system problems with partial or uncertain information.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
(2010) · Cited by 14,134
Mohsenian-Rad, A.-H., Wong, V. W. S., Jatskevich, J., Schober, R., & Leon-Garcia, A. (2010) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2010.2089069 · Cited by 2,744
Model-Free Renewable Scenario Generation Using Generative Adversarial Networks
Chen, Y., Wang, Y., Kirschen, D., & Zhang, B. (2018) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2018.2794541 · Cited by 674
On-Line Building Energy Optimization Using Deep Reinforcement Learning
Mocanu, E., Mocanu, D. C., Nguyen, P. H., Liotta, A., Webber, M. E., Gibescu, M., & Slootweg, J. G. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2834219 · Cited by 649
Short-Term Residential Load Forecasting Based on Resident Behaviour Learning
Kong, W., Dong, Z. Y., Hill, D. J., Luo, F., & Xu, Y. (2018) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2017.2688178 · Cited by 612
Model-Free Real-Time EV Charging Scheduling Based on Deep Reinforcement Learning
Wan, Z., Li, H., He, H., & Prokhorov, D. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2879572 · Cited by 548 · cited 1×
“The authors in [23] proposed the application of deep RL to optimize the real-time electric vehicle charging schedule with the consideration of future electricity price.”
BackgroundDemand Response Scheduling by Stochastic SCUC
Parvania, M., & Fotuhi-Firuzabad, M. (2010) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2010.2046430 · Cited by 427
Yan, Z., & Xu, Y. (2019) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2018.2881359 · Cited by 387
Yuan, H., Li, F., Wei, Y., & Zhu, J. (2018) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2594814 · Cited by 372
Self-citationResidential Demand Response Using Reinforcement Learning
O'Neill, D., Levorato, M., Goldsmith, A., & Mitra, U. (2010) · 2010 First IEEE International Conference on Smart Grid Communications · doi:10.1109/smartgrid.2010.5622078 · Cited by 281
Optimal Demand Response Using Device-Based Reinforcement Learning
Wen, Z., O'Neill, D., & Maei, H. (2015) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2015.2396993 · Cited by 266
Distributed Economic Dispatch in Microgrids Based on Cooperative Reinforcement Learning
Liu, W., Zhuang, P., Liang, H., Peng, J., & Huang, Z. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2801880 · Cited by 247
Game-Theoretic Demand-Side Management With Storage Devices for the Future Smart Grid
Soliman, H. M., & Leon‐Garcia, A. (2014) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2014.2302245 · Cited by 236
Zeng, P., Li, H., He, H., & Li, S. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2859821 · Cited by 232
Residential Energy Consumption Scheduling: A Coupled-Constraint Game Approach
Deng, R., Yang, Z., Chen, J., Asr, N. R., & Chow, M.-Y. (2014) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2013.2287494 · Cited by 226
Deep Learning-Based Socio-Demographic Information Identification From Smart Meter Data
Wang, Y., Chen, Q., Gan, D., Yang, J., Kirschen, D. S., & Kang, C. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2805723 · Cited by 221
Short-Term Electricity Price Forecasting With Stacked Denoising Autoencoders
Wang, L., Zhang, Z., & Chen, J. (2017) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2016.2628873 · Cited by 190
Plug-In Electric Vehicle to Home (V2H) Operation Under a Grid Outage
Shin, H., & Baldick, R. (2017) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2603502 · Cited by 175 · cited 1×
“, distributed generators, plug-in electric vehicles, demand response programs, and microgrids, in providing energy and ancillary services to the utility grid in both normal and emergent status [5].”
BackgroundClaessens, B., Vrancx, P., & Ruelens, F. (2016) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2629450 · Cited by 160
An Online Learning Algorithm for Demand Response in Smart Grid
Bahrami, S., Wong, V. W. S., & Huang, J. (2017) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2017.2667599 · Cited by 149
Real-Time Pricing for Demand Response Based on Stochastic Approximation
Samadi, P., Mohsenian‐Rad, H., Wong, V. W. S., & Schober, R. (2014) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2013.2293131 · Cited by 127
From AlphaGo to Power System AI: What Engineers Can Learn from Solving the Most Complex Board Game
Li, F. F., & Du, Y. (2018) · IEEE Power and Energy Magazine · doi:10.1109/mpe.2017.2779554 · Cited by 89
Self-citationDu, Y., & Li, F. F. (2018) · IEEE Transactions on Sustainable Energy · doi:10.1109/tste.2018.2884223 · Cited by 77
Self-citationDynamic load management for a residential customer; Reinforcement Learning approach
Sheikhi, A., Rayati, M., & Ranjbar, A. M. (2016) · Sustainable Cities and Society · doi:10.1016/j.scs.2016.04.001 · Cited by 38
Guest Editorial Special Section on Industrial and Commercial Demand Response
Catalào, J. P. S., Siano, P., Li, F. F., Masoum, M. A. S., & Aghaei, J. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2869296 · Cited by 4
Self-citation
Cited by
Reinforcement Learning and Its Applications in Modern Power and Energy Systems: A Review
Cao, D., Hu, W., Zhao, J., Zhang, G., Zhang, B., Liu, Z., Chen, Z., & Blaabjerg, F. (2020) · Journal of Modern Power Systems and Clean Energy · doi:10.35833/mpce.2020.000552 · Cited by 460
A Multi-Agent Reinforcement Learning-Based Data-Driven Method for Home Energy Management
Xu, X., Jia, Y., Xu, Y., Xu, Z., Chai, S., & Lai, C. S. (2020) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2020.2971427 · Cited by 420
Chen, X., Qu, G., Tang, Y., Low, S., & Li, N. (2022) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2022.3154718 · Cited by 415
Aguilar, J., Garces-Jimenez, A., R-Moreno, M. D., & García, R. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2021.111530 · Cited by 278
“Du and Li [58] define an EMS for a smart multi-microgrid (MMG) that combines two techniques, the DL and the RL methods.”
MethodIntelligent multi-zone residential HVAC control strategy based on deep reinforcement learning
Du, Y., Zandi, H., Kotevska, O., Kurte, K., Munk, J., Amasyali, K., Mckee, E., & Li, F. (2021) · Applied Energy · doi:10.1016/j.apenergy.2020.116117 · Cited by 268
Self-citation
Metadata
- Authors
- Du, Y., & Li, F.
- Venue
- IEEE Transactions on Smart Grid
- Published
- 2020-03
- Volume
- 11
- Issue
- 2
- Pages
- 1066-1076
- ISSN
- 1949-3053 (ISSN-L)
- 1949-3061
- OpenAlex
- W2963723202
- Cited by
- 393
- References
- 29
- FWCI
- 12.78
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.