The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Optimal energy management strategies for energy Internet via deep reinforcement learning approach
Abstract
This paper investigates the energy management problem in the field of energy Internet (EI) with interdisciplinary techniques. The concept of EI has been proposed for a while. However, there still exist many fundamental and technical issues that have not been fully investigated. In this paper, a new energy regulation issue is considered based on the operational principles of EI. Multiple targets are considered along with constraints. Then, the practical energy management problem is formulated as a constrained optimal control problem. Notably, no explicit mathematical model for power of renewable power generation devices and loads is utilized. Due to the complexity of this problem, conventional methods appear to be inapplicable. To obtain the desired control scheme, a model-free deep reinforcement learning algorithm is applied. A practical solution is obtained, and the feasibility as well as the performance of the proposed method are evaluated with numerical simulations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Advances in neural information processing systems 7
Cios, K., & Shields, M. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,059
Machine learning: Trends, perspectives, and prospects
Jordan, M. I., & Mitchell, T. M. (2015) · Science · doi:10.1126/science.aaa8415 · Cited by 9,955
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Stochastic differential equations and applications
Mao, X. (2008) · Woodhead Publishing Limited eBooks · doi:10.1533/9780857099402 · Cited by 4,589
Kennedy, J. (2011) · Encyclopedia of Machine Learning · doi:10.1007/978-0-387-30164-8_630 · Cited by 2,989
Long short-term memory recurrent neural network architectures for large scale acoustic modeling
Sak, H., Senior, A., & Beaufays, F. (2014) · Interspeech 2014 · doi:10.21437/interspeech.2014-80 · Cited by 2,973
Rifkin, J. (2011) · Cited by 1,321
Smart Energy Systems for coherent 100% renewable energy and transport solutions
Mathiesen, B. V., Lund, H., Connolly, D., Wenzel, H., Østergaard, P. A., Möller, B., Nielsen, S., Ridjan, I., Karnøe, P., Sperling, K., et al. (2015) · Applied Energy · doi:10.1016/j.apenergy.2015.01.075 · Cited by 1,265 · cited 1×
“g, solar power and wind power have attracted much attention [1, 2].”
BackgroundThurner, L., Scheidler, A., Schafer, F., Menke, J.-H., Dollichon, J., Meier, F., Meinecke, S., & Braun, M. (2018) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2018.2829021 · Cited by 1,171
Geidl, M., Koeppel, G., Favre-Perrod, P., Klockl, B., Andersson, G., & Frohlich, K. (2007) · IEEE Power and Energy Magazine · doi:10.1109/mpae.2007.264850 · Cited by 1,132
DC microgrids and distribution systems: An overview
Elsayed, A. T., Mohamed, A. A., & Mohammed, O. A. (2015) · Electric Power Systems Research · doi:10.1016/j.epsr.2014.10.017 · Cited by 590
Building energy load forecasting using Deep Neural Networks
Marino, D. L., Amarasinghe, K., & Manic, M. (2016) · IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society · doi:10.1109/iecon.2016.7793413 · Cited by 522
Electric Energy Systems : Analysis and Operation
Gómez‐Expósito, A., Conejo, A. J., & Cañizares, C. A. (2008) · Cited by 519
Sun, Q., Han, R., Zhang, H., Zhou, J., & Guerrero, J. M. (2015) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2015.2412779 · Cited by 401
Korkas, C. D., Baldi, S., Michailidis, I., & Kosmatopoulos, E. B. (2016) · Applied Energy · doi:10.1016/j.apenergy.2015.10.140 · Cited by 361
Robust Frequency Control in an Islanded Microgrid: H∞ and μ-Synthesis Approaches
Bevrani, H., Feizi, M. R., & Ataee, S. (2015) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2015.2446984 · Cited by 317
Cordoba-Arenas, A., Onori, S., Guezennec, Y., & Rizzoni, G. (2015) · Journal of Power Sources · doi:10.1016/j.jpowsour.2014.12.047 · Cited by 255
Renewable Energy for a Clean and Sustainable Future
BILGEN, S., KAYGUSUZ, K., & SARI, A. (2004) · Energy Sources · doi:10.1080/00908310490441421 · Cited by 242
Energy router: Architectures and functionalities toward Energy Internet
Xu, Y., Zhang, J., Wang, W., Juneja, A., & Bhattacharya, S. (2011) · 2011 IEEE International Conference on Smart Grid Communications (SmartGridComm) · doi:10.1109/smartgridcomm.2011.6102340 · Cited by 239
From smart grids to an energy internet: Assumptions, architectures and requirements
Tsoukalas, L. H., & Gao, R. (2008) · 2008 Third International Conference on Electric Utility Deregulation and Restructuring and Power Technologies · doi:10.1109/drpt.2008.4523385 · Cited by 227
Energy Management for Lifetime Extension of Energy Storage System in Micro-Grid Applications
Tran, D., & Khambadkone, A. M. (2013) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2013.2272835 · Cited by 225
Sezgin, S. (2018) · Turkish Journal of Business Ethics · doi:10.12711/tjbe.2018.11.1.0005r · Cited by 174
Vlachogiannis, J. G. (2009) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2009.2030420 · Cited by 171
Distributed EMPC of multiple microgrids for coordinated stochastic energy management
Kou, P., Liang, D., & Gao, L. (2016) · Applied Energy · doi:10.1016/j.apenergy.2016.09.092 · Cited by 167
Optimised simulated annealing for Ising spin glasses
Isakov, S., Zintchenko, I., Rønnow, T. F., & Troyer, M. (2014) · Computer Physics Communications · doi:10.1016/j.cpc.2015.02.015 · Cited by 164
Claessens, B., Vrancx, P., & Ruelens, F. (2016) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2629450 · Cited by 160
Zhu, H., Li, X., Sun, Q., Nie, L., Yao, J., & Zhao, G. (2015) · Energies · doi:10.3390/en9010011 · Cited by 154
A Graph Theory Based Energy Routing Algorithm in Energy Local Area Network
Wang, R., Wu, J., Qian, Z., Lin, Z., & He, X. (2017) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2713040 · Cited by 131
Multi-offspring genetic algorithm and its application to the traveling salesman problem
Wang, J., Ersoy, O. K., He, M., & Wang, F. (2016) · Applied Soft Computing · doi:10.1016/j.asoc.2016.02.021 · Cited by 124
Stochastic Optimal Control for Energy Internet: A Bottom-Up Energy Management Approach
Hua, H., Qin, Y., Hao, C., & Cao, J. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2867373 · Cited by 121
Self-citationFractional Order Darwinian Particle Swarm Optimization
Couceiro, M. S., & Ghamisi, P. (2015) · SpringerBriefs in applied sciences and technology · doi:10.1007/978-3-319-19635-0 · Cited by 106
Zhang, Y., Rahbari‐Asr, N., Duan, J., & Chow, M. (2016) · IEEE Transactions on Sustainable Energy · doi:10.1109/tste.2016.2581167 · Cited by 98
Lashway, C. R., & Mohammed, O. A. (2016) · IEEE Transactions on Transportation Electrification · doi:10.1109/tte.2016.2558843 · Cited by 81
Deep Learning-Based Distributed Optimal Control for Wide Area Energy Internet
Yang, G., Cao, J., Hua, H., & Zhou, Z. (2018) · IEEE International Conference on Energy Internet (ICEI) · doi:10.1109/icei.2018.00060 · Cited by 21
Self-citationHamilton–Jacobi–Bellman Equations
Festa, A., Guglielmi, R., Hermosilla, C., Picarelli, A., Sahu, S., Sassi, A., & Álvarez, F. J. S. (2017) · Lecture notes in mathematics · doi:10.1007/978-3-319-60771-9_2 · Cited by 10
Cited by
A review of deep learning for renewable energy forecasting
Wang, H., Lei, Z., Zhang, X., Zhou, B., & Peng, J. (2019) · Energy Conversion and Management · doi:10.1016/j.enconman.2019.111799 · Cited by 1,193
Edge Computing with Artificial Intelligence: A Machine Learning Perspective
Hua, H., Li, Y., Wang, T., Dong, N., Li, W., & Cao, J. (2023) · ACM Computing Surveys · doi:10.1145/3555802 · Cited by 563
Self-citationApplications of reinforcement learning in energy systems
Perera, A. T. D., & Kamalaruban, P. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.110618 · Cited by 420
Wu, Y., Tan, H., Peng, J., Zhang, H., & He, H. (2019) · Applied Energy · doi:10.1016/j.apenergy.2019.04.021 · Cited by 332
Shi, Z., Yao, W., Li, Z., Zeng, L., Zhao, Y., Zhang, R., Tang, Y., & Wen, J. (2020) · Applied Energy · doi:10.1016/j.apenergy.2020.115733 · Cited by 327
Metadata
- Authors
- Hua, H., Qin, Y., Hao, C., & Cao, J.
- Venue
- Applied Energy
- Publisher
- Elsevier BV
- Published
- 2019-04
- Volume
- 239
- Pages
- 598-609
- ISSN
- 0306-2619 (ISSN-L)
- OpenAlex
- W2911256795
- Cited by
- 329
- References
- 35
- FWCI
- 15.69
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.