The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Review on the research and practice of deep learning and reinforcement learning in smart grids
Open accessAbstract
Smart grids are the developmental trend of power systems and they have attracted much attention all over the world. Due to their complexities, and the uncertainty of the smart grid and high volume of information being collected, artificial intelligence techniques represent some of the enabling technologies for its future development and success. Owing to the decreasing cost of computing power, the profusion of data, and better algorithms, AI has entered into its new developmental stage and AI 2.0 is developing rapidly. Deep learning (DL), reinforcement learning (RL) and their combination-deep reinforcement learning (DRL) are representative methods and relatively mature methods in the family of AI 2.0. This article introduces the concept and status quo of the above three methods, summarizes their potential for application in smart grids, and provides an overview of the research work on their application in smart grids.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
He, Y., Mendis, G. J., & Wei, J. (2017) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2017.2703842 · Cited by 834
On-Line Building Energy Optimization Using Deep Reinforcement Learning
Mocanu, E., Mocanu, D. C., Nguyen, P. H., Liotta, A., Webber, M. E., Gibescu, M., & Slootweg, J. G. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2834219 · Cited by 649
Ensemble deep learning for regression and time series forecasting
Qiu, X., Zhang, L., Ren, Y., Suganthan, P., & Amaratunga, G. (2014) · 2014 IEEE Symposium on Computational Intelligence in Ensemble Learning (CIEL) · doi:10.1109/ciel.2014.7015739 · Cited by 368
Deep neural networks for energy load forecasting
Amarasinghe, K., Marino, D. L., & Manic, M. (2017) · 2017 IEEE 26th International Symposium on Industrial Electronics (ISIE) · doi:10.1109/isie.2017.8001465 · Cited by 336
Residential Demand Response of Thermostatically Controlled Loads Using Batch Reinforcement Learning
Ruelens, F., Claessens, B. J., Vandael, S., De Schutter, B., Babuska, R., & Belmans, R. (2017) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2517211 · Cited by 333
Dynamic Energy Management System for a Smart Microgrid
Venayagamoorthy, G. K., Sharma, R. K., Gautam, P. K., & Ahmadi, A. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2514358 · Cited by 328
Dynamic Pricing and Energy Consumption Scheduling With Reinforcement Learning
Kim, B.-G., Zhang, Y., van der Schaar, M., & Lee, J.-W. (2016) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2015.2495145 · Cited by 299
Residential Demand Response Using Reinforcement Learning
O'Neill, D., Levorato, M., Goldsmith, A., & Mitra, U. (2010) · 2010 First IEEE International Conference on Smart Grid Communications · doi:10.1109/smartgrid.2010.5622078 · Cited by 281
Optimal Demand Response Using Device-Based Reinforcement Learning
Wen, Z., O'Neill, D., & Maei, H. (2015) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2015.2396993 · Cited by 266
Q-Learning-Based Vulnerability Analysis of Smart Grid Against Sequential Topology Attacks
Yan, J., He, H., Zhong, X., & Tang, Y. (2017) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2016.2607701 · Cited by 264
Du, X., Cai, Y., Wang, S., & Zhang, L. (2016) · 2016 31st Youth Academic Annual Conference of Chinese Association of Automation (YAC) · doi:10.1109/yac.2016.7804882 · Cited by 220
Battery Energy Management in a Microgrid Using Batch Reinforcement Learning
Mbuwir, B., Ruelens, F., Spiessens, F., & Deconinck, G. (2017) · Energies · doi:10.3390/en10111846 · Cited by 187
Short-term load forecasting in smart grid: A combined CNN and K-means clustering approach
Dong, X., Qian, L., & Huang, L. (2017) · 2017 IEEE International Conference on Big Data and Smart Computing (BigComp) · doi:10.1109/bigcomp.2017.7881726 · Cited by 180
Reinforcement Learning Applied to an Electric Water Heater: From Theory to Practice
Ruelens, F., Claessens, B. J., Quaiyum, S., De Schutter, B., Babuska, R., & Belmans, R. (2018) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2640184 · Cited by 173
Two Machine Learning Approaches for Short-Term Wind Speed Time-Series Prediction
Ak, R., Fink, O., & Zio, E. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2418739 · Cited by 170
Claessens, B., Vrancx, P., & Ruelens, F. (2016) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2629450 · Cited by 160
Short-term prediction of wind power based on deep Long Short-Term Memory
Qu, X., Xiaoning, K., Zhang, C., Jiang, S., & Ma, X. (2016) · Asia-Pacific Power and Energy Engineering Conference (APPEEC) · doi:10.1109/appeec.2016.7779672 · Cited by 155
Two Distributed-State Models For Generating High-Dimensional Time Series
Taylor, G. W., Hinton, G. E., & Roweis, S. T. (2011) · Journal of Machine Learning Research · doi:10.5555/1953048.2021035 · Cited by 151
Conditional Restricted Boltzmann Machines for Structured Output PredictionPreprint
Mnih, V., Larochelle, H., & Hinton, G. E. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1202.3748 · Cited by 147
Deep Reinforcement Learning Solutions for Energy Microgrids Management
François-Lavet, V., Taralla, D., Ernst, D., & Raphael Fonteneau, D. (2016) · ORBi (University of Liège) · Cited by 128
A Multiagent Design for Power Distribution Systems Automation
Ghorbani, M. J., Choudhry, M. A., & Feliachi, A. (2015) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2015.2453884 · Cited by 100
Ruelens, F., Claessens, B., Vandael, S., Iacovella, S., Vingerhoets, P., & Belmans, R. J. M. (2014) · Power Systems Computation Conference · doi:10.1109/pscc.2014.7038106 · Cited by 86
Shapley Value Estimation for Compensation of Participants in Demand Response Programs
O'Brien, G., Gamal, A. E., & Rajagopal, R. (2015) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2015.2402194 · Cited by 82
Heterogeneous Energy Storage Optimization for Microgrids
Qiu, X., Nguyen, T. A., & Crow, M. L. (2015) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2015.2461134 · Cited by 82
Short-Term Power Load Forecasting with Deep Belief Network and Copula Models
He, Y., Deng, J., & Li, H. (2017) · International Conference on Intelligent Human-Machine Systems and Cybernetics · doi:10.1109/ihmsc.2017.50 · Cited by 76
Strategy Learning for Autonomous Agents in Smart Grid Markets
Reddy, P. P., & Veloso, M. (2011) · Cited by 61
Big IoT data mining for real-time energy disaggregation in buildings
Mocanu, D. C., Mocanu, E., Nguyen, P. H., Gibescu, M., & Liotta, A. (2016) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2016.7844820 · Cited by 51
Sogabe, T., Ichikawa, H., Sogabe, T., Sakamoto, K., Yamaguchi, K., Sogabe, M., Sato, T. G., & Suwa, Y. (2016) · IEEE Innovative Smart Grid Technologies-Asia · doi:10.1109/isgt-asia.2016.7796524 · Cited by 33
Peng, X., Pan, F., Liang, Y., Luo, Z., & Long, L. (2017) · International Conference on Smart Grid and Electrical Automation (ICSGEA) · doi:10.1109/icsgea.2017.19 · Cited by 33
Jasmin, E. A., Ahamed, T. P. I., & Remani, T. (2016) · IEEE International Conference on Power Electronics, Drives and Energy Systems · doi:10.1109/pedes.2016.7914428 · Cited by 24
Building load management clusters using reinforcement learning
Ahmed, S., & Bouffard, F. (2017) · IEEE Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON) · doi:10.1109/iemcon.2017.8117147 · Cited by 18
Reinforcement learning: survey of recent work
Xue-songa, C. (2010) · Jisuanji yingyong yanjiu · Cited by 9
Deep Learning Applied to PMU Data in Power Systems
Cardoso, P. E. D. R. (2017) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) · doi:10.34626/qrgg-9q53 · Cited by 9
Cited by
Enabling Massive IoT Toward 6G: A Comprehensive Survey
Guo, F., Yu, F. R., Zhang, H., Li, X., Ji, H., & Leung, V. C. M. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3063686 · Cited by 701
Deep reinforcement learning for cyber security
Nguyen, T. T., & Reddi, V. J. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3121870 · Cited by 620
Quo vadis artificial intelligence?
Jiang, Y., Li, X., Luo, H., Yin, S., & Kaynak, O. (2022) · Discover Artificial Intelligence · doi:10.1007/s44163-022-00022-8 · Cited by 544
A Review of Deep Reinforcement Learning for Smart Building Energy Management
Yu, L., Qin, S., Zhang, M., Shen, C., Jiang, T., & Guan, X. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3078462 · Cited by 476
Machine learning driven smart electric power systems: Current trends and new perspectives
Ibrahim, M. S., Dong, W., & Yang, Q. (2020) · Applied Energy · doi:10.1016/j.apenergy.2020.115237 · Cited by 435
Metadata
- Authors
- China Electric Power Research Institute, Zhang, D., Han, X., Taiyuan University of Technology, Deng, C., & China Electric Power Research Institute
- Venue
- CSEE Journal of Power and Energy Systems
- Publisher
- Power System Technology Press
- Published
- 2018-09-24
- Volume
- 4
- Issue
- 3
- Pages
- 362-370
- ISSN
- 2096-0042 (ISSN-L)
- OpenAlex
- W2892841407
- Cited by
- 561
- References
- 34
- FWCI
- 19.00
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.