The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Autonomous Voltage Control for Grid Operation Using Deep Reinforcement Learning
Open accessAbstract
Modern power grids are experiencing grand challenges caused by the stochastic and dynamic nature of growing renewable energy and demand response. Traditional theoretical assumptions and operational rules may be violated, which are difficult to be adapted by existing control systems due to the lack of computational power and accurate grid models for use in real time, leading to growing concerns in the secure and economic operation of the power grid. Existing operational control actions are typically determined offline, which are less optimized. This paper presents a novel paradigm, Grid Mind, for autonomous grid operational controls using deep reinforcement learning. The proposed AI agent for voltage control can learn its control policy through interactions with massive offline simulations, and adapts its behavior to new changes including not only load/generation variations but also topological changes. A properly trained agent is tested on the IEEE 14-bus system with tens of thousands of scenarios, and promising performance is demonstrated in applying autonomous voltage controls for secure grid operation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The suggested controllers were discovered to have sufficient overall dynamic performance and circumvent potential limitations related to other competing approaches.”
From A Comprehensive Review on the Role of Artificial Intelligence in Power System Stability, Control, and Protection: Insights and Future Directions (2024) · cites this paper as [116]
Citations
Cites
Power System Stability and Control
Kundur, P. (1994) · Cited by 19,639
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084 · cited 1×
“Using DRL for intelligent controls has achieved significant success in various domains, such as AlphaGo [7], ATARI Games [8], robotics [9], and demand response to improve energy efficiency [10].”
MethodReinforcement learning in robotics: A survey
Kober, J., Bagnell, J. A., & Peters, J. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913495721 · Cited by 3,160 · cited 1×
“Using DRL for intelligent controls has achieved significant success in various domains, such as AlphaGo [7], ATARI Games [8], robotics [9], and demand response to improve energy efficiency [10].”
MethodThe Arcade Learning Environment: An Evaluation Platform for General Agents
Bellemare, M. G., Naddaf, Y., Veness, J., & Bowling, M. (2013) · Journal of Artificial Intelligence Research · doi:10.1613/jair.3912 · Cited by 2,161 · cited 1×
“Using DRL for intelligent controls has achieved significant success in various domains, such as AlphaGo [7], ATARI Games [8], robotics [9], and demand response to improve energy efficiency [10].”
MethodDeep Reinforcement Learning: An Overview
Li, Y. (2017) · arXiv · doi:10.48550/arxiv.1701.07274 · Cited by 762 · cited 2×
“Typical RL algorithms include dynamic programming, Monte Carlo and Temporal difference such as Q-learning [12].”
BackgroundMethodDecision Tree-Based Online Voltage Security Assessment Using PMU Measurements
Diao, R., Sun, K., Vittal, V., O'Keefe, R. J., Richardson, M. R., Bhatt, N., Stradford, D., & Sarawgi, S. K. (2009) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2009.2016528 · Cited by 268 · cited 1×
“Machine learning based methods, e.g., decision trees, support vector machines, neural networks, have also been proposed to first train agents using offline analysis and then apply in real time [4]-[6].”
MethodSelf-citationDeep Reinforcement Learning: An Overview
Mousavi, S. S., Schukat, M., & Howley, E. (2018) · Lecture Notes in Networks and Systems · doi:10.1007/978-3-319-56991-8_32 · Cited by 261
Diao, R., Vittal, V., & Logic, N. (2009) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2009.2035507 · Cited by 156
Self-citationDecision tree assisted controlled islanding for preventing cascading events
Diao, R., Vittal, V., Sun, K., Kolluri, S., Mandal, S., & Galvan, F. (2009) · IEEE PES Power Systems Conference and Exposition · doi:10.1109/psce.2009.4839985 · Cited by 55 · cited 1×
“Machine learning based methods, e.g., decision trees, support vector machines, neural networks, have also been proposed to first train agents using offline analysis and then apply in real time [4]-[6].”
MethodSelf-citationA Human Expert-Based Approach to Electrical Peak Demand Management
Bian, D., Pipattanasomporn, M., & Rahman, S. (2014) · IEEE Transactions on Power Delivery · doi:10.1109/tpwrd.2014.2348495 · Cited by 42 · cited 1×
“Using DRL for intelligent controls has achieved significant success in various domains, such as AlphaGo [7], ATARI Games [8], robotics [9], and demand response to improve energy efficiency [10].”
Method
Research works printed but not linked: 5
- faggella, 0, Artificial Intelligence Industry - An Overview by Segment
- 0, PNNL GridPACK™
- 0, Anaconda
- 0, Deep Q-learning with Keras and Gym
- 0, TPL-00 1–4 Transmission System Planning Performance Requirements
Cited by
Reinforcement Learning and Its Applications in Modern Power and Energy Systems: A Review
Cao, D., Hu, W., Zhao, J., Zhang, G., Zhang, B., Liu, Z., Chen, Z., & Blaabjerg, F. (2020) · Journal of Modern Power Systems and Clean Energy · doi:10.35833/mpce.2020.000552 · Cited by 460
“Reference [96] proposes a DQN-based ap‐ proach for the autonomous voltage control (AVC) of power grid.”
BackgroundDeep-Reinforcement-Learning-Based Autonomous Voltage Control for Power Grid Operations
Duan, J., Shi, D., Diao, R., Li, H., Wang, Z., Zhang, B., Bian, D., & Yi, Z. (2020) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2019.2941134 · Cited by 434
“Thus, it is of great necessity to develop a novel control paradigm for real-time implementation that can effectively and rapidly support grid operators in making autonomous and effective control actions [3].”
BackgroundSelf-citationWang, W., Yu, N., Gao, Y., & Shi, J. (2020) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2019.2962625 · Cited by 331
“It has been shown that the deep reinforcement learning (DRL) approach could overcome this problem in emergency system control [4], [5].”
BackgroundA Data-Driven Multi-Agent Autonomous Voltage Control Framework Using Deep Reinforcement Learning
Wang, S., Duan, J., Shi, D., Xu, C., Li, H., Diao, R., & Wang, Z. (2020) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2020.2990179 · Cited by 315
“A novel AVC paradigm, called Grid Mind, is proposed to correct the abnormal voltage profiles in [1], [2] using DRL.”
BackgroundMethodInfluentialSelf-citationDeep Reinforcement Learning Based Volt-VAR Optimization in Smart Distribution Systems
Zhang, Y., Wang, X., Wang, J., & Zhang, Y. (2021) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2020.3010130 · Cited by 299
“• Unlike the single-objective RL methods in [18], [20], and [21] that only focus on voltage regulation and ignore the roles of the ZIP load models and smart inverters in optimizing system operation, the proposed MADRL method achieves VVO within milliseconds via these devices and thus can be implemented online.”
Metadata
- Authors
- Diao, R., Wang, Z., Shi, D., Chang, Q., Duan, J., & Zhang, X.
- Affiliations
- Global Energy Interconnection Research Institute North America (US)
- University of California, Davis (US)
- Venue
- 2019 IEEE Power & Energy Society General Meeting (PESGM)
- Publisher
- IEEE
- Published
- 2019-08
- Pages
- 1-5
- ISSN
- 1932-5517 (ISSN-L)
- OpenAlex
- W3003497208
- Cited by
- 115
- References
- 11
- Citations by year
- 2026: 3 · 2025: 10 · 2024: 18 · 2023: 22 · 2022: 18 · 2021: 18 · 2020: 18 · 2019: 8
- FWCI
- 24.66
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Power Engineering Society General Meeting (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- State Grid Corporation of China
- State Grid Jiangsu Electric Power
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Optimal Power Flow Distribution
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Power System Optimization and Stability
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Smart Grid and Power Systems
- Keywords
- deep reinforcement learning, power system operation, AI agents, renewable energy integration, demand response, IEEE 14-bus system, power system security, topology change
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Autonomous Voltage Control for Grid Operation Using Deep Reinforcement Learning. https://app.cochat.ai/papers/10.1109/pesgm40551.2019.8973924
- The paper
- Diao, R., Wang, Z., Shi, D., Chang, Q., Duan, J., & Zhang, X. (2019). Autonomous Voltage Control for Grid Operation Using Deep Reinforcement Learning. 2019 IEEE Power & Energy Society General Meeting (PESGM). https://doi.org/10.1109/pesgm40551.2019.8973924
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.