Robust Deep Reinforcement Learning Based Coordinated Wide-Area Damping Control for Multimode Inter-Area Oscillations With Randomly Delayed PMU Measurements
Abstract
Although the integration of phasor measurement units (PMUs) and wide-area transmission systems improves the system stability by transmitting the remote control signals to dampen inter-area low-frequency oscillations (LFOs), the reliance on communication networks for signal transmission induced time delays, significantly degrading wide-area damping control (WADC) performance. This paper proposes a coordinated WADC scheme to damp multi-mode LFOs. For LFO modes with small disturbances, this work designs a deep reinforcement learning (DRL) based WADC with a long short-term memory (LSTM) delay compensator. DRL agent adapts to the unknown power systems by designing an optimal stabilization voltage action set. For LFOs with large disturbances, this paper proposed robust DRL-based WADC to stabilize power systems with severe LFOs with online training for a continuous optimal action set. The minimax DRL algorithm optimizes the worst-case performance of the proposed policy and therefore provides robustness to uncertainties. The cyber layer metric (time delay) and the physical system metrics (phase angle and speed) are uniquely combined into the state set and provide sufficient cyber-physical information for the DRL agent. Extensive comparisons on two large IEEE systems under multimode LFOs demonstrate that the proposed coordinated WADCs can improve 20$\%$to 35$\%$of the stabilization effectiveness and save 50$\%$of the training costs.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
Synchronized Phasor Measurements and Their Applications
Phadke, A. G., & Thorp, J. S. (2008) · Power electronics and power systems · doi:10.1007/978-0-387-76537-2 · Cited by 1,814 · see citing works
A fundamental study of inter-area oscillations in power systems
Klein, M., Rogers, G. J., & Kundur, P. (1991) · IEEE Transactions on Power Systems · doi:10.1109/59.119229 · Cited by 1,051 · see citing works
Synchrophasor Measurement Technology in Power Systems: Panorama and State-of-the-Art
Aminifar, F., Fotuhi‐Firuzabad, M., Safdarian, A., et al. (2014) · IEEE Access · doi:10.1109/access.2015.2389659 · Cited by 261 · see citing works
Deep Reinforcement Learning for Smart Grid Operations: Algorithms, Applications, and Prospects
Li, Y., Yu, C., Shahidehpour, M., Yang, T., Zeng, Z., & Chai, T. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3303358 · Cited by 214 · see citing works
Moeini, A., Kamwa, I., Brunelle, P., et al. (2015) · International Universities Power Engineering Conference (UPEC) · doi:10.1109/upec.2015.7339813 · Cited by 152 · see citing works
Effect of packet size on loss rate and delay in wireless links
Korhonen, J., & Wang, Y. (2005) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc.2005.1424754 · Cited by 142 · see citing works
Xu, L., Guo, Q., Wang, Z., et al. (2021) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2021.3052303 · Cited by 90 · see citing works
Zeng, Y., Pou, J., Sun, C., et al. (2022) · IEEE Transactions on Power Electronics · doi:10.1109/tpel.2022.3218900 · Cited by 82 · see citing works
Neural Lyapunov Control for Power System Transient Stability: A Deep Learning-Based Approach
Zhao, T., Wang, J., Lu, X., & Du, Y. (2022) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2021.3102857 · Cited by 75 · see citing works
Wang, X., Bialek, J. W., & Turitsyn, K. S. (2017) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2017.2712762 · Cited by 72 · see citing works
Egbomwan, O. E., Liu, S., & Chaoui, H. (2022) · IEEE Systems Journal · doi:10.1109/jsyst.2022.3222262 · Cited by 63 · see citing works
Self-citationYang, F., Shen, Y., Li, D., et al. (2023) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2023.3242938 · Cited by 62 · see citing works
Yang, F., Huang, D., Li, D., et al. (2022) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2022.3223255 · Cited by 50 · see citing works
Zhao, T., Wang, J., & Yue, M. (2023) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2022.3233770 · Cited by 36 · see citing works
Su, J., Zhang, H., Liu, H., et al. (2023) · IEEE Transactions on Sustainable Energy · doi:10.1109/tste.2023.3266295 · Cited by 33 · see citing works
Prakash, A., Moursi, M. S. E., Parida, S. K., et al. (2023) · IEEE Transactions on Industry Applications · doi:10.1109/tia.2023.3312061 · Cited by 31 · see citing works
Zeng, H., Zhou, Y., Guo, Q., et al. (2021) · CSEE Journal of Power and Energy Systems · doi:10.17775/cseejpes.2020.04610 · Cited by 29 · see citing works
Robust Distributed Secondary Control for AC Microgrids With Time-Varying Delay
Li, X., He, J., Li, X., et al. (2022) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2022.3195037 · Cited by 29 · see citing works
Sabahi, K., Jamil, M., Shokri-Kalandaragh, Y., et al. (2024) · Canadian Journal of Electrical and Computer Engineering · doi:10.1109/icjece.2024.3353670 · Cited by 28 · see citing works
Liu, F., Haotian, L., Liu, Q., et al. (2022) · IEEE Transactions on Power Delivery · doi:10.1109/tpwrd.2022.3197397 · Cited by 27 · see citing works
Zhang, W., & Gong, B. (2023) · IEEE Transactions on Industrial Cyber-Physical Systems · doi:10.1109/ticps.2023.3301445 · Cited by 24 · see citing works
Cui, Z., Hu, W., Zhang, G., et al. (2023) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2023.3315538 · Cited by 20 · see citing works
Distributed Power Management and Adaptive Coordinated Control for SST-Based Power Systems
Ren, L., Zhang, L., Guo, H., Xu, C., Wang, F. “., Zhou, M., Shi, T., Gong, D., & Du, D. (2023) · IEEE Transactions on Industry Applications · doi:10.1109/tia.2023.3275554 · Cited by 12 · see citing works
Das, S. C., Vu, T., Ramasubramanian, D., et al. (2025) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2025.3604554 · Cited by 12 · see citing works
Comparative Analysis of Machine Learning Approaches in Enhancing Power System Stability
Pathan, M. I., Shahriar, M. S., Rahman, M. M., Hossain, M. S., Nadia, A., & Shafiullah, M. (2022) · Wiley eBooks · doi:10.1002/9781119893998.ch9 · Cited by 9 · see citing works
McCutcheon, L., & Fallah, S. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10341953 · Cited by 6 · see citing works
Shi, Y., Yuan, Y., Luo, B., et al. (2024) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2024.3415233 · Cited by 5 · see citing works
A New Binary Encoding Method for Energy Consumption Patterns Quantification
Fang, H., Xiao, J., Wang, Y., et al. (2024) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2024.3370803 · Cited by 3 · see citing works
Max-Min Off-Policy Actor-Critic Method Focusing on Worst-Case Robustness to Model Misspecification
Tanabe, T., Sato, R., Fukuchi, K., et al. (2022) · neural information processing systems · doi:10.52202/068431-0505 · Cited by 1 · see citing works
Zhang, X., Lu, C., Liu, S., et al. (2016) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2015.12.167
Self-citationMo, H., & Sansavini, G. (2021) · Applied Mathematical Modelling · doi:10.1016/j.apm.2020.07.026
Flagged first, then by citations
Cited by
Still being checked.
- Authors
- Li, Q., Liu, S., Yang, C., Chaoui, H., & Saddik, A. E.
- Affiliations
- Carleton University (CA)
- Guangzhou University (CN)
- University of Ottawa (CA)
- Venue
- IEEE Transactions on Power Systems
- Published
- 2026-07
- Volume
- 41
- Issue
- 4
- Pages
- 2468-2481
- ISSN
- 0885-8950 (ISSN-L)
- 1558-0679
- OpenAlex
- W7134109945
- Semantic Scholar
- 844159afaa161641433a0f8c8d6c80652aa83bba
- Cited by
- 0
- References
- 31
- FWCI
- 0.00
- Type
- journal article
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Power Systems (publishedVersion)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Power System Optimization and Stability
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Frequency Control in Power Systems
- Physical Sciences › Engineering › Control and Systems Engineering › Microgrid Control and Optimization
- Keywords
- wide-area damping control, multimode oscillation, deep reinforcement learning, robust control, coordinated control, power system stability, online training
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
