The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Q-Learning-Based Vulnerability Analysis of Smart Grid Against Sequential Topology Attacks
Open accessAbstract
Recent studies on sequential attack schemes revealed new smart grid vulnerability that can be exploited by attacks on the network topology. Traditional power systems contingency analysis needs to be expanded to handle the complex risk of cyber-physical attacks. To analyze the transmission grid vulnerability under sequential topology attacks, this paper proposes a Q-learning-based approach to identify critical attack sequences with consideration of physical system behaviors. A realistic power flow cascading outage model is used to simulate the system behavior, where attacker can use the Q-learning to improve the damage of sequential topology attack toward system failures with the least attack efforts. Case studies based on three IEEE test systems have demonstrated the learning ability and effectiveness of Q-learning-based vulnerability analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Error and attack tolerance of complex networks
Albert, R., Jeong, H., & Barabási, A.-L. (2000) · Nature · doi:10.1038/35019019 · Cited by 7,534
Zimmerman, R. D., Murillo-Sanchez, C. E., & Thomas, R. J. (2011) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2010.2051168 · Cited by 6,756
Error and attack tolerance of complex networks
Albert, R., Jeong, H., & Barabási, A.-Ĺ. (2000) · RePEc: Research Papers in Economics · Cited by 6,469
Watkins, C. (1989) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.17863/cam.132164 · Cited by 5,297
False data injection attacks against state estimation in electric power grids
Liu, Y., Ning, P., & Reiter, M. K. (2011) · ACM Transactions on Information and System Security · doi:10.1145/1952982.1952995 · Cited by 2,428
Cyber–Physical System Security for the Electric Power Grid
Sridhar, S., Hahn, A., & Govindarasu, M. (2012) · Proceedings of the IEEE · doi:10.1109/jproc.2011.2165269 · Cited by 1,208
Cyber–Physical Security of a Smart Grid Infrastructure
Mo, Y., Kim, T. H.-J., Brancik, K., Dickinson, D., Lee, H., Perrig, A., & Sinopoli, B. (2012) · Proceedings of the IEEE · doi:10.1109/jproc.2011.2161428 · Cited by 1,096
Stott, B., Jardim, J., & Alsac, O. (2009) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2009.2021235 · Cited by 1,052
A Review of False Data Injection Attacks Against Modern Power Systems
Liang, G., Zhao, J., Luo, F., Weller, S. R., & Dong, Z. Y. (2017) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2015.2495133 · Cited by 1,028
Cited by
Review on the research and practice of deep learning and reinforcement learning in smart grids
China Electric Power Research Institute, Zhang, D., Han, X., Taiyuan University of Technology, Deng, C., & China Electric Power Research Institute (2018) · CSEE Journal of Power and Energy Systems · doi:10.17775/cseejpes.2018.00520 · Cited by 561
Applications of artificial intelligence for disaster management
Sun, W., Bocchini, P., & Davison, B. D. (2020) · Natural Hazards · doi:10.1007/s11069-020-04124-3 · Cited by 491
Cyber‐physical attacks and defences in the smart grid: a survey
He, H., & Yan, J. (2016) · IET Cyber-Physical Systems: Theory & Applications · doi:10.1049/iet-cps.2016.0019 · Cited by 454
Self-citationMachine learning driven smart electric power systems: Current trends and new perspectives
Ibrahim, M. S., Dong, W., & Yang, Q. (2020) · Applied Energy · doi:10.1016/j.apenergy.2020.115237 · Cited by 435
Adaptive Critic Nonlinear Robust Control: A Survey
Wang, D., He, H., & Liu, D. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2712188 · Cited by 374
Self-citationArtificial Intelligence Techniques in Smart Grid: A Survey
Omitaomu, O. A., & Niu, H. (2021) · Smart Cities · doi:10.3390/smartcities4020029 · Cited by 371
Artificial intelligence, cyber-threats and industry 4.0: challenges and opportunities
Bécue, A., Praça, I., & Gama, J. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-020-09942-2 · Cited by 368
Deep Reinforcement Learning for Internet of Things: A Comprehensive Survey
Chen, W., Qiu, X., Cai, T., Dai, H.-N., Zheng, Z., & Zhang, Y. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3073036 · Cited by 311
The ai-based cyber threat landscape: A survey
Kaloudi, N., & Li, J. (2021) · ACM Computing Surveys · doi:10.1145/3372823 · Cited by 310
“Moreover, a data-driven approach based on RL is proposed to identify the critical attack sequence against sequential topology attacks [87].”
MethodDeep learning for edge computing applications: A State-of-the-Art survey
Wang, F., Zhang, M., Wang, X., Ma, X., & Liu, J. (2020) · IEEE Access · doi:10.1109/access.2020.2982411 · Cited by 259
Glavic, M., Fonteneau, R., & Ernst, D. (2017) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2017.08.1217 · Cited by 241
Reinforcement learning for iot security: A comprehensive survey
Uprety, A., & Rawat, D. B. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3040957 · Cited by 214
Glavic, M. (2019) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2019.09.008 · Cited by 163
“Q-learning was proposed in [81] to analyze the transmission grid vulnerability under sequential topology attacks and identify critical attack sequences with consideration of physical system behaviors.”
BackgroundSecure Frequency Control of Hybrid Power System Under DoS Attacks via Lie Algebra
Cheng, Z., Yue, D., Shen, S., Hu, S., & Chen, L. (2022) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2022.3158550 · Cited by 54
Experience-Driven Attack Design and Federated-Learning-Based Intrusion Detection in Industry 4.0
Tahir, B., Jolfaei, A., & Tariq, M. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3133384 · Cited by 47
Cyber-Physical Zero Trust Architecture for Industrial Cyber-Physical Systems
Feng, X., & Hu, S. (2023) · IEEE Transactions on Industrial Cyber-Physical Systems · doi:10.1109/ticps.2023.3333850 · Cited by 45
Laszka, A., Abbas, W., Vorobeychik, Y., & Koutsoukos, X. (2020) · Cyber-Physical Systems · doi:10.1080/23335777.2019.1624620 · Cited by 22
“…we plan to address these challenges using novel techniques from the area of artificial intelligence: using deep learning to predict impact based on simulation results for a relatively low number of attacks, and using deep reinforcement learning to find optimal strategies for attackers [108–110].”
Method
Metadata
- Authors
- Yan, J., He, H., Zhong, X., & Tang, Y.
- Venue
- IEEE Transactions on Information Forensics and Security
- Published
- 2017-01
- Volume
- 12
- Issue
- 1
- Pages
- 200-210
- ISSN
- 1556-6013 (ISSN-L)
- 1556-6021
- OpenAlex
- W2513580371
- Cited by
- 264
- References
- 35
- FWCI
- 19.36
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.