Reinforcement learning for iot security: A comprehensive survey
Open accessAbstract
The number of connected smart devices has been increasing exponentially for different Internet-of-Things (IoT) applications. Security has been a long run challenge in the IoT systems which has many attack vectors, security flaws and vulnerabilities. Securing billions of connected devices in IoT is a must task to realize the full potential of IoT applications. Recently, researchers have proposed many security solutions for IoT. Machine learning has been proposed as one of the emerging solutions for IoT security and reinforcement learning (RL) is gaining more popularity for securing IoT systems. RL, unlike other machine learning techniques, can learn the environment by having minimum information about the parameters to be learned. It solves the optimization problem by interacting with the environment adapting the parameters on the fly. In this article, we present an comprehensive survey of different types of cyberattacks against different IoT systems and then we present RL and deep RL-based security solutions to combat those different types of attacks in different IoT systems. Furthermore, we present the RL for securing CPS systems (i.e., IoT with feedback and control), such as smart grid and smart transportation system. The recent important attacks and countermeasures using RL in IoT are also summarized in the form of tables. With this article, readers can have a more thorough understanding of IoT security attacks and countermeasures using RL, as well as research trends in this area.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Surveys [50,70,76] addressed ML-based trust evaluation in IoV focusing on the trust scheme.
“For example, the surveys in [50,70,76] addressed the use of ML-based trust evaluation in IoV focusing on the trust scheme.”
From Security and Trust Management in the Internet of Vehicles (IoV): Challenges and Machine Learning Solutions (2024) · cites this paper as [76]
It is challenging to protect IoT networks against malware attacks, eavesdropping, DoS attacks, and virus injection.
“As such, it is challenging to protect all these networks against malware attacks, eavesdropping, DoS attacks, and virus injection [76,130].”
From Security and Trust Management in the Internet of Vehicles (IoV): Challenges and Machine Learning Solutions (2024) · cites this paper as [76]
Despite its strengths, ML faces challenges such as failure in detection of attacks, wrongly classified objects, recognition of driver monitoring patterns, vehicle theft, and compromised functional safety.
“Despite its strengths, ML faces a range of challenges such as failure in the detection of attacks, wrongly classified objects, the recognition of driver monitoring patterns, vehicle theft, and compromised functional safety [57,76,171,172].”
From Security and Trust Management in the Internet of Vehicles (IoV): Challenges and Machine Learning Solutions (2024) · cites this paper as [76]
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357 · see citing works
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,263 · see citing works
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928 · see citing works
The Internet of Things: A survey
Atzori, L., Iera, A., & Morabito, G. (2010) · Computer Networks · doi:10.1016/j.comnet.2010.05.010 · Cited by 15,613 · see citing works
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612 · see citing works
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782 · see citing works
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · see citing works
Reinforcement Learning: An Introduction
Johnson, J. D., Li, J., & Chen, Z. (2000) · Neurocomputing · doi:10.1016/s0925-2312(00)00324-6 · Cited by 8,821 · see citing works
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132 · see citing works
Finite-time Analysis of the Multiarmed Bandit Problem
Auer, P., Cesa-Bianchi, N., & Fischer, P. (2002) · Machine Learning · doi:10.1023/a:1013689704352 · Cited by 6,033 · see citing works
A Survey of Data Mining and Machine Learning Methods for Cyber Security Intrusion Detection
Buczak, A. L., & Guven, E. (2016) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2015.2494502 · Cited by 3,332 · see citing works
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318 · see citing works
Dueling Network Architectures for Deep Reinforcement Learning
Wang, Z., Schaul, T., Hessel, M., van Hasselt, H., Lanctot, M., & de Freitas, N. (2015) · arXiv · doi:10.48550/arxiv.1511.06581 · Cited by 3,300 · see citing works
Anomaly-based network intrusion detection: Techniques, systems and challenges
García-Teodoro, P., Díaz-Verdejo, J., Maciá-Fernández, G., & Vázquez, E. (2009) · Computers & Security · doi:10.1016/j.cose.2008.08.003 · Cited by 2,085 · see citing works
Reinforcement learning and adaptive dynamic programming for feedback control
Lewis, F. L., & Vrabie, D. (2009) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2009.933854 · Cited by 1,569 · see citing works
Karagiannis, G., Altintas, O., Ekici, E., Heijenk, G., Jarupan, B., Lin, K., & Weil, T. (2011) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2011.061411.00019 · Cited by 1,529 · see citing works
Deep reinforcement learning for robotic manipulation with asynchronous off-policy updates
Gu, S., Holly, E., Lillicrap, T., & Levine, S. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989385 · Cited by 1,485 · see citing works
On the features and challenges of security and privacy in distributed internet of things
Román, R., Zhou, J., & López, J. (2013) · Computer Networks · doi:10.1016/j.comnet.2012.12.018 · Cited by 1,471 · see citing works
Understanding the mirai botnet
Antonakakis, M., April, T., Bailey, M., Bernhard, M., Bursztein, E., Cochran, J., Durumeric, Z., Halderman, J. A., Invernizzi, L., Kallitsis, M., et al. (2017) · USENIX Security Symposium · Cited by 1,362 · see citing works
Resource Management with Deep Reinforcement Learning
Mao, H., Alizadeh, M., Menache, I., & Kandula, S. (2016) · Proceedings of the 15th ACM Workshop on Hot Topics in Networks · doi:10.1145/3005745.3005750 · Cited by 1,353 · cited 1× · see citing works
“Researchers have proposed many DRL approaches with its application ranging from control [15], resource management [16], [17], robotics [18], [19] and many more.”
BackgroundAn Introduction to Deep Reinforcement Learning
François-Lavet, V., Henderson, P., Islam, R., Bellemare, M. G., & Pineau, J. (2018) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000071 · Cited by 1,353 · see citing works
Internet of Things security: A survey
Alaba, F. A., Othman, M., Hashem, M., & Alotaibi, F. A. (2017) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2017.04.002 · Cited by 1,348 · see citing works
Machine Learning and Deep Learning Methods for Cybersecurity
Xin, Y., Kong, L., Liu, Z., Chen, Y., Li, Y., Zhu, H., Gao, M., Hou, H., & Wang, C. (2018) · IEEE Access · doi:10.1109/access.2018.2836950 · Cited by 1,228 · see citing works
Recent Advances in Hierarchical Reinforcement Learning
Barto, A. G., & Mahadevan, S. (2003) · Discrete Event Dynamic Systems · doi:10.1023/a:1022140919877 · Cited by 1,043 · see citing works
A survey on security control and attack detection for industrial cyber-physical systems
Ding, D., Han, Q., Xiang, Y., Ge, X., & Zhang, X. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.10.009 · Cited by 947 · see citing works
Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstraction and Intrinsic MotivationPreprint
Kulkarni, T. D., Narasimhan, K., Saeedi, A., & Tenenbaum, J. B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.06057 · Cited by 895 · see citing works
A survey on software-defined network and openflow: From concept to implementation
Hu, F., Hao, Q., & Bao, K. (2014) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2014.2326417 · Cited by 752 · see citing works
Research on the architecture of Internet of Things
Wu, M., Lu, T., Ling, F.-Y., Sun, J., & Du, H. (2010) · International Conference on Advanced Computer Theory and Engineering · doi:10.1109/icacte.2010.5579493 · Cited by 695 · see citing works
IoT Security Techniques Based on Machine Learning: How Do IoT Devices Use AI to Enhance Security?
Xiao, L., Wan, X., Lu, X., Zhang, Y., & Wu, D. (2018) · IEEE Signal Processing Magazine · doi:10.1109/msp.2018.2825478 · Cited by 681 · see citing works
Deep reinforcement learning for cyber security
Nguyen, T. T., & Reddi, V. J. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3121870 · Cited by 620 · see citing works
Smart community: an internet of things application
Li, X., Lu, R., Liang, X., Shen, X., Chen, J., & Lin, X. (2011) · IEEE Communications Magazine · doi:10.1109/mcom.2011.6069711 · Cited by 586 · see citing works
A Survey of Deep Learning Methods for Cyber Security
Berman, D. S., Buczak, A. L., Chavis, J. S., & Corbett, C. L. (2019) · Information · doi:10.3390/info10040122 · Cited by 569 · see citing works
An introduction to deep reinforcement learning
François-Lavet, V., Henderson, P., Islam, R., Bellemare, M. G., & Pineau, J. (2018) · doi:10.1561/9781680835397 · Cited by 544 · see citing works
Internet of Things: Security vulnerabilities and challenges
Andrea, I., Chrysostomou, C., & Hadjichristofi, G. (2015) · 2015 IEEE Symposium on Computers and Communication (ISCC) · doi:10.1109/iscc.2015.7405513 · Cited by 520 · see citing works
Leveraging Demonstrations for Deep Reinforcement Learning on Robotics Problems with Sparse Rewards
Vecerik, M., Hester, T., Scholz, J., Wang, F., Pietquin, O., Piot, B., Heess, N., Rothörl, T., Lampe, T., & Riedmiller, M. (2017) · arXiv · doi:10.48550/arxiv.1707.08817 · Cited by 478 · see citing works
Khan, A. A., Rehmani, M. H., & Rachedi, A. (2017) · IEEE Wireless Communications · doi:10.1109/mwc.2017.1600404 · Cited by 461 · see citing works
Bayesian Inverse Reinforcement Learning
Krishnamurthy, V. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009449441.027 · Cited by 443 · see citing works
Data Mining and Machine Learning in Cybersecurity
Dua, S., & Du, X. (2011) · Auerbach Publications eBooks · doi:10.1201/b10867 · Cited by 392 · see citing works
Jamming and anti-jamming techniques in wireless networks: a survey
Grover, K., Lim, A., & Yang, Q. B. (2014) · International Journal of Ad Hoc and Ubiquitous Computing · doi:10.1504/ijahuc.2014.066419 · Cited by 384 · see citing works
Machine learning aided Android malware classification
Milošević, N., Dehghantanha, A., & Choo, K. R. (2017) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2017.02.013 · Cited by 351 · see citing works
An anti-jamming stochastic game for cognitive radio networks
Wang, B., Wu, Y., Liu, K. J. R., & Clancy, T. C. (2011) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2011.110418 · Cited by 318 · see citing works
Recent Advances in Hierarchical Reinforcement Learning
Barto, A. G., & Mahadevan, S. (2003) · Discrete Event Dynamic Systems · doi:10.1023/a:1025696116075 · Cited by 317 · see citing works
UAV Relay in VANETs Against Smart Jamming With Reinforcement Learning
Xiao, L., Lu, X., Xu, D., Tang, Y., Wang, L., & Zhuang, W. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2789466 · Cited by 298 · see citing works
PHY-Layer Spoofing Detection With Reinforcement Learning in Wireless Networks
Xiao, L., Li, Y., Han, G., Liu, G., & Zhuang, W. (2016) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2016.2524258 · Cited by 296 · see citing works
Internet of Things (IoT): Taxonomy of security attacks
Nawir, M., Amir, A., Yaakob, N., & Lynn, O. B. (2016) · International Conference on Electronic Design · doi:10.1109/iced.2016.7804660 · Cited by 294 · see citing works
Q-Learning-Based Vulnerability Analysis of Smart Grid Against Sequential Topology Attacks
Yan, J., He, H., Zhong, X., & Tang, Y. (2016) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2016.2607701 · Cited by 264 · see citing works
Online Cyber-Attack Detection in Smart Grid: A Reinforcement Learning Approach
Kurt, M. N., Ogundijo, O., Li, C., & Wang, X. (2018) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2878570 · Cited by 263 · see citing works
The Internet of Things: a security point of view
Li, S., Tryfonas, T., & Li, H. (2016) · Internet Research · doi:10.1108/intr-07-2014-0173 · Cited by 263 · see citing works
Anti-Jamming Communications Using Spectrum Waterfall: A Deep Reinforcement Learning Approach
Liu, X., Xu, Y., Jia, L., Wu, Q., & Anpalagan, A. (2018) · IEEE Communications Letters · doi:10.1109/lcomm.2018.2815018 · Cited by 262 · see citing works
Olowononi, F. O., Rawat, D. B., & Liu, C. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3036778 · Cited by 250 · see citing works
Self-citationAnti-Jamming Games in Multi-Channel Cognitive Radio Networks
Wu, Y., Wang, B., Liu, K. J. R., & Clancy, T. C. (2012) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2012.120102 · Cited by 242 · see citing works
Yau, D. K. Y., Lui, J. C. S., Liang, F., & Yam, Y. (2005) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2004.842221 · Cited by 238 · see citing works
Detecting cyber-physical attacks in CyberManufacturing systems with machine learning methods
Wu, M., Song, Z., & Moon, Y. B. (2019) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-017-1315-5 · Cited by 238 · see citing works
Evaluation of Reinforcement Learning-Based False Data Injection Attack to Automatic Voltage Control
Chen, Y., Huang, S., Liu, F., Wang, Z., & Sun, X. (2018) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2790704 · Cited by 229 · see citing works
Two-dimensional anti-jamming communication based on deep reinforcement learning
Han, G., Xiao, L., & Poor, H. V. (2017) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2017.7952524 · Cited by 223 · see citing works
Learning-Based Privacy-Aware Offloading for Healthcare IoT With Energy Harvesting
Min, M., Wan, X., Xiao, L., Chen, Y., Xia, M., Wu, D., & Dai, H. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2875926 · Cited by 213 · see citing works
A Multistage Game in Smart Grid Security: A Reinforcement Learning Solution
Ni, Z., & Paul, S. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2885530 · Cited by 212 · see citing works
Adversarial environment reinforcement learning algorithm for intrusion detection
Caminero, G., Lopez-Martin, M., & Carro, B. (2019) · Comput. Networks · doi:10.1016/j.comnet.2019.05.013 · Cited by 199 · see citing works
Defending against path-based DoS attacks in wireless sensor networks
Deng, J. W., Han, R. Y., & Mishra, S. (2005) · doi:10.1145/1102219.1102235 · Cited by 187 · see citing works
User-Centric View of Unmanned Aerial Vehicle Transmission Against Smart Attacks
Xiao, L., Xie, C., Min, M., & Zhuang, W. (2017) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2017.2785414 · Cited by 166 · see citing works
Wormhole-Based Antijamming Techniques in Sensor Networks
Čagalj, M., Čapkun, S., & Hubaux, J. (2006) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2007.250674 · Cited by 160 · see citing works
Guidelines for smart grid cybersecurity
(2014) · doi:10.6028/nist.ir.7628r1 · Cited by 160 · see citing works
Deep reinforcement learning approaches for process control
Spielberg, S. P. K., Gopaluni, R. B., & Loewen, P. D. (2017) · International Symposium on Advanced Control of Industrial Processes · doi:10.1109/adconip.2017.7983780 · Cited by 154 · see citing works
Richard Bellman on the Birth of Dynamic Programming
Dreyfus, S. E. (2002) · Operations Research · doi:10.1287/opre.50.1.48.17791 · Cited by 147 · see citing works
Architecting the Internet of Things: State of the Art
Abdmeziem, M. R., Tandjaoui, D., & Romdhani, I. (2015) · Studies in systems, decision and control · doi:10.1007/978-3-319-22168-7_3 · Cited by 137 · see citing works
Loch, J., & Singh, S. P. (1998) · Cited by 133 · see citing works
Intelligent Cloud Resource Management with Deep Reinforcement Learning
Zhang, Y., Yao, J., & Guan, H. (2017) · IEEE Cloud Computing · doi:10.1109/mcc.2018.1081063 · Cited by 127 · see citing works
Multi-Agent Reinforcement Learning Based Cognitive Anti-Jamming
Aref, M. A., Jayaweera, S. K., & Machuzak, S. (2017) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc.2017.7925694 · Cited by 124 · see citing works
Wormhole-based anti-jamming techniques in sensor networks
Cagalj, M., Čapkun, S., & Hubaux, J. (2007) · Cited by 122 · see citing works
Study on the IOT Architecture and Gateway Technology
Zhong, C., Zhu, Z., & Huang, R.-G. (2015) · International Symposium on Distributed Computing and Applications for Business Engineering and Science (DCABES) · doi:10.1109/dcabes.2015.56 · Cited by 117 · see citing works
Reinforcement Learning in Continuous Action Spaces through Sequential Monte Carlo Methods
Lazaric, A., Restelli, M., & Bonarini, A. (2007) · Cited by 116 · see citing works
Salameh, H. B., Almajali, S., Ayyash, M., & Elgala, H. (2018) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2817339 · Cited by 111 · see citing works
Controlling IP Spoofing through Interdomain Packet Filters
Duan, Z., Yuan, X., & Chandrashekar, J. (2008) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2007.70224 · Cited by 110 · see citing works
Wang, Y., Ye, Z., Wan, P., & Zhao, J. (2018) · Artificial Intelligence Review · doi:10.1007/s10462-018-9639-x · Cited by 106 · see citing works
Classification of RFID Attacks
Mitrokotsa, A., Rieback, M. R., & Tanenbaum, A. S. (2008) · doi:10.5220/0001738800730086 · Cited by 101 · see citing works
Jamming in the Internet of Things: A Game-Theoretic Perspective
Namvar, N., Saad, W., Bahadori, N., & Kelley, B. (2016) · Globecom · doi:10.1109/glocom.2016.7841922 · Cited by 91 · see citing works
A Survey on Applications of Model-Free Strategy Learning in Cognitive Wireless Networks
Wang, W., Kwasinski, A., Niyato, D. T., & Han, Z. (2016) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2016.2539923 · Cited by 90 · see citing works
Robust physical layer authentication using inherent properties of channel impulse response
Liu, F. J., Wang, X., & Tang, H. (2011) · IEEE Military Communications Conference (MILCOM) · doi:10.1109/milcom.2011.6127727 · Cited by 87 · see citing works
Anti-Jamming Underwater Transmission With Mobility and Learning
Xiao, L., Donghua, Jiang, Wan, X., Su, W., & Tang, Y. (2018) · IEEE Communications Letters · doi:10.1109/lcomm.2018.2792015 · Cited by 82 · see citing works
Security of ultra-lightweight RFID authentication protocols and its improvements
Chien, H., & Huang, C. (2007) · ACM SIGOPS Operating Systems Review · doi:10.1145/1278901.1278916 · Cited by 78 · see citing works
Distributed response to network intrusions using multiagent reinforcement learning
Malialis, K., & Kudenko⋆, D. (2015) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2015.01.013 · Cited by 76 · see citing works
Security in Intelligent Transport Systems for Smart Cities: From Theory to Practice
Javed, M. A., Hamida, E. B., & Znaïdi, W. (2016) · Sensors · doi:10.3390/s16060879 · Cited by 74 · see citing works
Deep Reinforcement Learning based Smart Mitigation of DDoS Flooding in Software-Defined Networks
Liu, Y., Dong, M., Ota, K., Li, J., & Wu, J. (2018) · IEEE International Workshop on Computer Aided Modeling and Design of Communication Links and Networks (CAMAD) · doi:10.1109/camad.2018.8514971 · Cited by 71 · see citing works
Vehicular Cyber Physical Systems
Rawat, D. B., & Bajracharya, C. (2016) · Springer eBooks · doi:10.1007/978-3-319-44494-9 · Cited by 70 · see citing works
Self-citationJamming mitigation in cognitive radio networks
Pietro, R. D., & Oligeri, G. (2013) · IEEE Network · doi:10.1109/mnet.2013.6523802 · Cited by 67 · see citing works
Reinforcement learning based anti-jamming with wideband autonomous cognitive radios
Machuzak, S., & Jayaweera, S. K. (2016) · IEEE/CIC International Conference on Communications in China (ICCC) · doi:10.1109/iccchina.2016.7636793 · Cited by 62 · see citing works
Alanazi, S., Al-Muhtadi, J. F., Derhab, A., Saleem, K., AlRomi, A. N., Alholaibah, H. S., & Rodrigues, J. J. P. C. (2015) · IEEE International Conference on e-Health Networking, Applications and Services (Healthcom) · doi:10.1109/healthcom.2015.7454499 · Cited by 57 · see citing works
A Loss-Free Multipathing Solution for Data Center Network Using Software-Defined Networking Approach
Fang, S., Yu, Y., Foh, C. H., & Aung, K. M. M. (2013) · IEEE Transactions on Magnetics · doi:10.1109/tmag.2013.2254703 · Cited by 55 · see citing works
A survey on bad data injection attack in smart grid
Wang, D., Guan, X., Liu, T., Gu, Y., Sun, Y., & Liu, Y. (2013) · Asia-Pacific Power and Energy Engineering Conference (APPEEC) · doi:10.1109/appeec.2013.6837157 · Cited by 54 · see citing works
DQN-Based Power Control for IoT Transmission against Jamming
Chen, Y., Li, Y., Xu, D., & Xiao, L. (2018) · IEEE Vehicular Technology Conference · doi:10.1109/vtcspring.2018.8417695 · Cited by 51 · see citing works
Application of reinforcement learning for security enhancement in cognitive radio networks
Ling, M. H., Yau, K. A., Qadir, J., Poh, G. S., & Ni, Q. (2015) · Applied Soft Computing · doi:10.1016/j.asoc.2015.09.017 · Cited by 50 · see citing works
Bkassiny, M., Jayaweera, S. K., Li, Y., & Avery, K. A. (2012) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2012.051512.111504 · Cited by 50 · see citing works
Anti-Jamming Communication Game for UAV-Aided VANETs
Lu, X., Xu, D., Xiao, L., Wang, L., & Zhuang, W. (2017) · Globecom · doi:10.1109/glocom.2017.8253987 · Cited by 50 · see citing works
Li, Y., Wang, X., Liu, D., Guo, Q., Liu, X., Zhang, J., & Xu, Y. (2019) · Applied Sciences · doi:10.3390/app9071361 · Cited by 40 · see citing works
Machine Learning for Cyber Defense and Attack
Rege, M., & Mbah, R. B. K. (2018) · Cited by 38 · see citing works
Rawat, D. B., Alsabet, R., Bajracharya, C., & Song, M. (2018) · Computer Networks · doi:10.1016/j.comnet.2018.03.015 · Cited by 31 · see citing works
Self-citationThe sequential attack against power grid networks
Zhu, Y., Yan, J., Tang, Y., Sun, Y. L., & He, H. (2014) · International Conference on Communications · doi:10.1109/icc.2014.6883387 · Cited by 30 · see citing works
A Comprehensive Analysis of Spoofing
Ramesh, P., Bhaskari, D. L., & -, C. S. (2010) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2010.010623 · Cited by 29 · see citing works
Power control with jammer location uncertainty: A Game Theoretic perspective
El-Bardan, R., Brahma, S. K., & Varshney, P. K. (2014) · Conference on Information Sciences and Systems · doi:10.1109/ciss.2014.6814091 · Cited by 27 · see citing works
Channel hopping scheme to mitigate jamming attacks in wireless LANs
Djuraev, S., Choi, J., Sohn, K.-S., & Nam, S. Y. (2017) · EURASIP Journal on Wireless Communications and Networking · doi:10.1186/s13638-016-0785-z · Cited by 26 · see citing works
Towards Trustworthy Identity and Access Management for the Future Internet
Weber, S., Martucci, L. A., Mühlhäuser, M., & Ries, S. (2010) · TUbilio (Technical University of Darmstadt) · Cited by 23 · see citing works
Smart Transportation System: A Review of Security and Privacy Issues
Alsaffar, N., Ali, H., & Elmedany, W. M. (2018) · International Conference on Innovation and Intelligence for Informatics, Computing, and Technologies (3ICT) · doi:10.1109/3ict.2018.8855737 · Cited by 23 · see citing works
Dodge-Jam: Anti-Jamming Technique for Low-Power and Lossy Wireless Networks
Heo, J., Kim, J., Bahk, S., & Paek, J. (2017) · IEEE International Conference on Sensing, Communication, and Networking (SECON) · doi:10.1109/sahcn.2017.7964926 · Cited by 23 · see citing works
Active authentication with reinforcement learning based on ambient radio signals
Liu, J., Xiao, L., Liu, G., & Zhao, Y. (2015) · Multimedia Tools and Applications · doi:10.1007/s11042-015-2958-x · Cited by 20 · see citing works
An IRL Approach for Cyber-Physical Attack Intention Prediction and Recovery
Elnaggar, M. M., & Bezzo, N. (2018) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc.2018.8430922 · Cited by 19 · see citing works
Multiagent Router Throttling: Decentralized Coordinated Response Against DDoS Attacks
Malialis, K., & Kudenko⋆, D. (2013) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v27i2.19000 · Cited by 18 · see citing works
Anti-Jamming V2V Communication in an Integrated UAV-CAV Network with Hybrid Attackers
Feng, S., & Haykin, S. (2019) · International Conference on Communications · doi:10.1109/icc.2019.8761101 · Cited by 17 · see citing works
A short review on Applications of Deep learning for Cyber securityPreprint
Mohammed Harun Babu, R., Vinayakumar, R., & Soman, K. P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.06292 · Cited by 17 · see citing works
Reachability-based self-triggered scheduling and replanning of UAV operations
Yel, E., Lin, T. X., & Bezzo, N. (2017) · NASA/ESA Conference on Adaptive Hardware and Systems (AHS) · doi:10.1109/ahs.2017.8046382 · Cited by 15 · see citing works
Applying Reinforcement Learning and Supervised Learning Techniques to Play Hearthstone
Kachalsky, I., Zakirzyanov, I., & Игоревич, У. В. (2017) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2017.00016 · Cited by 15 · see citing works
Predicting Malicious Intention in CPS under Cyber-Attack
Bezzo, N. (2018) · ACM/IEEE International Conference on Cyber-Physical Systems (ICCPS) · doi:10.1109/iccps.2018.00049 · Cited by 11 · see citing works
Review of jamming attack using game theory
Bhoyar, D. G., & Yadav, U. (2017) · International Conference on Innovations in Information, Embedded and Communication Systems · doi:10.1109/iciiecs.2017.8276173 · Cited by 11 · see citing works
Open source and the Internet of Things
Mansfield-Devine, S. (2018) · Network Security · doi:10.1016/s1353-4858(18)30016-3 · Cited by 11 · see citing works
Learning-Based Rogue Edge Detection in VANETs with Ambient Radio Signals
Xiao, L., Zhuang, W., Zhou, S., & Chen, C. (2018) · Wireless networks · doi:10.1007/978-3-030-01731-6_2 · Cited by 10 · see citing works
Securing space communication systems against reactive cognitive jammer
Rawat, D. B., & Song, M. (2015) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc.2015.7127678 · Cited by 10 · see citing works
Self-citationCognitive Radio Anti-Jamming Scheme for Security Provisioning IoT Communications
Kim, S. (2015) · KSII Transactions on Internet and Information Systems · doi:10.3837/tiis.2015.10.023 · Cited by 8 · see citing works
Dynamic Beamforming Optimization for Anti - Jamming and Hardware Fault Recovery
Becker, J. M. (2014) · KiltHub Repository · doi:10.1184/r1/6716114 · Cited by 6 · see citing works
Flagged first, then by citations
7 of the 124 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Machine Learning (ML) in Medicine: Review, Applications, and Challenges
Rahmani, A. M., Yousefpoor, E., Yousefpoor, M. S., Mehmood, Z., Haider, A., Hosseinzadeh, M., & Naqvi, R. A. (2021) · Mathematics · doi:10.3390/math9222970 · Cited by 275 · see citing works
Ozkan-Okay, M., Akin, E., Aslan, Ö., Koşunalp, S., Iliev, T. B., Stoyanov, I. S., & Beloev, I. H. (2024) · IEEE Access · doi:10.1109/access.2024.3355547 · Cited by 287 · see citing works
A Systematic Study on Reinforcement Learning Based Applications
Sivamayilvelan, K., Rajasekar, E., Aljafari, B., Nikolovski, S., Subramaniyaswamy, V., & Indragandhi, V. (2023) · Energies · doi:10.3390/en16031512 · Cited by 165 · see citing works
A Review of Anomaly Detection Strategies to Detect Threats to Cyber-Physical Systems
Jeffrey, N., Tan, Q., & Villar, J. R. (2023) · Electronics · doi:10.3390/electronics12153283 · Cited by 160 · see citing works
Host-based IDS: A review and open issues of an anomaly detection system in IoT
Martins, I., Resende, J. S., Sousa, P. R., Silva, S., Antunes, L. F., & da Gama, J. M. P. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.03.001 · Cited by 145 · see citing works
A Comprehensive Survey on Imputation of Missing Data in Internet of Things
Adhikari, D., Jiang, W., Zhan, J., He, Z., Rawat, D. B., Aickelin, U., & Khorshidi, H. A. (2022) · ACM Computing Surveys · doi:10.1145/3533381 · Cited by 143 · see citing works
Self-citationCherbal, S., Zier, A., Hebal, S., Louail, L., & Annane, B. (2024) · The Journal of Supercomputing · doi:10.1007/s11227-023-05616-2 · Cited by 152 · see citing works
Abdelmoumin, G., Rawat, D. B., & Rahman, A. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3103829 · Cited by 128 · see citing works
Self-citationAlalwany, E., & Mahgoub, I. (2024) · Sensors · doi:10.3390/s24020368 · Cited by 130 · see citing works
MalBoT-DRL: Malware Botnet Detection Using Deep Reinforcement Learning in IoT Networks
Al-Fawa’reh, M., Abu-Khalaf, J., Szewczyk, P., & Kang, J. J. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3324053 · Cited by 110 · see citing works
Deep Reinforcement Learning in the Advanced Cybersecurity Threat Detection and Protection
Sewak, M., Sahay, S. K., & Rathore, H. (2022) · Information Systems Frontiers · doi:10.1007/s10796-022-10333-x · Cited by 116 · see citing works
Vivek Menon, U., Kumaravelu, V. B., Vinoth Kumar, C., Rammohan, A., Chinnadurai, S., Venkatesan, R., Hai, H., & Selvaprabhu, P. (2025) · IEEE Access · doi:10.1109/access.2025.3551750 · Cited by 120 · see citing works
Kabir, H., Tham, M., & Chang, Y. C. (2023) · Digital Communications and Networks · doi:10.1016/j.dcan.2023.05.006 · Cited by 119 · see citing works
Reinforcement Learning for feedback-enabled cyber resilience
Huang, Y., Huang, L., & Zhu, Q. (2022) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2022.01.001 · Cited by 97 · see citing works
A Survey on Neural Network Hardware Accelerators
Mohaidat, T., & Khalil, K. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2024.3377147 · Cited by 97 · see citing works
Rupanetti, D., & Kaabouch, N. (2024) · Applied Sciences · doi:10.3390/app14167104 · Cited by 102 · see citing works
Reinforcement Learning-Based Routing Protocols in Flying Ad Hoc Networks (FANET): A Review
Lánský, J., Ali, S., Rahmani, A. M., Yousefpoor, M. S., Yousefpoor, E., Khan, F. N., & Hosseinzadeh, M. (2022) · Mathematics · doi:10.3390/math10163017 · Cited by 94 · see citing works
Salau, B. A., Rawal, A., & Rawat, D. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3170449 · Cited by 79 · see citing works
Self-citationShen, S., Wu, X., Sun, P. J., Zhou, H., Wu, Z., & Yu, S. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120192 · Cited by 74 · see citing works
Yang, N., Chen, S., Zhang, H., & Berry, R. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3405075 · Cited by 77 · see citing works
Recent advances in anomaly detection in Internet of Things: Status, challenges, and perspectives
Adhikari, D., Jiang, W., Zhan, J., Rawat, D. B., & Bhattarai, A. (2024) · Computer Science Review · doi:10.1016/j.cosrev.2024.100665 · Cited by 80 · see citing works
Self-citationMachine Learning for Industry 4.0: A Systematic Review Using Deep Learning-Based Topic Modelling
Mazzei, D., & Ramjattan, R. (2022) · Sensors · doi:10.3390/s22228641 · Cited by 69 · see citing works
Abdellatif, A. A., Mhaisen, N., Mohamed, A. M. S., Erbad, A., & Guizani, M. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3288050 · Cited by 73 · see citing works
Mahamat, M., Jaber, G., & Bouabdallah, A. (2022) · Wireless Networks · doi:10.1007/s11276-022-03170-y · Cited by 65 · see citing works
Bothra, P., Karmakar, R., Bhattacharya, S., & De, S. (2023) · Computer Networks · doi:10.1016/j.comnet.2023.109634 · Cited by 65 · see citing works
Retracted: A DQN-Based Frame Aggregation and Task Offloading Approach for Edge-Enabled IoMT
Yuan, X., Zhang, Z., Feng, C., Cui, Y., Garg, S., Kaddoum, G., & Yu, K. (2022) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2022.3218313 · Cited by 57 · see citing works
RetractedNeurosymbolic Reinforcement Learning and Planning: A Survey
Acharya, K., Raza, W., Dourado, C. M. J. D. M., Velasquez, A., & Song, H. (2023) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2023.3311428 · Cited by 60 · see citing works
Zhu, R., Wu, S., Li, L., Lv, P., & Xu, M. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3167029 · Cited by 56 · see citing works
Hashmi, E., Yamin, M. M., & Yayilgan, S. Y. (2024) · AI and Ethics · doi:10.1007/s43681-024-00529-z · Cited by 68 · see citing works
A Cross-Layer Survey on Secure and Low-Latency Communications in Next-Generation IoT
Martalò, M., Pettorru, G., & Atzori, L. (2024) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2024.3390543 · Cited by 51 · see citing works
Adil, M., Farouk, A., Abulkasim, H., Ali, A., Song, H. H., & Jin, Z. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3486659 · Cited by 48 · see citing works
Wang, H., Di, X., Wang, Y., Ren, B., Gao, G., & Deng, J. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2023.3310091 · Cited by 43 · see citing works
Study of Machine Learning for Cloud Assisted IoT Security as a Service
Alsharif, M., & Rawat, D. B. (2021) · Sensors · doi:10.3390/s21041034 · Cited by 36 · see citing works
Self-citationZhang, Z., Guo, Z., Zheng, H., Li, Z., & Yuan, P. F. (2024) · Automation in Construction · doi:10.1016/j.autcon.2024.105702 · Cited by 35 · see citing works
Dual Network Computation Offloading Based on DRL for Satellite-Terrestrial Integrated Networks
Li, D., Sun, Y., Peng, J., Cheng, S., Yin, Z., Cheng, N., Liu, J., Li, Z., & Xu, C. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3493388 · Cited by 34 · see citing works
New challenges in reinforcement learning: a survey of security and privacy
Lei, Y., Ye, D., Shen, S., Sui, Y., Zhu, T., & Zhou, W. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10348-5 · Cited by 32 · see citing works
Adversarial learning techniques for security and privacy preservation: A comprehensive review
Hathaliya, J. J., Tanwar, S., & Sharma, P. (2022) · Security and Privacy · doi:10.1002/spy2.209 · Cited by 30 · see citing works
Privacy-preserving security of IoT networks: A comparative analysis of methods and applications
Wakili, A., & Bakkali, S. (2025) · Cyber Security and Applications · doi:10.1016/j.csa.2025.100084 · Cited by 30 · see citing works
Exploring the Confluence of IoT and Metaverse: Future Opportunities and Challenges
Asif, R., & Hassan, S. R. (2023) · IoT · doi:10.3390/iot4030018 · Cited by 29 · see citing works
Musaddiq, A., Olsson, T., & Ahlgren, F. (2023) · Sensors · doi:10.3390/s23198263 · Cited by 34 · see citing works
Resiliency Metrics for Monitoring and Analysis of Cyber-Power Distribution System With IoTs
Sarker, P. S., Sadanandan, S. K., & Srivastava, A. K. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3183180 · Cited by 30 · see citing works
Multi-type task offloading for wireless Internet of Things by federated deep reinforcement learning
Tong, Z., Wang, J., Mei, J., Li, K., Li, W., & Li, K. (2023) · Future Generation Computer Systems · doi:10.1016/j.future.2023.04.004 · Cited by 29 · see citing works
Learning Near-Optimal Intrusion Responses Against Dynamic Attackers
Hammar, K., & Stadler, R. (2023) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2023.3293413 · Cited by 32 · see citing works
A Survey of Using Machine Learning in IoT Security and the Challenges Faced by Researchers
Harahsheh, K., & Chen, C. (2023) · Informatica · doi:10.31449/inf.v47i6.4635 · Cited by 38 · see citing works
A Comprehensive Analysis of Machine Learning and Deep Learning Approaches towards IoT Security
Desanamukula, V. S., Priyadarshini, M. A., Srilatha, D., Rao, K. V., Kumari, R. V. S. L., & Vivek, K. (2023) · International Conference on Electronics and Sustainable Communication Systems (ICESC) · doi:10.1109/icesc57686.2023.10193209 · Cited by 32 · see citing works
Hassan, A., Nizam‐Uddin, N., Quddus, A., Hassan, S. R., Rehman, A. U., & Bharany, S. (2024) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2024.057877 · Cited by 28 · see citing works
Distributed Cyber-infrastructures and Artificial Intelligence in Hybrid Post-Quantum Era
Yavuz, A. A., Nouma, S. E., Hoang, T., Earl, D., & Packard, S. (2022) · IEEE International Conference on Trust, Privacy and Security in Intelligent Systems and Applications (TPS-ISA) · doi:10.1109/tps-isa56441.2022.00014 · Cited by 30 · see citing works
Multi-Agent Reinforcement Learning for Cybersecurity: Classification and survey
Finistrella, S., Mariani, S., & Zambonelli, F. (2025) · Intelligent Systems with Applications · doi:10.1016/j.iswa.2025.200495 · Cited by 26 · see citing works
Strategic Honeypot Deployment in Ultra-Dense Beyond 5G Networks: A Reinforcement Learning Approach
Grammatikis, P. I. R., Sarigiannidis, P. G., Diamantoulakis, P. D., Λάγκας, Θ., Saoulidis, T., Fountoukidis, E., & Karagiannidis, G. K. (2022) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2022.3184112 · Cited by 25 · see citing works
Reinforcement Learning for Intelligent Healthcare Systems: A Comprehensive SurveyPreprint
Abdellatif, A. A., Mhaisen, N., Chkirbene, Z., Mohamed, A. M. S., Erbad, A., & Guizani, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.04087 · Cited by 37 · see citing works
Hafid, A., Rahouti, M., & Aledhari, M. (2025) · Mathematics · doi:10.3390/math13101574 · Cited by 23 · see citing works
Sultana, R., Grover, J., & Tripathi, M. (2024) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2024.101962 · Cited by 23 · see citing works
A novel reinforcement learning-based hybrid intrusion detection system on fog-to-cloud computing
Najafli, S., Haghighat, A. T., & Karasfi, B. (2024) · The Journal of Supercomputing · doi:10.1007/s11227-024-06417-x · Cited by 21 · see citing works
Reinforcement Learning-Based Device Scheduling for Renewable Energy-Powered Federated Learning
Cui, Y., Cao, K., & Wei, T. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3210008 · Cited by 21 · see citing works
Deep Semantic Communication for Knowledge Sharing in Internet of Vehicles
Wang, Z., Leng, S., Zhang, H., & Yuen, C. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3531910 · Cited by 20 · see citing works
Asynchronous Advantage Actor-Critic (A3C) Learning for Cognitive Network Security
Muhati, E., & Rawat, D. B. (2021) · IEEE International Conference on Trust, Privacy and Security in Intelligent Systems and Applications (TPS-ISA) · doi:10.1109/tpsisa52974.2021.00012 · Cited by 20 · see citing works
Self-citationParihar, V., Malik, A., Bhawna, Bhushan, B., & Chaganti, R. (2023) · Engineering cyber-physical systems and critical infrastructures · doi:10.1007/978-3-031-31952-5_1 · Cited by 20 · see citing works
Azimjonov, J., & Kim, T. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3415499 · Cited by 19 · see citing works
A Deep Deterministic Policy Gradient Learning Approach to Missile Autopilot Design
Candeli, A., Tommasi, G. D., Lui, D. G., Mele, A., Santini, S., & Tartaglione, G. (2022) · IEEE Access · doi:10.1109/access.2022.3150926 · Cited by 20 · see citing works
Detection of DDoS attack in IoT traffic using ensemble machine learning techniques
Pandey, N., & Mishra, P. K. (2023) · Networks and Heterogeneous Media · doi:10.3934/nhm.2023061 · Cited by 19 · see citing works
Security defense strategy algorithm for Internet of Things based on deep reinforcement learning
Feng, X., Han, J., Zhang, R., Xu, S., & Xia, H. (2023) · High-Confidence Computing · doi:10.1016/j.hcc.2023.100167 · Cited by 19 · see citing works
Reinforcement Learning Applications in Cyber Security: A Review
CENGİZ, E., & Gök, M. (2023) · Sakarya University Journal of Science · doi:10.16984/saufenbilder.1237742 · Cited by 18 · see citing works
Multiagent Cooperative Caching Policy in Industrial Internet of Things
Zhen, Y., Chen, W., Zheng, L., Li, X., & Mu, D. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3164447 · Cited by 17 · see citing works
Deep Reinforcement Learning Approach for Cyberattack Detection
Tareq, I., Elbagoury, B. M., El-Regaily, S. A., & El-Horbaty, E.-S. M. (2024) · International Journal of Online and Biomedical Engineering (iJOE) · doi:10.3991/ijoe.v20i05.48229 · Cited by 17 · see citing works
Scalable Intrusion Detection in IoT Networks Via Property Testing and Federated Edge AI
Reis, M. J. C. S. (2025) · IEEE Access · doi:10.1109/access.2025.3603937 · Cited by 16 · see citing works
An evolutionary computation-based machine learning for network attack detection in big data traffic
Wang, Y., Zhang, H., Wei, Y., Wang, H., Peng, Y. L., Bin, Z., & Li, W. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110184 · Cited by 16 · see citing works
Giacomoni, L., & Parisis, G. (2024) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom52122.2024.10621288 · Cited by 16 · see citing works
Sonavane, S. M., Prashantha, G. R., Nikam, P. D., Mayuri, A. V. R., Chauhan, J., Sountharrajan, S., & Bavirisetti, D. P. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e24224 · Cited by 16 · see citing works
Bakhshad, S., Ponnusamy, V., Annur, R., Waqasyz, M., Alasmary, H., & Tux, S. (2022) · International Conference on Computer, Information and Telecommunication Systems · doi:10.1109/cits55221.2022.9832976 · Cited by 15 · see citing works
Ayoub, I., Balakrichenan, S., Khawam, K., & Ampeau, B. (2023) · Sensors · doi:10.3390/s23094473 · Cited by 15 · see citing works
Recent Reinforcement Learning and Blockchain Based Security Solutions for Internet of Things: Survey
Gasmi, R., Hammoudi, S., Lamri, M., & Harous, S. (2023) · Wireless Personal Communications · doi:10.1007/s11277-023-10664-1 · Cited by 14 · see citing works
A Survey on Verification of Security and Safety in IoT Systems
Abuserrieh, L., & Alalfi, M. H. (2024) · IEEE Access · doi:10.1109/access.2024.3413071 · Cited by 14 · see citing works
Secure State Estimation of Cyber-Physical System under Cyber Attacks: Q-Learning vs. SARSA
Jin, Z., Ma, M., Zhang, S., Hu, Y., Zhang, Y., & Sun, C. (2022) · Electronics · doi:10.3390/electronics11193161 · Cited by 14 · see citing works
Machine learning approaches for active queue management: A survey, taxonomy, and future directions
Toopchinezhad, M. P., & Ahmadi, M. (2025) · Computer Networks · doi:10.1016/j.comnet.2025.111174 · Cited by 14 · see citing works
Li, Y., Hu, H., Liu, W., & Yang, X. (2023) · Electronics · doi:10.3390/electronics12071598 · Cited by 13 · see citing works
Heterogeneous IoT (HetIoT) security: techniques, challenges and open issues
Mahadik, S. S., Pawar, P. M., & Muthalagu, R. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-16715-w · Cited by 13 · see citing works
Smart Jamming for Secrecy: Deep Reinforcement Learning Enabled Secure Visible Light Communication
Liu, S., Liu, X., Du, X., & Guizani, M. (2024) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2024.3458046 · Cited by 12 · see citing works
Jamshidi, S., Amirnia, A., Nikanjam, A., Nafi, K. W., Khomh, F., & Keivanpour, S. (2025) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2025.104176 · Cited by 13 · see citing works
Owusu, E., Danlard, I., Opoku, G., Dede, A., Klogo, G. S., Boateng, K. O., & Akowuah, E. K. (2025) · Security and Privacy · doi:10.1002/spy2.70147 · Cited by 12 · see citing works
Hemashree, P., Kavitha, V., Mahalakshmi, S. B., Praveena, K., & Tarunika, R. (2024) · Signals and communication technology · doi:10.1007/978-3-031-49593-9_7 · Cited by 12 · see citing works
Feasibility discussion of quantum cryptography for Internet of Things security: a literature review
Yang, Y., Lin, Y., Xiao, J., & Zhong, Z. (2025) · Optical and Quantum Electronics · doi:10.1007/s11082-025-08168-2 · Cited by 11 · see citing works
Razaque, A., Hariri, S., Alajlan, A. M., & Yoo, J. (2025) · Computer Science Review · doi:10.1016/j.cosrev.2025.100789 · Cited by 11 · see citing works
The Power of MEME: Adversarial Malware Creation with Model-Based Reinforcement Learning
Rigaki, M., & García, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-51482-1_3 · Cited by 10 · see citing works
Fan, J., Shar, L. K., Zhang, R., Liu, Z., Yang, W., Niyato, D. T., & Lam, K.-Y. (2026) · IEEE Internet of Things Journal · doi:10.1109/jiot.2026.3653434 · Cited by 26 · see citing works
TSGS: Two-stage security game solution based on deep reinforcement learning for Internet of Things
Feng, X., Xia, H., Xu, S., Xu, L., & Zhang, R. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120965 · Cited by 10 · see citing works
Towards Secure IoMT: Attack Detection Using Deep Q-Learning in Healthcare Networks
Daher, L. A. (2023) · International Conference on Developments in eSystems Engineering (DeSE) · doi:10.1109/dese60595.2023.10468942 · Cited by 9 · see citing works
Data-Based Q-Learning for Replay Attack Detection in Cyber-Physical Systems
Qin, J., Zhang, Z., & Zhao, H. (2025) · IEEE Transactions on Industrial Cyber-Physical Systems · doi:10.1109/ticps.2025.3532881 · Cited by 9 · see citing works
Prediction and Detection of Cyberattacks using AI Model in Virtualized Wireless Networks
Sapavath, N. N., Muhati, E., & Rawat, D. B. (2021) · IEEE International Conference on Cyber Security and Cloud Computing / IEEE International Conference on Edge Computing and Scalable Cloud (CSCloud/EdgeCom) · doi:10.1109/cscloud-edgecom52276.2021.00027 · Cited by 9 · see citing works
Self-citationRayNet: A Simulation Platform for Developing Reinforcement Learning-Driven Network Protocols
Giacomoni, L., Benny, B., & Parisis, G. (2024) · ACM Transactions on Modeling and Computer Simulation · doi:10.1145/3653975 · Cited by 10 · see citing works
Iturbe, E., Rego, A., Llorente-Vazquez, O., Rios, E., Dalamagkas, C., Merkouris, D., & Toledo, N. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129168 · Cited by 13 · see citing works
CyberForce: A Federated Reinforcement Learning Framework for Malware Mitigation
Feng, C., Celdrán, A. H., Sánchez, P. M. S., Kreischer, J., von der Assen, J., Bovet, G., Pérez, G. M., & Stiller, B. (2025) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2025.3547005 · Cited by 8 · see citing works
A Taxonomy of AI Techniques for Security and Privacy in Cyber–Physical Systems
Bandi, A. (2024) · Journal of Computational and Cognitive Engineering · doi:10.47852/bonviewjcce42021539 · Cited by 8 · see citing works
Leveraging AI and Blockchain for Enhanced IoT Cybersecurity
Reshi, I. A., & Sholla, S. (2024) · Blockchain technologies · doi:10.1007/978-981-97-1249-6_14 · Cited by 7 · see citing works
Solution of IoT Security and Privacy Challenges: A Systematic Literature Review
Alsafran, J., Elmedany, W. M., & Sharif, M. S. (2024) · Arab ICT Conference (AICTC) · doi:10.1109/aictc58357.2024.10735034 · Cited by 7 · see citing works
Maghanaki, M., Keramati, S., Chen, F. F., & Shahin, M. (2026) · Journal of Manufacturing Science and Engineering · doi:10.1115/1.4071232 · Cited by 7 · see citing works
Machine Learning Algorithms and IoT Sensors for Securing the Networks
Sridevi, & Kolhar, A. (2025) · IGI Global eBooks · doi:10.4018/979-8-3693-7758-1.ch009 · Cited by 7 · see citing works
Ma, S., Alkhaleefah, M., Chang, Y.-L., Chuah, J. H., Chang, W., Ku, C.-S., Wu, M.-C., & Chang, L. (2022) · Sensors · doi:10.3390/s22072695 · Cited by 7 · see citing works
Zolfaghari, B., & Koshiba, T. (2022) · Applied System Innovation · doi:10.3390/asi5040075 · Cited by 7 · see citing works
Security Challenges and Solutions in IoT
Hajla, S. E., Ennaji, E. M., Maleh, Y., & Mounir, S. (2024) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-7540-2.ch002 · Cited by 6 · see citing works
An Overview of Q‐Learning and Deep Q‐Learning for an Autonomous Multi‐ UAV Wireless Network
Sharma, V. C., & Roy, S. (2025) · Expert Systems · doi:10.1111/exsy.70143 · Cited by 6 · see citing works
- Authors
- Uprety, A., & Rawat, D. B.
- Affiliations
- Howard University (US)
- Venue
- IEEE Internet of Things Journal
- Published
- 2021-06-01
- Volume
- 8
- Issue
- 11
- Pages
- 8693-8706
- ISSN
- 2327-4662 (ISSN-L)
- 2372-2541
- OpenAlex
- W3108669277
- Cited by
- 214
- References
- 124
- Citations by year
- 2026: 28 · 2025: 47 · 2024: 42 · 2023: 52 · 2022: 31 · 2021: 14
- FWCI
- 11.40
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Internet of Things Journal (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- U.S. NSF (CNS/SaTC 2039583, CNS 1650831, 1828811)
- DoD Center of Excellence in AI and Machine Learning at Howard University (W911NF-20-2-0277)
- U.S. Army Research Laboratory
- DoE’s National Nuclear Security Administration (DE-NA0003946)
- U.S. Department of Homeland Security (2017-ST-062-000003)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Network Security and Intrusion Detection
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Information Systems › Internet of Things and AI
- Keywords
- Internet of Things security, reinforcement learning, deep reinforcement learning, attack countermeasures, cyber-physical security, smart grid, smart transportation, IoT vulnerabilities
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review