The DOI matches its Crossref record; 117 of the 124 references it cites were found in a registry or an index.
Reinforcement Learning for IoT Security: A Comprehensive Survey
Open accessAbstract
The number of connected smart devices has been increasing exponentially for different Internet-of-Things (IoT) applications. Security has been a long run challenge in the IoT systems which has many attack vectors, security flaws and vulnerabilities. Securing billions of connected devices in IoT is a must task to realize the full potential of IoT applications. Recently, researchers have proposed many security solutions for IoT. Machine learning has been proposed as one of the emerging solutions for IoT security and reinforcement learning (RL) is gaining more popularity for securing IoT systems. RL, unlike other machine learning techniques, can learn the environment by having minimum information about the parameters to be learned. It solves the optimization problem by interacting with the environment adapting the parameters on the fly. In this article, we present an comprehensive survey of different types of cyberattacks against different IoT systems and then we present RL and deep RL-based security solutions to combat those different types of attacks in different IoT systems. Furthermore, we present the RL for securing CPS systems (i.e., IoT with feedback and control), such as smart grid and smart transportation system. The recent important attacks and countermeasures using RL in IoT are also summarized in the form of tables. With this article, readers can have a more thorough understanding of IoT security attacks and countermeasures using RL, as well as research trends in this area.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, the surveys in [50,70,76] addressed the use of ML-based trust evaluation in IoV focusing on the trust scheme.”
From Security and Trust Management in the Internet of Vehicles (IoV): Challenges and Machine Learning Solutions (2024) · cites this paper as [76]
In the citing paper
“As such, it is challenging to protect all these networks against malware attacks, eavesdropping, DoS attacks, and virus injection [76,130].”
From Security and Trust Management in the Internet of Vehicles (IoV): Challenges and Machine Learning Solutions (2024) · cites this paper as [76]
In the citing paper
“Despite its strengths, ML faces a range of challenges such as failure in the detection of attacks, wrongly classified objects, the recognition of driver monitoring patterns, vehicle theft, and compromised functional safety [57,76,171,172].”
From Security and Trust Management in the Internet of Vehicles (IoV): Challenges and Machine Learning Solutions (2024) · cites this paper as [76]
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
The Internet of Things: A survey
Atzori, L., Iera, A., & Morabito, G. (2010) · Computer Networks · doi:10.1016/j.comnet.2010.05.010 · Cited by 15,613
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Reinforcement Learning: An Introduction
Johnson, J. D., Li, J., & Chen, Z. (2000) · Neurocomputing · doi:10.1016/s0925-2312(00)00324-6 · Cited by 8,825
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Finite-time Analysis of the Multiarmed Bandit Problem
Auer, P., Cesa-Bianchi, N., & Fischer, P. (2002) · Machine Learning · doi:10.1023/a:1013689704352 · Cited by 6,033
Research works printed but not linked: 6
- biswas, 2018, Intrusion detection using machine learning: A comparison study, Int J Pure Appl Math, 118, 101
- sonar, 2014, A survey: DDoS attack on Internet of Things, Int J Eng Research & Development, 10, 58
- finkenzeller, 2009, Known attacks on RFID systems, possible countermeasures and upcoming standardisation activities, Proc 5th Eur Workshop RFID Syst Technol, 1
- woolf, 2016, DDoS attack that disrupted internet was largest of its kind in history experts say
- whalen, 2001, An Introduction to ARP Spoofing
- weng, 2018, The Multi-Armed Bandit Problem and Its Solutions
Cited by
Sorted by citations
Machine Learning (ML) in Medicine: Review, Applications, and Challenges
Rahmani, A. M., Yousefpoor, E., Yousefpoor, M. S., Mehmood, Z., Haider, A., Hosseinzadeh, M., & Naqvi, R. A. (2021) · Mathematics · doi:10.3390/math9222970 · Cited by 289
Ozkan-Okay, M., Akin, E., Aslan, Ö., Koşunalp, S., Iliev, T. B., Stoyanov, I. S., & Beloev, I. H. (2024) · IEEE Access · doi:10.1109/access.2024.3355547 · Cited by 318
A Systematic Study on Reinforcement Learning Based Applications
Sivamayilvelan, K., Rajasekar, E., Aljafari, B., Nikolovski, S., Subramaniyaswamy, V., & Indragandhi, V. (2023) · Energies · doi:10.3390/en16031512 · Cited by 197
A Review of Anomaly Detection Strategies to Detect Threats to Cyber-Physical Systems
Jeffrey, N., Tan, Q., & Villar, J. R. (2023) · Electronics · doi:10.3390/electronics12153283 · Cited by 160
Host-based IDS: A review and open issues of an anomaly detection system in IoT
Martins, I., Resende, J. S., Sousa, P. R., Silva, S., Antunes, L. F., & da Gama, J. M. P. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.03.001 · Cited by 145
Metadata
- Authors
- Uprety, A., & Rawat, D. B.
- Affiliations
- Howard University (US)
- Venue
- IEEE Internet of Things Journal
- Published
- 2021-06-01
- Volume
- 8
- Issue
- 11
- Pages
- 8693-8706
- ISSN
- 2327-4662 (ISSN-L)
- 2372-2541
- OpenAlex
- W3108669277
- Cited by
- 214
- References
- 124
- Citations by year
- 2026: 28 · 2025: 47 · 2024: 42 · 2023: 52 · 2022: 31 · 2021: 14
- FWCI
- 11.40
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Internet of Things Journal (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- U.S. NSF (CNS/SaTC 2039583, CNS 1650831, 1828811)
- DoD Center of Excellence in AI and Machine Learning at Howard University (W911NF-20-2-0277)
- U.S. Army Research Laboratory
- DoE’s National Nuclear Security Administration (DE-NA0003946)
- U.S. Department of Homeland Security (2017-ST-062-000003)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Network Security and Intrusion Detection
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Information Systems › Internet of Things and AI
- Keywords
- Internet of Things security, reinforcement learning, deep reinforcement learning, attack countermeasures, cyber-physical security, smart grid, smart transportation, IoT vulnerabilities
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
