The DOI matches its Crossref record; 190 of the 190 references it cites were found in a registry or an index.
Applications of Deep Reinforcement Learning in Communications and Networking: A Survey
Abstract
This paper presents a comprehensive literature review on applications of deep reinforcement learning (DRL) in communications and networking. Modern networks, e.g., Internet of Things (IoT) and unmanned aerial vehicle (UAV) networks, become more decentralized and autonomous. In such networks, network entities need to make decisions locally to maximize the network performance under uncertainty of network environment. Reinforcement learning has been efficiently used to enable the network entities to obtain the optimal policy including, e.g., decisions or actions, given their states when the state and action spaces are small. However, in complex and large-scale networks, the state and action spaces are usually large, and the reinforcement learning may not be able to find the optimal policy in reasonable time. Therefore, DRL, a combination of reinforcement learning with deep learning, has been developed to overcome the shortcomings. In this survey, we first give a tutorial of DRL from fundamental concepts to advanced models. Then, we review DRL approaches proposed to address emerging issues in communications and networking. The issues include dynamic network access, data rate control, wireless caching, data offloading, network security, and connectivity preservation which are all important to next generation networks, such as 5G and beyond. Furthermore, we present applications of DRL for traffic routing, resource sharing, and data collection. Finally, we highlight important challenges, open issues, and future research directions of applying DRL.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
(1995) · Cited by 10,558
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Markov decision processes: Discrete stochastic dynamic programming
Hazeghi, K., & Puterman, M. L. (1995) · Journal of the American Statistical Association · doi:10.2307/2291177 · Cited by 8,037
Training feedforward networks with the Marquardt algorithm
Hagan, M. T., & Menhaj, M. B. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.329697 · Cited by 7,701
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Research works printed but not linked: 18
- bellemare, 2017, A distributional perspective on reinforcement learning, Proc Int Conf Mach Learn, 449
- wang, 2018, Handover control optimization via asynchronous multi-user deep reinforcement learning, Proc IEEE ICC, 1
- 10.1002/9780470400531.eorms0118 · DOI
- balazinska, 2003, IBM Watson Research Center
- 10.1109/MNET.2018.1800085 · doi:10.1109/mnet.2018.1800085
- zhao, 2018, Deep reinforcement learning for network slicing, arXiv preprint arXiv 1805 06591, 1
- 2016, Google Achieves Ai “Breakthrough” by Beating Go Champion
- bellman, 2013, Dynamic Programming
- govindan, 0, Tutornet A Low Power Wireless IoT Testbed
- wang, 2017, Deep reinforcement learning for dynamic multichannel access, Proc Int Conf Comput Netw Commun (ICNC), 599
- 2016, Measuring Fixed Broadband Report
- lillicrap, 2016, Continuous control with deep reinforcement learning, CoRR, abs 1509 2971, 1
- 0, Tyouku of China Network Video Index
- bai, 2018, Deep learning based fast multiuser detection for massive machine-type communication, arXiv preprint arXiv 1807 00967, 1
- 10.1587/transcom.2017NRP0014 · doi:10.1587/transcom.2017nrp0014
- goodfellow, 2016, Deep Learning
- chen, 2017, Machine learning for wireless networks with artificial intelligence: A tutorial on neural networks, arXiv preprint arXiv 1710 02913, 1
- lowe, 2017, Multi-agent actor-critic for mixed cooperative-competitive environments, Proc Adv Neural Inf Process Syst, 6379
Cited by
Federated Learning in Mobile Edge Networks: A Comprehensive Survey
Lim, W. Y. B., Luong, N. C., Hoang, D. T., Jiao, Y., Liang, Y.-C., Yang, Q., Niyato, D., & Miao, C. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2986024 · Cited by 2,565
Self-citationOn the Road to 6G: Visions, Requirements, Key Technologies, and Testbeds
Wang, C.-X., You, X., Gao, X., Zhu, X., Li, Z., Zhang, C., Wang, H., Huang, Y., Chen, Y., Haas, H., et al. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3249835 · Cited by 2,336
The Roadmap to 6G: AI Empowered Wireless Networks
Letaief, K. B., Chen, W., Shi, Y., Zhang, J., & Zhang, Y.-J. A. (2019) · IEEE Communications Magazine · doi:10.1109/mcom.2019.1900271 · Cited by 2,207
Reconfigurable Intelligent Surfaces: Principles and Opportunities
Liu, Y., Liu, X., Mu, X., Hou, T., Xu, J., Di Renzo, M., & Al-Dhahir, N. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3077737 · Cited by 1,847
Deep Learning in Mobile and Wireless Networking: A Survey
Zhang, C., Patras, P., & Haddadi, H. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2904897 · Cited by 1,768
Satellite Communications in the New Space Era: A Survey and Future Challenges
Kodheli, O., Lagunas, E., Maturo, N., Sharma, S. K., Shankar, B., Montoya, J. F. M., Duncan, J. C. M., Spano, D., Chatzinotas, S., Kisseleff, S., et al. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3028247 · Cited by 1,524
Artificial Neural Networks-Based Machine Learning for Wireless Networks: A Tutorial
Chen, M., Challita, U., Saad, W., Yin, C., & Debbah, M. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2926625 · Cited by 1,117
Toward Smart Wireless Communications via Intelligent Reflecting Surfaces: A Contemporary Survey
Gong, S., Lu, X., Hoang, D. T., Niyato, D., Shu, L., Kim, D. I., & Liang, Y.-C. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3004197 · Cited by 1,035
Self-citationMulti-agent deep reinforcement learning: a survey
Gronauer, S., & Diepold, K. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-09996-w · Cited by 957
Huang, C., Mo, R., & Yuen, C. (2020) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3000835 · Cited by 938
Pham, Q.-V., Fang, F., Ha, V. N., Piran, M. J., Le, M., Le, L. B., Hwang, W.-J., & Ding, Z. (2020) · IEEE Access · doi:10.1109/access.2020.3001277 · Cited by 870
Edge artificial intelligence for 6g: vision, enabling technologies, and applications
Letaief, K. B., Shi, Y., Lu, J., & Lu, J. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126076 · Cited by 829
“In 5G, the superior performance has been achieved by leveraging the AI capability into RAN [289], [290].”
BackgroundSurvey on 6G Frontiers: Trends, Applications, Requirements, Technologies and Future Research
Alwis, C. D., Kalla, A., Pham, Q.-V., Kumar, P., Dev, K., Hwang, W.-J., & Liyanage, M. (2021) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2021.3071496 · Cited by 788
Multi-Agent Deep Reinforcement Learning for Dynamic Power Allocation in Wireless Networks
Nasir, Y. S., & Guo, D. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2933973 · Cited by 660
Himeur, Y., Ghanem, K., Alsalemi, A., Bensaali, F., & Amira, A. (2021) · Applied Energy · doi:10.1016/j.apenergy.2021.116601 · Cited by 660
Xu, W., Yang, Z., Ng, D. W. K., Levorato, M., Eldar, Y. C., & Debbah, M. (2023) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2023.3239189 · Cited by 660
Quantum Machine Learning for 6G Communication Networks: State-of-the-Art and Vision for the Future
Nawaz, S. J., Sharma, S. K., Wyne, S., Patwary, M. N., & Asaduzzaman, M. (2019) · IEEE Access · doi:10.1109/access.2019.2909490 · Cited by 658
Reinforcement learning algorithms: A brief survey
Shakya, A. K., Pillai, G., & Chakrabarty, S. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120495 · Cited by 656
Alahi, M. E. E., Sukkuea, A., Tina, F. W., Nag, A., Kurdthongmee, W., Suwannarat, K., & Mukhopadhyay, S. C. (2023) · Sensors · doi:10.3390/s23115206 · Cited by 646
Deep reinforcement learning for cyber security
Nguyen, T. T., & Reddi, V. J. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3121870 · Cited by 620
Javed, A. R., Shahzad, F., Rehman, S. U., Zikria, Y. B., Razzak, I., Jalil, Z., & Xu, G. (2022) · Cities · doi:10.1016/j.cities.2022.103794 · Cited by 606
Evolution of NOMA Toward Next Generation Multiple Access (NGMA) for 6G
Liu, Y., Zhang, S., Mu, X., Ding, Z., Schober, R., Al-Dhahir, N., Hossain, E., & Shen, X. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3145234 · Cited by 595
6G Wireless Communications Networks: A Comprehensive Survey
Alsabah, M., Naser, M. A., Mahmmod, B. M., Abdulhussain, S. H., Eissa, M. R., Al-Baidhani, A., Noordin, N. K., Sait, S. M., Al-Utaibi, K. A., & Hashim, F. (2021) · IEEE Access · doi:10.1109/access.2021.3124812 · Cited by 575
Distributed Learning in Wireless Networks: Recent Progress and Future Challenges
Chen, M., Gunduz, D., Huang, K., Saad, W., Bennis, M., Feljan, A. V., & Poor, H. V. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118346 · Cited by 548
A Vision and Framework for the High Altitude Platform Station (HAPS) Networks of the Future
Karabulut Kurt, G., Khoshkholgh, M. G., Alfattani, S., Ibrahim, A., Darwish, T. S. J., Alam, M. S., Yanikomeroglu, H., & Yongacoglu, A. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3066905 · Cited by 538
A Review of Deep Reinforcement Learning for Smart Building Energy Management
Yu, L., Qin, S., Zhang, M., Shen, C., Jiang, T., & Guan, X. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3078462 · Cited by 476
Multi-Hop RIS-Empowered Terahertz Communications: A DRL-Based Hybrid Beamforming Design
Huang, C., Yang, Z., Alexandropoulos, G. C., Xiong, K., Wei, L., Yuen, C., Zhang, Z., & Debbah, M. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3071836 · Cited by 430
A Survey of Recent Advances in Edge-Computing-Powered Artificial Intelligence of Things
Chang, Z., Liu, S., Xiong, X., Cai, Z., & Tu, G. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3088875 · Cited by 418
Deep learning: systematic review, models, challenges, and research directions
Talaei Khoei, T., Ould Slimane, H., & Kaabouch, N. (2023) · Neural Computing and Applications · doi:10.1007/s00521-023-08957-4 · Cited by 411
Single and multi-agent deep reinforcement learning for AI-enabled wireless networks: A tutorial
Feriani, A., & Hossain, E. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3063822 · Cited by 410
A Survey of Rate-Optimal Power Domain NOMA With Enabling Technologies of Future Wireless Networks
Maraqa, O., Rajasekaran, A. S., Al-Ahmadi, S., Yanikomeroglu, H., & Sait, S. M. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3013514 · Cited by 406
She, C., Sun, C., Gu, Z., Li, Y., Yang, C., Poor, H. V., & Vucetic, B. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3053601 · Cited by 405
Alsharif, M. H., Kelechi, A. H., Albreem, M. A., Chaudhry, S. A., Zia, M. S., & Kim, S. (2020) · Symmetry · doi:10.3390/sym12040676 · Cited by 360
A Survey on Machine-Learning Techniques for UAV-Based Communications
Bithas, P. S., Michailidis, E. T., Nomikos, N., Vouyioukas, D., & Kanatas, A. G. (2019) · Sensors · doi:10.3390/s19235170 · Cited by 353
Deep Reinforcement Learning for Energy-Efficient Computation Offloading in Mobile-Edge Computing
Zhou, H., Jiang, K., Liu, X., Li, X., & Leung, V. C. M. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3091142 · Cited by 350
Federated Learning in Edge Computing: A Systematic Survey
Abreha, H. G., Hayajneh, M., & Serhani, M. A. (2022) · Sensors · doi:10.3390/s22020450 · Cited by 342
Mahbooba, B., Timilsina, M., Sahal, R., & Serrano, M. (2021) · Complexity · doi:10.1155/2021/6634811 · Cited by 327
Deep reinforcement learning in smart manufacturing: A review and prospects
Li, C., Zheng, P., Yin, Y., Wang, B., & Wang, L. (2023) · CIRP Journal of Manufacturing Science and Technology · doi:10.1016/j.cirpj.2022.11.003 · Cited by 327
Digital Twin of Wireless Systems: Overview, Taxonomy, Challenges, and Opportunities
Khan, L. U., Han, Z., Saad, W., Hossain, E., Guizani, M., & Hong, C. S. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3198273 · Cited by 322
Deep-Reinforcement Learning Multiple Access for Heterogeneous Wireless Networks
Yu, Y., Wang, T., & Liew, S. C. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2904329 · Cited by 319
Khalil, R. A., Saeed, N., Masood, M., Fard, Y. M., Alouini, M.-S., & Al-Naffouri, T. Y. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3051414 · Cited by 318
Deep Reinforcement Learning for Internet of Things: A Comprehensive Survey
Chen, W., Qiu, X., Cai, T., Dai, H.-N., Zheng, Z., & Zhang, Y. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3073036 · Cited by 311
Distributed Control and Communication Strategies in Networked Microgrids
Zhou, Q., Shahidehpour, M., Paaso, A., Bahramirad, S., Alabdulwahab, A., & Abusorrah, A. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3023963 · Cited by 307
Yao, Y., Zhao, J., Li, Z., Cheng, X., & Wu, L. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3236788 · Cited by 306
Deep Reinforcement Learning for Autonomous Internet of Things: Model, Applications and Challenges
Lei, L., Tan, Y., Zheng, K., Liu, S., Zhang, K., & Shen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2988367 · Cited by 298
Deep learning for hybrid 5G services in mobile edge computing systems: learn from a digital twin
Dong, R., She, C., Hardjawana, W., Li, Y., & Vucetic, B. (2019) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2927312 · Cited by 295
Toward Autonomous Multi-UAV Wireless Network: A Survey of Reinforcement Learning-Based Approaches
Bai, Y., Zhao, H., Zhang, X., Chang, Z., Jäntti, R., & Yang, K. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3323344 · Cited by 295
Edge Computing for Internet of Everything: A Survey
Kong, X., Wu, Y., Wang, H., & Xia, F. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3200431 · Cited by 290
Deep Reinforcement Learning for Mobile 5G and Beyond: Fundamentals, Applications, and Challenges
Xiong, Z., Zhang, Y., Niyato, D., Deng, R., Wang, P., & Wang, L.-C. (2019) · IEEE Vehicular Technology Magazine · doi:10.1109/mvt.2019.2903655 · Cited by 285
Self-citationDeep reinforcement learning in production systems: a systematic literature review
Panzer, M., & Bender, B. (2022) · International Journal of Production Research · doi:10.1080/00207543.2021.1973138 · Cited by 282
Lopez-Perez, D., De Domenico, A., Piovesan, N., Xinli, G., Bao, H., Qitao, S., & Debbah, M. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3142532 · Cited by 282
Fusion of Federated Learning and Industrial Internet of Things: A survey
Boobalan, P., Ramu, S. P., Pham, Q.-V., Dev, K., Pandya, S., Maddikunta, P. K. R., Gadekallu, T. R., & Huynh-The, T. (2022) · Computer Networks · doi:10.1016/j.comnet.2022.109048 · Cited by 280
Qadir, Z., Ullah, F., Munawar, H. S., & Al-Turjman, F. (2021) · Computer Communications · doi:10.1016/j.comcom.2021.01.003 · Cited by 280
Zeng, Y., Xu, X., Jin, S., & Zhang, R. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3056573 · Cited by 264
Survey on Aerial Radio Access Networks: Toward a Comprehensive 6G Access Infrastructure
Dao, N.-N., Pham, Q.-V., Tu, N. H., Thanh, T. T., Bao, V. N. Q., Lakew, D. S., & Cho, S. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3059644 · Cited by 262
Path-Planning for Unmanned Aerial Vehicles with Environment Complexity Considerations: A Survey
Jones, M., Djahel, S., & Welsh, K. (2023) · ACM Computing Surveys · doi:10.1145/3570723 · Cited by 258
A Gentle Introduction to Reinforcement Learning and its Application in Different Fields
Naeem, M., Rizvi, S. T. H., & Coronato, A. (2020) · IEEE Access · doi:10.1109/access.2020.3038605 · Cited by 257
Open, Programmable, and Virtualized 5G Networks: State-of-the-Art and the Road Ahead
Bonati, L., Polese, M., D’Oro, S., Basagni, S., & Melodia, T. (2020) · Computer Networks · doi:10.1016/j.comnet.2020.107516 · Cited by 254
Du, H., Zhang, R., Liu, Y., Wang, J., Lin, Y., Li, Z., Niyato, D., Kang, J., Xiong, Z., Cui, S., et al. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3400011 · Cited by 254
Self-citationRIS-Aided Cell-Free Massive MIMO Systems for 6G: Fundamentals, System Design, and Applications
Shi, E., Zhang, J., Du, H., Ai, B., Yuen, C., Niyato, D., Letaief, K. B., & Shen, X. (2024) · Proceedings of the IEEE · doi:10.1109/jproc.2024.3404491 · Cited by 224
Self-citationMahmood, M. R., Matin, M. A., Sarigiannidis, P., & Goudos, S. K. (2022) · IEEE Access · doi:10.1109/access.2022.3199689 · Cited by 209
Challenges and Countermeasures for Adversarial Attacks on Deep Reinforcement Learning
Ilahi, I., Usama, M., Qadir, J., Janjua, M. U., Al-Fuqaha, A., Hoang, D. T., & Niyato, D. (2022) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2021.3111139 · Cited by 170
Self-citationEnabling AI in Future Wireless Networks: A Data Life Cycle Perspective
Nguyen, D. C., Cheng, P., Ding, M., Lopez-Perez, D., Pathirana, P. N., Li, J., Seneviratne, A., Li, Y., & Poor, H. V. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3024783 · Cited by 160
6G Communication Technology: A Vision on Intelligent Healthcare
Nayak, S., & Patgiri, R. (2021) · Studies in Computational Intelligence · doi:10.1007/978-981-15-9735-0_1 · Cited by 143
“deep neural networks algorithms and combines the advantages of both [37].”
BackgroundDrones’ Edge Intelligence Over Smart Environments in B5G: Blockchain and Federated Learning Synergy
Alsamhi, S. H., Almalki, F. A., Afghah, F., Hawbani, A., Shvetsov, A. V., Lee, B., & Song, H. (2022) · IEEE Transactions on Green Communications and Networking · doi:10.1109/tgcn.2021.3132561 · Cited by 139
Zeb, S., Mahmood, A., Hassan, S. A., Piran, M. J., Gidlund, M., & Guizani, M. (2022) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2021.103309 · Cited by 132
Agarwal, B., Togou, M. A., Ruffini, M., & Muntean, G.-M. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3207967 · Cited by 123
A Deep Actor-Critic Reinforcement Learning Framework for Dynamic Multichannel Access
Zhong, C., Lu, Z., Gursoy, M. C., & Velipasalar, S. (2019) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2019.2952909 · Cited by 123
“As summarized in [18] and [19], deep reinforcement learning algorithms have been applied in various wireless settings.”
BackgroundMachine Learning for Security in Vehicular Networks: A Comprehensive Survey
Talpur, A., & Gurusamy, M. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3129079 · Cited by 107
Machine learning in NextG networks via generative adversarial networks
Ayanoglu, E., Davaslioglu, K., & Sagduyu, Y. E. (2022) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2022.3153004 · Cited by 55
Distributed Q-Learning Aided Uplink Grant-Free NOMA for Massive Machine-Type Communications
Liu, J., Shi, Z., Zhang, S., & Kato, N. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3078496 · Cited by 53
Towards Learning-automation IoT Attack Detection through Reinforcement Learning
Gu, T., Abhishek, A., Fu, H., Zhang, H., Basu, D., & Mohapatra, P. (2020) · 2020 IEEE 21st International Symposium on "A World of Wireless, Mobile and Multimedia Networks" (WoWMoM) · doi:10.1109/wowmom49955.2020.00029 · Cited by 50
Toward Smart Security Enhancement of Federated Learning Networks
Tan, J., Liang, Y.-C., Luong, N. C., & Niyato, D. (2021) · IEEE Network · doi:10.1109/mnet.011.2000379 · Cited by 42
Self-citationEmploying Intelligent Aerial Data Aggregators for the Internet of Things: Challenges and Solutions
Li, K., Ni, W., Noor, A., & Guizani, M. (2022) · IEEE Internet of Things Magazine · doi:10.1109/iotm.001.2100161 · Cited by 11
Kim, D., Castellanos, M. R., & Heath, R. W. (2024) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2024.3397615 · Cited by 8
Self-citationCurrent and future RL’s contribution to emerging network security
Feltus, C. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.10.071 · Cited by 6
Artificial Intelligence for Dynamic Spectrum Management
Liang, Y.-C. (2020) · Signals and Communication Technology · doi:10.1007/978-981-15-0776-2_6 · Cited by 5
Self-citation
Metadata
- Authors
- Luong, N. C., Hoang, D. T., Gong, S., Niyato, D., Wang, P., Liang, Y.-C., & Kim, D. I.
- Venue
- IEEE Communications Surveys & Tutorials
- Published
- 2019
- Volume
- 21
- Issue
- 4
- Pages
- 3133-3174
- ISSN
- 1553-877X (ISSN-L)
- 2373-745X
- OpenAlex
- W2898035736
- Cited by
- 2,060
- References
- 190
- FWCI
- 104.64
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Funders
- A*STAR-NTU-SUTD Joint Research Grant Call on Artificial Intelligence for the Future of Manufacturing (RGANS1906)
- WASP/NTU (M4082187 (4080))
- Ministry of Education - Singapore (2017-T1-002-007 RG122/17)
- MOE Tier 2 (MOE2014-T2-2-015 ARC4/15)
- Singapore (NRF2015-NRF-ISF001-2277)
- Singapore EMA Energy Resilience (NRF2017EWT-EP003-041)
- National Research Foundation of Korea
- Ministry of Science, ICT and Future Planning (2014R1A5A1011478, 2017R1A2B2003953)
- National Natural Science Foundation of China (61631005, U1801261, 61571100, 61601449)
- Shenzhen Talent Peacock Plan Program (KQTD2015071715073798)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.