The DOI matches its Crossref record; 190 of the 190 references it cites were found in a registry or an index.
Applications of Deep Reinforcement Learning in Communications and Networking: A Survey
Abstract
This paper presents a comprehensive literature review on applications of deep reinforcement learning (DRL) in communications and networking. Modern networks, e.g., Internet of Things (IoT) and unmanned aerial vehicle (UAV) networks, become more decentralized and autonomous. In such networks, network entities need to make decisions locally to maximize the network performance under uncertainty of network environment. Reinforcement learning has been efficiently used to enable the network entities to obtain the optimal policy including, e.g., decisions or actions, given their states when the state and action spaces are small. However, in complex and large-scale networks, the state and action spaces are usually large, and the reinforcement learning may not be able to find the optimal policy in reasonable time. Therefore, DRL, a combination of reinforcement learning with deep learning, has been developed to overcome the shortcomings. In this survey, we first give a tutorial of DRL from fundamental concepts to advanced models. Then, we review DRL approaches proposed to address emerging issues in communications and networking. The issues include dynamic network access, data rate control, wireless caching, data offloading, network security, and connectivity preservation which are all important to next generation networks, such as 5G and beyond. Furthermore, we present applications of DRL for traffic routing, resource sharing, and data collection. Finally, we highlight important challenges, open issues, and future research directions of applying DRL.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
(1995) · Cited by 10,558
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Markov decision processes: Discrete stochastic dynamic programming
Hazeghi, K., & Puterman, M. L. (1995) · Journal of the American Statistical Association · doi:10.2307/2291177 · Cited by 8,037
Training feedforward networks with the Marquardt algorithm
Hagan, M. T., & Menhaj, M. B. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.329697 · Cited by 7,701
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Long-term recurrent convolutional networks for visual recognition and description
Donahue, J., Hendricks, L. A., Guadarrama, S., Rohrbach, M., Venugopalan, S., Darrell, T., & Saenko, K. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298878 · Cited by 5,228
(1999) · Cited by 5,147
Greedy layer-wise training of deep networks
Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0024 · Cited by 4,841
Deep Reinforcement Learning: A Brief Survey
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2743240 · Cited by 4,733
A Brief Survey of Deep Reinforcement Learning
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · arXiv · doi:10.48550/arxiv.1708.05866 · Cited by 4,733
Benchmarking cloud serving systems with YCSB
Cooper, B. F., Silberstein, A., Tam, E., Ramakrishnan, R., & Sears, R. (2010) · Proceedings of the 1st ACM symposium on Cloud computing · doi:10.1145/1807128.1807152 · Cited by 3,716
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Dueling Network Architectures for Deep Reinforcement Learning
Wang, Z., Schaul, T., Hessel, M., van Hasselt, H., Lanctot, M., & de Freitas, N. (2015) · arXiv · doi:10.48550/arxiv.1511.06581 · Cited by 3,300
Deterministic Policy Gradient Algorithms
Silver, D., Lever, G., Heess, N., Degris, T., Wierstra, D., & Riedmiller, M. (2014) · HAL · Cited by 3,275
Schaul, T., Quan, J., Antonoglou, I., & Silver, D. (2015) · arXiv · doi:10.48550/arxiv.1511.05952 · Cited by 3,120
Markov Decision Processes: Discrete Stochastic Dynamic Programming
Baxter, L. A. (1995) · Technometrics · doi:10.1080/00401706.1995.10484354 · Cited by 2,415
Shapley, L. S. (1953) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.39.10.1095 · Cited by 2,382
Power of Deep Learning for Channel Estimation and Signal Detection in OFDM Systems
Ye, H., Li, G. Y., & Juang, B.-H. (2018) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2017.2757490 · Cited by 2,000
Fractional Programming for Communication Systems—Part I: Power Control and Beamforming
Shen, K., & Yu, W. (2018) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2018.2812733 · Cited by 1,935
Rainbow: Combining Improvements in Deep Reinforcement Learning
Hessel, M., Modayil, J., Van Hasselt, H., Schaul, T., Ostrovski, G., Dabney, W., Horgan, D., Piot, B., Azar, M., & Silver, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11796 · Cited by 1,846
AN OVERVIEW OF THE OMNeT++ SIMULATION ENVIRONMENT
Varga, A., & Hornig, R. (2008) · Proceedings of the First International ICST Conference on Simulation Tools and Techniques for Communications Networks and Systems · doi:10.4108/icst.simutools2008.3027 · Cited by 1,767
Donoho, D. L., Tsaig, Y., Drori, I., & Starck, J.-L. (2012) · IEEE Transactions on Information Theory · doi:10.1109/tit.2011.2173241 · Cited by 1,509
Deep reinforcement learning for robotic manipulation with asynchronous off-policy updates
Gu, S., Holly, E., Lillicrap, T., & Levine, S. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989385 · Cited by 1,424
Semi-Supervised Learning with Deep Generative Models
Kingma, D. P., Rezende, D. J., Mohamed, S., & Welling, M. (2014) · UvA-DARE (University of Amsterdam) · doi:10.48550/arxiv.1406.5298 · Cited by 1,415
Neural Adaptive Video Streaming with Pensieve
Mao, H., Netravali, R., & Alizadeh, M. (2017) · Proceedings of the Conference of the ACM Special Interest Group on Data Communication · doi:10.1145/3098822.3098843 · Cited by 1,357
Resource Management with Deep Reinforcement Learning
Mao, H., Alizadeh, M., Menache, I., & Kandula, S. (2016) · Proceedings of the 15th ACM Workshop on Hot Topics in Networks · doi:10.1145/3005745.3005750 · Cited by 1,353 · cited 1×
“The authors in [163] propose a DRL-based solution, DeepRM, by employing policy gradient methods [148] to manage resources in computer systems directly from experience.”
MethodCar-following: a historical review
Brackstone, M., & McDonald, M. (1999) · Transportation Research Part F: Traffic Psychology and Behaviour · doi:10.1016/s1369-8478(00)00005-x · Cited by 1,270
Machine Learning and Deep Learning Methods for Cybersecurity
Xin, Y., Kong, L., Liu, Z., Chen, Y., Li, Y., Zhu, H., Gao, M., Hou, H., & Wang, C. (2018) · IEEE Access · doi:10.1109/access.2018.2836950 · Cited by 1,228
BRITE: an approach to universal topology generation
Medina, A., Lakhina, A., Matta, I., & Byers, J. (2002) · MASCOTS 2001, Proceedings Ninth International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems · doi:10.1109/mascot.2001.948886 · Cited by 1,226
Dynamic adaptive streaming over HTTP -: standards and design principles
Stockhammer, T. (2011) · Proceedings of the second annual ACM conference on Multimedia systems · doi:10.1145/1943552.1943572 · Cited by 1,221
Network function virtualization: Challenges and opportunities for innovations
Han, B., Gopalakrishnan, V., Ji, L., & Lee, S. (2015) · IEEE Communications Magazine · doi:10.1109/mcom.2015.7045396 · Cited by 1,165
Network Slicing in 5G: Survey and Challenges
Foukas, X., Patounas, G., Elmokashfi, A., & Marina, M. K. (2017) · IEEE Communications Magazine · doi:10.1109/mcom.2017.1600951 · Cited by 1,162
CSI-based Fingerprinting for Indoor Localization: A Deep Learning Approach
Wang, X., Gao, L., Mao, S., & Pandey, S. (2016) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2016.2545523 · Cited by 1,106
A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP
Yin, X., Jindal, A., Sekar, V., & Sinopoli, B. (2015) · Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication · doi:10.1145/2785956.2787486 · Cited by 1,016
Nash Q-Learning for General-Sum Stochastic Games
Hu, J., Wellman, M. P., & Boutilier, C. (2003) · Cited by 923
U-Air: when urban air quality inference meets big data
Zheng, Y., Liu, F., & Hsieh, H.-P. (2013) · Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2487575.2488188 · Cited by 916
van Hasselt, H. P. (2010) · Centrum Wiskunde & Informatica (CWI), the national research institute for mathematics and computer science in the Netherlands · Cited by 839
A generic quantitative relationship between quality of experience and quality of service
Fiedler, M., Hossfeld, T., & Tran-Gia, P. (2010) · IEEE Network · doi:10.1109/mnet.2010.5430142 · Cited by 837
Deep Learning for Super-Resolution Channel Estimation and DOA Estimation Based Massive MIMO System
Huang, H., Yang, J., Huang, H., Song, Y., & Gui, G. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2851783 · Cited by 818
Fadlullah, Z. M., Tang, F., Mao, B., Kato, N., Akashi, O., Inoue, T., & Mizutani, K. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2707140 · Cited by 810
Deep Learning for Intelligent Wireless Networks: A Comprehensive Survey
Mao, Q., Hu, F., & Hao, Q. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2846401 · Cited by 789
EvalVid – A Framework for Video Transmission and Quality Evaluation
Klaue, J., Rathke, B., & Wolisz, A. (2003) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-45232-4_16 · Cited by 787
Multiagent learning using a variable learning rate
Bowling, M., & Veloso, M. (2002) · Artificial Intelligence · doi:10.1016/s0004-3702(02)00121-2 · Cited by 775
Deep Reinforcement Learning: An Overview
Li, Y. (2017) · arXiv · doi:10.48550/arxiv.1701.07274 · Cited by 762
Monahan, G. E. (1982) · Management Science · doi:10.1287/mnsc.28.1.1 · Cited by 745
Chen, M., Mozaffari, M., Saad, W., Yin, C., Debbah, M., & Hong, C. S. (2017) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2017.2680898 · Cited by 742
Chen, X., Zhang, H., Wu, C., Mao, S., Ji, Y., & Bennis, M. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2876279 · Cited by 680
Shapley, L. S. (1953) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.39.10.1953 · Cited by 677
Deep Recurrent Q-Learning for Partially Observable MDPs
Hausknecht, M., & Stone, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.06527 · Cited by 667
Multi-Agent Deep Reinforcement Learning for Dynamic Power Allocation in Wireless Networks
Nasir, Y. S., & Guo, D. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2933973 · Cited by 660
He, Y., Zhao, N., & Yin, H. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2017.2760281 · Cited by 569
Learning-Based Computation Offloading for IoT Devices With Energy Harvesting
Min, M., Xiao, L., Chen, Y., Cheng, P., Wu, D., & Zhuang, W. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2890685 · Cited by 560
Deep reinforcement learning based computation offloading and resource allocation for MEC
Li, J., Gao, H., Lv, T., & Lu, Y. (2018) · 2018 IEEE Wireless Communications and Networking Conference (WCNC) · doi:10.1109/wcnc.2018.8377343 · Cited by 548
Noisy Networks for Exploration
Fortunato, M., Azar, M. G., Piot, B., Menick, J., Osband, I., Graves, A., Mnih, V., Munos, R., Hassabis, D., Pietquin, O., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.10295 · Cited by 543
Modeling and Tools for Network Simulation
(2010) · Springer eBooks · doi:10.1007/978-3-642-12331-3 · Cited by 493
Deep Reinforcement Learning for Dynamic Multichannel Access in Wireless Networks
Wang, S., Liu, H., Gomes, P. H., & Krishnamachari, B. (2018) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2018.2809722 · Cited by 477
Massive MIMO Has Unlimited Capacity
Bjornson, E., Hoydis, J., & Sanguinetti, L. (2018) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2017.2768423 · Cited by 474
Deep Reinforcement Learning from Self-Play in Imperfect-Information GamesPreprint
Heinrich, J., & Silver, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.01121 · Cited by 445
A bisection method for computing the H∞ norm of a transfer matrix and related problems
Boyd, S., Balakrishnan, V., & Kabamba, P. T. (1989) · Mathematics of Control Signals and Systems · doi:10.1007/bf02551385 · Cited by 443
Interference Management for Cellular-Connected UAVs: A Deep Reinforcement Learning Approach
Challita, U., Saad, W., & Bettstetter, C. (2019) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2900035 · Cited by 440
Experience-driven Networking: A Deep Reinforcement Learning based Approach
Xu, Z., Tang, J., Meng, J., Zhang, W., Wang, Y., Liu, C. H., & Yang, D. (2018) · IEEE INFOCOM 2018 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2018.8485853 · Cited by 439
Semisupervised Deep Reinforcement Learning in Support of IoT and Smart City Services
Mohammadi, M., Al-Fuqaha, A., Guizani, M., & Oh, J.-S. (2018) · IEEE Internet of Things Journal · doi:10.1109/jiot.2017.2712560 · Cited by 435
A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP
Yin, X., Jindal, A., Sekar, V., & Sinopoli, B. (2015) · ACM SIGCOMM Computer Communication Review · doi:10.1145/2829988.2787486 · Cited by 376
Rainbow: Combining Improvements in Deep Reinforcement Learning
Hessel, M., Modayil, J., van Hasselt, H. P., Schaul, T., Ostrovski, G., Dabney, W., Horgan, D., Piot, B., Azar, M. G., & Silver, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.02298 · Cited by 369
Commute path bandwidth traces from 3G networks: analysis and applications
Riiser, H., Vigmostad, P., Griwodz, C., & Halvorsen, P. (2013) · Proceedings of the 4th ACM Multimedia Systems Conference · doi:10.1145/2483977.2483991 · Cited by 366
On myopic sensing for multi-channel opportunistic access: structure, optimality, and performance
Zhao, Q., Krishnamachari, B., & Liu, K. (2008) · IEEE Transactions on Wireless Communications · doi:10.1109/t-wc.2008.071349 · Cited by 360
He, Y., Yu, F. R., Zhao, N., Leung, V. C. M., & Yin, H. (2017) · IEEE Communications Magazine · doi:10.1109/mcom.2017.1700246 · Cited by 358
Luong, N. C., Hoang, D. T., Wang, P., Niyato, D., Kim, D. I., & Han, Z. (2016) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2016.2582841 · Cited by 357
Self-citationMobility-Aware Edge Caching and Computing in Vehicle Networks: A Deep Reinforcement Learning
Tan, L. T., & Hu, R. Q. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2867191 · Cited by 356
Evolutionary artificial potential fields and their application in real time robot path planning
Vadakkepat, P., Tan, K. C., & Ming-Liang, W. (2002) · Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512) · doi:10.1109/cec.2000.870304 · Cited by 346
Joint Resource Allocation and User Association for Heterogeneous Wireless Cellular Networks
Fooladivanda, D., & Rosenberg, C. (2013) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2012.121112.120018 · Cited by 336
TCP ex machina: computer-generated congestion control
Winstein, K., & Balakrishnan, H. (2013) · Proceedings of the ACM SIGCOMM 2013 conference on SIGCOMM · doi:10.1145/2486001.2486020 · Cited by 332
Issues in Using Function Approximation for Reinforcement Learning
Thrun, S., & Schwartz, A. (1999) · Cited by 311
Cryptocurrency Portfolio Management with Deep Reinforcement Learning
Jiang, Z., & Liang, J. (2016) · arXiv · doi:10.48550/arxiv.1612.01277 · Cited by 298
(2017) · doi:10.1109/intellisys.2017.8324237 · Cited by 298
UAV Relay in VANETs Against Smart Jamming With Reinforcement Learning
Xiao, L., Lu, X., Xu, D., Tang, Y., Wang, L., & Zhuang, W. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2789466 · Cited by 297
A New Deep-Q-Learning-Based Transmission Scheduling Mechanism for the Cognitive Internet of Things
Zhu, J., Song, Y., Jiang, D., & Song, H. (2018) · IEEE Internet of Things Journal · doi:10.1109/jiot.2017.2759728 · Cited by 296
Reinforcement Learning in Large Discrete Action Spaces.Preprint
Dulac-Arnold, G., Evans, R., Sunehag, P., & Coppin, B. (2015) · arXiv (Cornell University) · Cited by 292
FIFS: Fine-Grained Indoor Fingerprinting System
Xiao, J., Wu, K., Yi, Y., & Ni, L. M. (2012) · 2012 21st International Conference on Computer Communications and Networks (ICCCN) · doi:10.1109/icccn.2012.6289200 · Cited by 290
Deep Reinforcement Learning in Large Discrete Action Spaces
Dulac-Arnold, G., Evans, R., van Hasselt, H., Sunehag, P., Lillicrap, T., Hunt, J., Mann, T., Weber, T., Degris, T., & Coppin, B. (2015) · arXiv · doi:10.48550/arxiv.1512.07679 · Cited by 290
SensorScope: Application-specific sensor network for environmental monitoring
Ingelrest, F., Barrenetxea, G., Schaefer, G., Vetterli, M., Couach, O., & Parlange, M. (2010) · ACM Transactions on Sensor Networks · doi:10.1145/1689239.1689247 · Cited by 289
He, Y., Zhang, Z., Yu, F. R., Zhao, N., Yin, H., Leung, V. C. M., & Zhang, Y. (2017) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2017.2751641 · Cited by 288
The Logarithmic Nature of QoE and the Role of the Weber-Fechner Law in QoE Assessment
Reichl, P., Egger, S., Schatz, R., & D'Alconzo, A. (2010) · 2010 IEEE International Conference on Communications · doi:10.1109/icc.2010.5501894 · Cited by 284
Dynamic Watermarking: Active Defense of Networked Cyber–Physical Systems
Satchidanandan, B., & Kumar, P. R. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2016.2575064 · Cited by 275
A deep reinforcement learning based framework for power-efficient resource allocation in cloud RANs
Xu, Z., Wang, Y., Tang, J., Wang, J., & Gursoy, M. C. (2017) · 2017 IEEE International Conference on Communications (ICC) · doi:10.1109/icc.2017.7997286 · Cited by 262
Anti-Jamming Communications Using Spectrum Waterfall: A Deep Reinforcement Learning Approach
Liu, X., Xu, Y., Jia, L., Wu, Q., & Anpalagan, A. (2018) · IEEE Communications Letters · doi:10.1109/lcomm.2018.2815018 · Cited by 258
Globally Optimal Energy-Efficient Power Control and Receiver Design in Wireless Networks
Zappone, A., Bjornson, E., Sanguinetti, L., & Jorswieck, E. (2017) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2017.2673813 · Cited by 238
A deep reinforcement learning-based framework for content caching
Zhong, C., Gursoy, M. C., & Velipasalar, S. (2018) · 2018 52nd Annual Conference on Information Sciences and Systems (CISS) · doi:10.1109/ciss.2018.8362276 · Cited by 231
Resource Management in Cloud Networking Using Economic Analysis and Pricing Models: A Survey
Luong, N. C., Wang, P., Niyato, D., Wen, Y., & Han, Z. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2647981 · Cited by 230
Self-citationMigration Modeling and Learning Algorithms for Containers in Fog Computing
Tang, Z., Zhou, X., Zhang, F., Jia, W., & Zhao, W. (2019) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2018.2827070 · Cited by 229
Security in Mobile Edge Caching with Reinforcement Learning
Xiao, L., Wan, X., Dai, C., Du, X., Chen, X., & Guizani, M. (2018) · IEEE Wireless Communications · doi:10.1109/mwc.2018.1700291 · Cited by 228
Deep Reinforcement Learning for Resource Allocation in V2V Communications
Ye, H., & Li, G. Y. (2018) · 2018 IEEE International Conference on Communications (ICC) · doi:10.1109/icc.2018.8422586 · Cited by 222
Cellular Network Traffic Scheduling With Deep Reinforcement Learning
Chinchali, S., Hu, P., Chu, T., Sharma, M., Bansal, M., Misra, R., Pavone, M., & Katti, S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11339 · Cited by 218 · cited 2×
“Thus, learning methods such as DQL should be used to provide adaptive rate control mechanisms as proposed in [72].”
BackgroundMethodTwo-dimensional anti-jamming communication based on deep reinforcement learning
Han, G., Xiao, L., & Poor, H. V. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7952524 · Cited by 218
Green Resource Allocation Based on Deep Reinforcement Learning in Content-Centric IoT
He, X., Wang, K., Huang, H., Miyazaki, T., Wang, Y., & Guo, S. (2020) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2018.2805718 · Cited by 208
Liquid State Machines: Motivation, Theory, and Applications
Maass, W. (2011) · Computability in Context · doi:10.1142/9781848162778_0008 · Cited by 201
Simplifying the synthesis of internet traffic matrices
Roughan, M. (2005) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1096536.1096551 · Cited by 199
Li, X., Fang, J., Cheng, W., Duan, H., Chen, Z., & Li, H. (2018) · IEEE Access · doi:10.1109/access.2018.2831240 · Cited by 192
CRAWDAD dataset roma/taxi (v. 2014-07-17)
Bracciale, L., Bonola, M., Loreti, P., Bianchi, G., Amici, R., & Rabuffi, A. (2014) · CRAWDAD wireless network data archive · doi:10.15783/c7qc7m · Cited by 192
Deep convolutional neural networks for massive MIMO fingerprint-based positioning
Vieira, J., Leitinger, E., Sarajlic, M., Li, X., & Tufvesson, F. (2017) · 2017 IEEE 28th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC) · doi:10.1109/pimrc.2017.8292280 · Cited by 186
Machine Learning for Wireless Networks with Artificial Intelligence: A Tutorial on Neural NetworksPreprint
Chen, M., Challita, U., Saad, W., Yin, C., & Debbah, M. A. (2017) · arXiv (Cornell University) · Cited by 184
CCS-TA: quality-guaranteed online task allocation in compressive crowdsensing
Wang, L., Zhang, D., Pathak, A., Chen, C., Xiong, H., Yang, D., & Wang, Y. (2015) · Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2750858.2807513 · Cited by 183
A Secure Mobile Crowdsensing Game With Deep Reinforcement Learning
Xiao, L., Li, Y., Han, G., Dai, H., & Poor, H. V. (2018) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2017.2737968 · Cited by 180
Computation offloading for mobile edge computing: A deep learning approach
Yu, S., Wang, X., & Langar, R. (2017) · 2017 IEEE 28th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC) · doi:10.1109/pimrc.2017.8292514 · Cited by 174
Optimizing User Association and Spectrum Allocation in HetNets: A Utility Perspective
Lin, Y., Bao, W., Yu, W., & Liang, B. (2015) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2015.2417011 · Cited by 172
A Deep-Reinforcement Learning Approach for Software-Defined Networking Routing Optimization
Stampa, G., Arias, M., Sánchez-Charles, D., Muntés-Mulero, V., & Cabellos‐Aparicio, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.07080 · Cited by 168
D-DASH: A Deep Q-Learning Framework for DASH Video Streaming
Gadaleta, M., Chiariotti, F., Rossi, M., & Zanella, A. (2017) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2017.2755007 · Cited by 168
Learning-Based Energy-Efficient Data Collection by Unmanned Vehicles in Smart Cities
Zhang, B., Liu, C. H., Tang, J., Xu, Z., Ma, J., & Wang, W. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2783439 · Cited by 166
User-Centric View of Unmanned Aerial Vehicle Transmission Against Smart Attacks
Xiao, L., Xie, C., Min, M., & Zhuang, W. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2017.2785414 · Cited by 166
Deep learning for signal authentication and security in massive internet-of-things systems
Ferdowsi, A., & Saad, W. (2019) · IEEE Transactions on Communications · doi:10.1109/tcomm.2018.2878025 · Cited by 160
Deep Learning Power Allocation in Massive MIMO
Sanguinetti, L., Zappone, A., & Debbah, M. A. (2018) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/acssc.2018.8645343 · Cited by 159
Performance Optimization in Mobile-Edge Computing via Deep Reinforcement Learning
Chen, X., Zhang, H., Wu, C., Mao, S., Ji, Y., & Bennis, M. (2018) · 2018 IEEE 88th Vehicular Technology Conference (VTC-Fall) · doi:10.1109/vtcfall.2018.8690980 · Cited by 158
Deep reinforcement learning with experience replay based on SARSA
Zhao, D., Wang, H., Shao, K., & Zhu, Y. (2016) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci.2016.7849837 · Cited by 153
Chu, M., Li, H., Liao, X., & Cui, S. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2872440 · Cited by 153
Luong, N. C., Wang, P., Niyato, D. T., Liang, Y., Han, Z., & Hou, F. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2870996 · Cited by 148
Self-citationDeep Reinforcement Learning for Interference-Aware Path Planning of Cellular-Connected UAVs
Challita, U., Saad, W., & Bettstetter, C. (2018) · International Conference on Communications · doi:10.1109/icc.2018.8422706 · Cited by 145
UAV-Aided Cellular Communications with Deep Reinforcement Learning Against Jamming
Lu, X., Xiao, L., Dai, C., & Dai, H. (2020) · IEEE Wireless Communications · doi:10.1109/mwc.001.1900207 · Cited by 145
Robust Deep Reinforcement Learning for Security and Safety in Autonomous Vehicle Systems
Ferdowsi, A., Challita, U., Saad, W., & Mandayam, N. B. (2018) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2018.8569635 · Cited by 144
Ferreira, P. V. R., Paffenroth, R. C., Wyglinski, A. M., Hackett, T. M., Bilén, S. G., Reinhart, R. C., & Mortensen, D. J. (2018) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2018.2832820 · Cited by 140
Liu, S., Hu, X., & Wang, W. (2018) · IEEE Access · doi:10.1109/access.2018.2809581 · Cited by 128
Deep Multi-User Reinforcement Learning for Dynamic Spectrum Access in Multichannel Wireless Networks
Naparstek, O., & Cohen, K. (2017) · Globecom · doi:10.1109/glocom.2017.8254101 · Cited by 116
Wang, C., Wang, J., Zhang, X., & Zhang, X. (2017) · IEEE Global Conference on Signal and Information Processing · doi:10.1109/globalsip.2017.8309082 · Cited by 113
DRAG: Deep Reinforcement Learning Based Base Station Activation in Heterogeneous Networks
Ye, J., & Zhang, Y. A. (2019) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2019.2922602 · Cited by 112
Deep Reinforcement Learning for Sponsored Search Real-time Bidding
Zhao, J., Qiu, G., Guan, Z., Zhao, W. Z., & He, X. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3219918 · Cited by 111
Huang, T., Zhang, R.-X., Zhou, C., & Sun, L. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240545 · Cited by 110
DeepNap: Data-Driven Base Station Sleeping Operations Through Deep Reinforcement Learning
Liu, J., Krishnamachari, B., Zhou, S., & Niu, Z. (2018) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2846694 · Cited by 106
He, Y., Yu, F. R., Zhao, N., & Yin, H. (2018) · IEEE Wireless Communications · doi:10.1109/mwc.2018.1700274 · Cited by 106
He, Y., Liang, C., Yu, F. R., & Han, Z. (2018) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2018.2865183 · Cited by 102
Poonawala, H. A., Satici, A. C., Eckert, H., & Spong, M. W. (2014) · IEEE Transactions on Control of Network Systems · doi:10.1109/tcns.2014.2378876 · Cited by 101
Chen, M., Saad, W., & Yin, C. (2019) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2917440 · Cited by 97
Strategies for adaptive frequency hopping in the unlicensed bands
Popovski, P., Yomo, H., & Prasad, R. (2006) · IEEE Wireless Communications · doi:10.1109/mwc.2006.275200 · Cited by 92
A deep reinforcement learning based offloading scheme in ad-hoc mobile clouds
Le, D. V., & Tham, C. (2018) · IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) · doi:10.1109/infcomw.2018.8406881 · Cited by 92
A Survey on Applications of Model-Free Strategy Learning in Cognitive Wireless Networks
Wang, W., Kwasinski, A., Niyato, D. T., & Han, Z. (2016) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2016.2539923 · Cited by 91
Self-citationA deep learning approach for optimizing content delivering in cache-enabled HetNet
Lei, L., You, L., Dai, G., Vu, T. X., Yuan, D., & Chatzinotas, S. (2017) · International Symposium on Wireless Communication Systems · doi:10.1109/iswcs.2017.8108157 · Cited by 91
Cyber-Physical Attacks With Control Objectives
Chen, Y., Kar, S., & Moura, J. M. F. (2017) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2017.2741778 · Cited by 90
Anti-Jamming Underwater Transmission With Mobility and Learning
Xiao, L., Donghua, Jiang, Wan, X., Su, W., & Tang, Y. (2018) · IEEE Communications Letters · doi:10.1109/lcomm.2018.2792015 · Cited by 82
An Efficient Deep Reinforcement Learning Model for Urban Traffic ControlPreprint
Lin, Y., Dai, X., Li, L., & Wang, F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.01876 · Cited by 80
Communication-Based Train Control System Performance Optimization Using Deep Reinforcement Learning
Zhu, L., He, Y., Yu, F. R., Ning, B., Tang, T., & Zhao, N. (2017) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2017.2724060 · Cited by 78
Deep Learning-Based Dynamic Watermarking for Secure Signal Authentication in the Internet of Things
Ferdowsi, A., & Saad, W. (2018) · International Conference on Communications · doi:10.1109/icc.2018.8422728 · Cited by 78
Liquid State Machine Learning for Resource Allocation in a Network of Cache-Enabled LTE-U UAVs
Chen, M., Saad, W., & Yin, C. (2017) · Globecom · doi:10.1109/glocom.2017.8254746 · Cited by 75
Deep Reinforcement Learning for User Association and Resource Allocation in Heterogeneous Networks
Zhao, N., Liang, Y., Niyato, D. T., Pei, Y., & Jiang, Y. (2018) · Globecom · doi:10.1109/glocom.2018.8647611 · Cited by 74
Self-citationResource Allocation and Inter-Cell Interference Management for Dual-Access Small Cells
Elsherif, A. R., Chen, W., Itô, A., & Ding, Z. J. (2015) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2015.2416990 · Cited by 72
Reinforcement learning–based QoS/QoE‐aware service function chaining in software‐driven 5G slices
Chen, X., Li, Z., Zhang, Y., Long, R., Yu, H., Du, X., & Guizani, M. (2018) · Transactions on Emerging Telecommunications Technologies · doi:10.1002/ett.3477 · Cited by 72
Multiagent -Learning for Aloha-Like Spectrum Access in Cognitive Radio Systems
Li, H. (2010) · EURASIP Journal on Wireless Communications and Networking · doi:10.1155/2010/876216 · Cited by 69
AIF: An Artificial Intelligence Framework for Smart Wireless Network Management
Cao, G., Lu, Z., Wen, X., Lei, T., & Hu, Z. (2017) · IEEE Communications Letters · doi:10.1109/lcomm.2017.2776917 · Cited by 69
Zhang, C., Liu, Z., Gu, B., Yamori, K., & Tanaka, Y. (2018) · IEICE Transactions on Communications · doi:10.1587/transcom.2017cqp0014 · Cited by 66
Malware Detection on Mobile Devices Using Distributed Machine Learning
Shamili, A. S., Bauckhage, C., & Alpcan, T. (2010) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2010.1057 · Cited by 64
Model-free control for distributed stream data processing using deep reinforcement learning
Li, T., Xu, Z., Tang, J., & Wang, Y. (2018) · Proceedings of the VLDB Endowment · doi:10.14778/3199517.3199521 · Cited by 61
He, Y., Liang, C., Yu, F. R., Zhao, N., & Yin, H. (2017) · International Conference on Communications · doi:10.1109/icc.2017.7996332 · Cited by 60
Deep Q-Learning Based Dynamic Resource Allocation for Self-Powered Ultra-Dense Networks
Li, H., Gao, H., Lv, T., & Lu, Y. (2018) · IEEE International Conference on Communications workshops · doi:10.1109/iccw.2018.8403505 · Cited by 60
DECCO: Deep-Learning Enabled Coverage and Capacity Optimization for Massive MIMO Systems
Yang, Y., Li, Y., Li, K., Zhao, S., Chen, R., Wang, J., & Ci, S. (2018) · IEEE Access · doi:10.1109/access.2018.2828859 · Cited by 56
A Non-Stochastic Learning Approach to Energy Efficient Mobility Management
Shen, C., Tekin, C., & van der Schaar, M. (2016) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2016.2612038 · Cited by 55
Reinforcement Learning with Echo State Networks
Szita, I., Gyenes, V., & Lörincz, A. (2006) · Lecture notes in computer science · doi:10.1007/11840817_86 · Cited by 54
Reinforcement Learning Based Mobile Offloading for Cloud-Based Malware Detection
Wan, X., Sheng, G., Li, Y., Xiao, L., & Du, X. (2017) · Globecom · doi:10.1109/glocom.2017.8254503 · Cited by 53
DQN-Based Power Control for IoT Transmission against Jamming
Chen, Y., Li, Y., Xu, D., & Xiao, L. (2018) · IEEE Vehicular Technology Conference · doi:10.1109/vtcspring.2018.8417695 · Cited by 51
Online Energy-Efficient Power Control in Wireless Networks by Deep Neural Networks
Zappone, A., Debbah, M., & Altman, Z. (2018) · 2018 IEEE 19th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc.2018.8445857 · Cited by 48
User Association and Load Balancing for Massive MIMO through Deep Learning
Zappone, A., Sanguinetti, L., & Debbah, M. (2018) · 2018 52nd Asilomar Conference on Signals, Systems, and Computers · doi:10.1109/acssc.2018.8645483 · Cited by 48
User Association and Load Balancing for Massive MIMO through Deep Learning
Zappone, A., Sanguinetti, L., & Debbah, M. (2018) · arXiv · doi:10.48550/arxiv.1812.06905 · Cited by 48
On the benefits of edge caching for MIMO interference alignment
Deghel, M., Baştuǧ, E., Assaad, M., & Debbah, M. A. (2015) · IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc.2015.7227119 · Cited by 48
Optimal Resource Allocation in Wireless Powered Communication Networks With User Cooperation
Di, X., Xiong, K., Fan, P., Yang, H., & Letaief, K. B. (2017) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2017.2754494 · Cited by 48
CodingCache: multipath-aware CCN cache with network coding
Wu, Q., Li, Z., & Xie, G. (2013) · ACM Conference on Information-Centric Networking (ICN) · doi:10.1145/2491224.2491240 · Cited by 46
Proactive Resource Management in LTE-U Systems: A Deep Learning Perspective.Preprint
Challita, U., Dong, L., & Saad, W. (2017) · arXiv (Cornell University) · Cited by 46
Oda, T., Obukata, R., Ikeda, M., Barolli, L., & Takizawa, M. (2017) · International Conference on Advanced Information Networking and Applications Workshops (WAINA) · doi:10.1109/waina.2017.67 · Cited by 46
Cell Selection with Deep Reinforcement Learning in Sparse Mobile Crowdsensing
Wang, L., Liu, W., Zhang, D., Wang, Y., Wang, E., & Yang, Y. (2018) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2018.00164 · Cited by 44
Deep Q-Learning for Self-Organizing Networks Fault Management and Radio Performance Improvement
Mismar, F. B., & Evans, B. L. (2018) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/acssc.2018.8645083 · Cited by 40
Quality of Service Aware Computation Offloading in an Ad-Hoc Mobile Cloud
Le, D. V., & Tham, C. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2852330 · Cited by 38
He, Y., Yu, F. R., Zhao, N., Yin, H., & Boukerche, A. (2017) · Design and Analysis of Intelligent Vehicular Networks and Applications · doi:10.1145/3132340.3132355 · Cited by 37
Deep Reinforcement Learning for Distributed Dynamic Power Allocation in Wireless Networks.Preprint
Nasir, Y. S., & Guo, D. (2018) · arXiv (Cornell University) · Cited by 34
A Big Data Deep Reinforcement Learning Approach to Next Generation Green Wireless Networks
He, Y., Zhang, Z., & Zhang, Y. (2017) · Globecom · doi:10.1109/glocom.2017.8254717 · Cited by 32
He, Y., Liang, C., Zhang, Z., Yu, F. R., Zhao, N., Yin, H., & Zhang, Y. (2017) · IEEE Vehicular Technology Conference · doi:10.1109/vtcfall.2017.8288203 · Cited by 32
Anti-Jamming Power Control Game in Unmanned Aerial Vehicle Networks
Lv, S., Xiao, L., Hu, Q., Wang, X., Hu, C., & Sun, L. (2017) · Globecom · doi:10.1109/glocom.2017.8253988 · Cited by 29
Mobile cloud offloading for malware detections with learning
Li, Y., Liu, J., Li, Q., & Xiao, L. (2015) · IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) · doi:10.1109/infcomw.2015.7179384 · Cited by 24
Wang, W., Hao, J., Wang, Y., & Taylor, M. E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.00162 · Cited by 23
ADAPTIVE STEP-SIZES FOR REINFORCEMENT LEARNING
Dabney, W. (2014) · Scholarworks (University of Massachusetts Amherst) · doi:10.7275/6053347.0 · Cited by 20
Zhang, Y., Song, B., & Zhang, P. (2016) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2016.11.015 · Cited by 20
Tarchi, D., Corazza, G. E., & Vanelli‐Coralli, A. (2013) · International Conference on Communications · doi:10.1109/icc.2013.6655277 · Cited by 18
Quan, L., Wang, Z., & Ren, F. (2018) · Future Internet · doi:10.3390/fi10070060 · Cited by 17
Deep Q-Learning to Preserve Connectivity in Multi-robot Systems
Huang, W., Wang, Y., & Yi, X. (2017) · International Conference on Signal Processing Systems (ICSPS) · doi:10.1145/3163080.3163113 · Cited by 12
A deep reinforcement learning approach to preserve connectivity for multi-robot systems
Huang, W., Wang, Y., & Yi, X. (2017) · International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI) · doi:10.1109/cisp-bmei.2017.8302157 · Cited by 10
Learning Runtime Parameters in Computer Systems with Delayed Experience InjectionPreprint
Schaarschmidt, M., Gessert, F., Dalibard, V., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.09903 · Cited by 8
Implementation of a space communications cognitive engine
Hackett, T. M., Bilén, S. G., Ferreira, P. V. R., Wyglinski, A. M., & Reinhart, R. C. (2017) · IEEE Cognitive Communications for Aerospace Applications Workshop (CCAAW) · doi:10.1109/ccaaw.2017.8001607 · Cited by 8
Crowdsensing Game with Demand Uncertainties: A Deep Reinforcement Learning ApproachPreprint
Zhan, Y., Xia, Y., Zhang, J., Li, T., & Wang, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.00733 · Cited by 7
Cache-enabled Wireless Networks with Opportunistic Interference AlignmentPreprint
He, Y., & Hu, S. Q. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.09024 · Cited by 6
OPPay: Design and Implementation of a Payment System for Opportunistic Data Services
Shi, F., Qin, Z., & McCann, J. A. (2017) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2017.21 · Cited by 6
Cache-Enabled Adaptive Bit Rate Streaming via Deep Self-Transfer Reinforcement Learning
Zhang, Z. J., Zheng, Y., Li, C., Huang, Y., & Yang, L. (2018) · International Conference on Wireless Communications and Signal Processing (WCSP) · doi:10.1109/wcsp.2018.8555916 · Cited by 5
Research works printed but not linked: 18
- bellemare, 2017, A distributional perspective on reinforcement learning, Proc Int Conf Mach Learn, 449
- wang, 2018, Handover control optimization via asynchronous multi-user deep reinforcement learning, Proc IEEE ICC, 1
- 10.1002/9780470400531.eorms0118 · DOI
- balazinska, 2003, IBM Watson Research Center
- 10.1109/MNET.2018.1800085 · doi:10.1109/mnet.2018.1800085
- zhao, 2018, Deep reinforcement learning for network slicing, arXiv preprint arXiv 1805 06591, 1
- 2016, Google Achieves Ai “Breakthrough” by Beating Go Champion
- bellman, 2013, Dynamic Programming
- govindan, 0, Tutornet A Low Power Wireless IoT Testbed
- wang, 2017, Deep reinforcement learning for dynamic multichannel access, Proc Int Conf Comput Netw Commun (ICNC), 599
- 2016, Measuring Fixed Broadband Report
- lillicrap, 2016, Continuous control with deep reinforcement learning, CoRR, abs 1509 2971, 1
- 0, Tyouku of China Network Video Index
- bai, 2018, Deep learning based fast multiuser detection for massive machine-type communication, arXiv preprint arXiv 1807 00967, 1
- 10.1587/transcom.2017NRP0014 · doi:10.1587/transcom.2017nrp0014
- goodfellow, 2016, Deep Learning
- chen, 2017, Machine learning for wireless networks with artificial intelligence: A tutorial on neural networks, arXiv preprint arXiv 1710 02913, 1
- lowe, 2017, Multi-agent actor-critic for mixed cooperative-competitive environments, Proc Adv Neural Inf Process Syst, 6379
Cited by
Federated Learning in Mobile Edge Networks: A Comprehensive Survey
Lim, W. Y. B., Luong, N. C., Hoang, D. T., Jiao, Y., Liang, Y.-C., Yang, Q., Niyato, D., & Miao, C. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2986024 · Cited by 2,565
Self-citationOn the Road to 6G: Visions, Requirements, Key Technologies, and Testbeds
Wang, C.-X., You, X., Gao, X., Zhu, X., Li, Z., Zhang, C., Wang, H., Huang, Y., Chen, Y., Haas, H., et al. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3249835 · Cited by 2,336
The Roadmap to 6G: AI Empowered Wireless Networks
Letaief, K. B., Chen, W., Shi, Y., Zhang, J., & Zhang, Y.-J. A. (2019) · IEEE Communications Magazine · doi:10.1109/mcom.2019.1900271 · Cited by 2,207
Reconfigurable Intelligent Surfaces: Principles and Opportunities
Liu, Y., Liu, X., Mu, X., Hou, T., Xu, J., Di Renzo, M., & Al-Dhahir, N. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3077737 · Cited by 1,847
Deep Learning in Mobile and Wireless Networking: A Survey
Zhang, C., Patras, P., & Haddadi, H. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2904897 · Cited by 1,768
Metadata
- Authors
- Luong, N. C., Hoang, D. T., Gong, S., Niyato, D., Wang, P., Liang, Y.-C., & Kim, D. I.
- Venue
- IEEE Communications Surveys & Tutorials
- Published
- 2019
- Volume
- 21
- Issue
- 4
- Pages
- 3133-3174
- ISSN
- 1553-877X (ISSN-L)
- 2373-745X
- OpenAlex
- W2898035736
- Cited by
- 2,060
- References
- 190
- FWCI
- 104.64
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Funders
- A*STAR-NTU-SUTD Joint Research Grant Call on Artificial Intelligence for the Future of Manufacturing (RGANS1906)
- WASP/NTU (M4082187 (4080))
- Ministry of Education - Singapore (2017-T1-002-007 RG122/17)
- MOE Tier 2 (MOE2014-T2-2-015 ARC4/15)
- Singapore (NRF2015-NRF-ISF001-2277)
- Singapore EMA Energy Resilience (NRF2017EWT-EP003-041)
- National Research Foundation of Korea
- Ministry of Science, ICT and Future Planning (2014R1A5A1011478, 2017R1A2B2003953)
- National Natural Science Foundation of China (61631005, U1801261, 61571100, 61601449)
- Shenzhen Talent Peacock Plan Program (KQTD2015071715073798)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.