Multi-Agent Deep Reinforcement Learning for Dynamic Power Allocation in Wireless Networks
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
This work demonstrates the potential of deep reinforcement learning techniques for transmit power control in wireless networks. Existing techniques typically find near-optimal power allocations by solving a challenging optimization problem. Most of these algorithms are not scalable to large networks in real-world scenarios because of their computational complexity and instantaneous cross-cell channel state information (CSI) requirement. In this paper, a distributively executed dynamic power allocation scheme is developed based on model-free deep reinforcement learning. Each transmitter collects CSI and quality of service (QoS) information from several neighbors and adapts its own transmit power accordingly. The objective is to maximize a weighted sum-rate utility function, which can be particularized to achieve maximum sum-rate or proportionally fair scheduling. Both random variations and delays in the CSI are inherently addressed using deep Q-learning. For a typical network architecture, the proposed algorithm is shown to achieve near-optimal power allocation in real time based on delayed CSI measurements available to the agents. The proposed scheme is especially suitable for practical scenarios where the system model is inaccurate and CSI delay is non-negligible.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“For instances, distributed RL [55], decentralized graph neural networks [23], and distributed DNN [61], are able to automatically learn the distributed resource allocation optimization algorithms.”
From Edge artificial intelligence for 6g: vision, enabling technologies, and applications (2022) · cites this paper as [55]
The cited source says what the claim attributes to it.
In the citing paper
“The DNN for real-time radio resource management at the physical layer of communication networks has been proposed in [101].”
From Quantum Machine Learning for 6G Communication Networks: State-of-the-Art and Vision for the Future (2019) · cites this paper as [101]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“We follow the simulation setup for V2X communications in annex A 3GPP TR 36.885, which describes in detail the vehicular channel models, vehicle mobility, and vehicular data traffic for an urban scenario [34].”
From Explainable AI-Aided Feature Selection and Model Reduction for DRL-Based V2X Resource Allocation (2025) · cites this paper as [34]
Experimental — accuracy not yet measuredIn the citing paper
“By considering CSI variations [55], [275], [276] and stochastic task arrivals [84], [85], the dynamic communication and computation resource allocation problem can be formulated as a MDP, for which deep RL, a modelfree approach, can provide efficient and robust solutions [73].”
From Edge artificial intelligence for 6g: vision, enabling technologies, and applications (2022) · cites this paper as [55]
In the citing paper
“In particular, edge AI techniques, including distributed RL [55], [301], decentralized GNN [23], as well as distributed DNN with binarized output layer [61], are able to learn and execute the distributed resource allocation polices in an automatic and real-time manner.”
From Edge artificial intelligence for 6g: vision, enabling technologies, and applications (2022) · cites this paper as [55]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Fundamentals of Wireless Communication
Tse, D., & Viswanath, P. (2005) · doi:10.1017/cbo9780511807213 · Cited by 13,162
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
An overview of gradient descent optimization algorithms
Ruder, S. (2016) · arXiv · doi:10.48550/arxiv.1609.04747 · Cited by 4,962
Shi, Q., Razaviyayn, M., Luo, Z.-Q., & He, C. (2011) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2011.2147784 · Cited by 2,129 · cited 4×
“We also address some important practical constraints that are not included in [2], [3].”
BackgroundMethodInfluentialApplications of Deep Reinforcement Learning in Communications and Networking: A Survey
Luong, N. C., Hoang, D. T., Gong, S., Niyato, D., Wang, P., Liang, Y.-C., & Kim, D. I. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2916583 · Cited by 2,060
Fractional Programming for Communication Systems—Part I: Power Control and Beamforming
Shen, K., & Yu, W. (2018) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2018.2812733 · Cited by 1,935
Research works printed but not linked: 3
- 2017, Radio frequency (RF) system scenarios
- nasir, 2018, Deep reinforcement learning for distributed dynamic power allocation in wireless networks, arXiv 1808 00490
- 2017, Study on Channel Model for Frequencies From 0 5 to 100 GHz
Cited by
Items 101–200 of 687
Kong, X., Ni, C.-H., Duan, G., Shen, G., Yang, Y., & Das, S. K. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3365293 · Cited by 60
Federated Deep Reinforcement Learning for the Distributed Control of NextG Wireless Networks
Tehrani, P., Restuccia, F., & Levorato, M. (2021) · IEEE International Symposium on Dynamic Spectrum Access Networks · doi:10.1109/dyspan53946.2021.9677132 · Cited by 58
Xu, Y., Zhu, K., Xu, H., & Ji, J. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3240425 · Cited by 64
Sharma, H., Kumar, N., & Tekchandani, R. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3212966 · Cited by 60
Sharma, H., & Kumar, N. (2023) · Physical Communication · doi:10.1016/j.phycom.2023.102002 · Cited by 67
Link Scheduling Using Graph Neural Networks
Zhao, Z., Verma, G., Rao, C. R., Swami, A., & Segarra, S. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3222781 · Cited by 87
Deep Reinforcement Learning for Joint Spectrum and Power Allocation in Cellular Networks
Nasir, Y. S., & Guo, D. (2021) · IEEE Globecom Workshops (GC Wkshps) · doi:10.1109/gcwkshps52748.2021.9681985 · Cited by 62
Self-citationSeid, A. M., Abishu, H. N., Yacob, Y. H., Ayall, T. A., Erbad, A., & Guizani, M. (2022) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2022.3197309 · Cited by 57
Digital Twin Enabled Task Offloading for IoVs: A Learning-Based Approach
Zheng, J., Zhang, Y., Luan, T. H., Mu, P. K., Li, G., Dong, M., & Wu, Y. (2023) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2023.3303461 · Cited by 51
OSTTD: Offloading of Splittable Tasks With Topological Dependence in Multi-Tier Computing Networks
Zhang, R., Chu, X., Ma, R., Zhang, M., Lin, L., Gao, H., & Guan, H. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3227023 · Cited by 55
SWIPT-Enabled Cell-Free Massive MIMO-NOMA Networks: A Machine Learning-Based Approach
Zhang, R., Xiong, K., Lu, Y., Ng, D. W. K., Fan, P., & Letaief, K. B. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3327596 · Cited by 55
Decentralized Scheduling for Cooperative Localization With Deep Reinforcement Learning
Peng, B., Seco‐Granados, G., Steinmetz, E., Fröhle, M., & Wymeersch, H. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2913695 · Cited by 49
Federated Multi-Agent Deep Reinforcement Learning (Fed-MADRL) for Dynamic Spectrum Access
Chang, H.-H., Song, Y., Doan, T. T., & Liu, L. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3233436 · Cited by 52
Adaptive Contention Window Design Using Deep Q-Learning
Kumar, A., Verma, G., Rao, C. R., Swami, A., & Segarra, S. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414805 · Cited by 56
Sun, H., Pu, W., Fu, X., Chang, T., & Hong, M. (2022) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2022.3143372 · Cited by 59
Deep Dyna-Reinforcement Learning Based on Random Access Control in LEO Satellite IoT Networks
Liu, X., Zhang, H., Long, K., Nallanathan, A., & Leung, V. C. M. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3112907 · Cited by 51
Multi-Agent Deep Reinforcement Learning for Massive Access in 5G and Beyond Ultra-Dense NOMA System
Shi, Z., Liu, J., Zhang, S., & Kato, N. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3117859 · Cited by 45
SINR Based Energy Optimization Schemes for 5G Vehicular Sensor Networks
Sachan, S., Sharma, R., & Sehgal, A. (2021) · Wireless Personal Communications · doi:10.1007/s11277-021-08561-6 · Cited by 45
Xu, J., & Ai, B. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3054511 · Cited by 46
Self-Learning Multi-Objective Service Coordination Using Deep Reinforcement Learning
Schneider, S., Khalili, R., Manzoor, A., Qarawlus, H., Schellenberg, R., Karl, H., & Hecker, A. (2021) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2021.3076503 · Cited by 52
A Federated Digital Twin Framework for UAVs-Based Mobile Scenarios
Zhou, L., Leng, S., & Wang, Q. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3335386 · Cited by 50
Decoupling or Learning: Joint Power Splitting and Allocation in MC-NOMA With SWIPT
Tang, J., Luo, J., Ou, J.-H., Zhang, X. Y., Zhao, N., So, D. K. C., & Wong, K. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2020.2998858 · Cited by 44
Hwang, S., Kim, H., Lee, H., & Lee, I. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.3029609 · Cited by 46
Reinforcement Learning Meets Wireless Networks: A Layering Perspective
Chen, Y., Liu, Y., Zeng, M., Saleem, U., Lu, Z., Wen, X., Jin, D., Han, Z., Jiang, T., & Li, Y. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3025365 · Cited by 47
Age of Information Minimization for Wireless Ad Hoc Networks: A Deep Reinforcement Learning Approach
Leng, S., & Yener, A. (2019) · Globecom · doi:10.1109/globecom38437.2019.9013454 · Cited by 46
Joloudari, J. H., Mojrian, S., Saadatfar, H., Nodehi, I., Fazl, F., Shirkharkolaie, S. K., Alizadehsani, R., Kabir, H. M. D., Tan, R., & Acharya, U. R. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-18123-0 · Cited by 47
Wang, M., Liu, X., Wang, F., Liu, Y., Qiu, T., & Jin, M. (2024) · Scientific Reports · doi:10.1038/s41598-024-59241-x · Cited by 39
Deep Reinforcement Learning for QoS provisioning at the MAC layer: A Survey
Abbasi, M., Shahraki, A., Piran, M. J., & Taherkordi, A. (2021) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2021.104234 · Cited by 44
Hashima, S., Fouda, M. M., Sakib, S., Fadlullah, Z. M., Hatano, K., Mohamed, E. M., & Shen, X. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3162135 · Cited by 40
Learning to Beamform in Heterogeneous Massive MIMO Networks
Zhu, M., Chang, T., & Hong, M. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3230662 · Cited by 41
Applications and prospects of artificial intelligence in covert satellite communication: a review
Lu, K., Liu, H., Zeng, L., Wang, J., Zhang, Z., & An, J. (2023) · Science China Information Sciences · doi:10.1007/s11432-022-3566-4 · Cited by 39
Multiple Access in the Era of Distributed Computing and Edge Intelligence
Evgenidis, N. G., Mitsiou, N. A., Koutsioumpa, V. I., Tegos, S. A., Diamantoulakis, P. D., & Karagiannidis, G. K. (2024) · Proceedings of the IEEE · doi:10.1109/jproc.2024.3417528 · Cited by 50
Gündoğan, A., Gürsu, H. M., Pauli, V., & Kellerer, W. (2020) · ACM International Symposium on Theory, Algorithmic Foundations, and Protocol Design for Mobile Networks and Mobile Computing (MobiHoc) · doi:10.1145/3397166.3413468 · Cited by 44
Deep Actor-Critic Learning for Distributed Power Control in Wireless Mobile Networks
Nasir, Y. S., & Guo, D. (2020) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/ieeeconf51394.2020.9443301 · Cited by 46
Self-citationEnergy-Efficient Task Transfer in Wireless Computing Power Networks
Lu, Y., Ai, B., Zhong, Z. D., & Zhang, Y. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3223690 · Cited by 41
Guo, C., Wang, C., Cui, L., Zhou, Q., & Li, J. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2023.3242723 · Cited by 40
Reinforcement Learning for Intelligent Healthcare Systems: A Comprehensive SurveyPreprint
Abdellatif, A. A., Mhaisen, N., Chkirbene, Z., Mohamed, A. M. S., Erbad, A., & Guizani, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.04087 · Cited by 44
Li, J., Zhou, C., Liu, J., Sheng, M., Zhao, N., & Su, Y. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3282909 · Cited by 38
Hsieh, C.-K., Chan, K.-L., & Chien, F. (2021) · Applied Sciences · doi:10.3390/app11094135 · Cited by 41
Distributed Intelligence in Wireless Networks
Liu, X., Yu, J., Liu, Y., Gao, Y., Mahmoodi, T., Lambotharan, S., & Tsang, D. H. K. (2023) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2023.3265425 · Cited by 48
Ge, J., Liang, Y., Zhang, L., Long, R., & Sun, S. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3314930 · Cited by 39
Zhao, J., Zhang, Y., Nie, Y., & Liu, J. (2020) · IEEE Access · doi:10.1109/access.2019.2963751 · Cited by 35
mobile-env: An Open Platform for Reinforcement Learning in Wireless Mobile Networks
Schneider, S., Werner, S., Khalili, R., Hecker, A., & Karl, H. (2022) · IEEE/IFIP Network Operations and Management Symposium (NOMS) · doi:10.1109/noms54207.2022.9789886 · Cited by 50
Li, X., Zhang, Y., Ding, H., & Fang, Y. M. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3305567 · Cited by 33
Wang, H., Bai, Y., & Xie, X. (2023) · IEEE Transactions on Communications · doi:10.1109/tcomm.2023.3322736 · Cited by 33
Cross-Domain Resource Orchestration for the Edge-Computing-Enabled Smart Road
Yuan, Q., Li, J., Zhou, H., Luo, G., Lin, T., Yang, F., & Shen, X. (2020) · IEEE Network · doi:10.1109/mnet.011.2000007 · Cited by 33
A Deep Q-Learning Method for Downlink Power Allocation in Multi-Cell NetworksPreprint
Ahmed, K. I., & Hossain, E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.13032 · Cited by 52
Kupwiwat, C.-T., Hayashi, K., & Ohsaki, M. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.107594 · Cited by 38
Multi-Agent DDPG Based Resource Allocation in NOMA-Enabled Satellite IoT
Chai, F., Zhang, Q., Yao, H., Xin, X., Wang, F., Xu, M., Xiong, Z., & Niyato, D. T. (2024) · IEEE Transactions on Communications · doi:10.1109/tcomm.2024.3397841 · Cited by 32
Lee, K., Hong, J., Seo, H., & Choi, W. (2019) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2947514 · Cited by 34
Consensus Learning for Cooperative Multi-Agent Reinforcement Learning
Xu, Z., Zhang, B., Li, D., Zhang, Z., Zhou, G., Chen, H., & Fan, G. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i10.26385 · Cited by 54
Aznar-Poveda, J., García-Sánchez, A.-J., Egea-López, E., & García-Haro, J. (2021) · IEEE Access · doi:10.1109/access.2021.3050625 · Cited by 34
Tefera, M. K., Zhang, S., & Jin, Z. (2023) · Entropy · doi:10.3390/e25030413 · Cited by 42
Resource Management in Wireless Networks via Multi-Agent Deep Reinforcement Learning
Naderializadeh, N., Sydir, J. J., Simsek, M., & Nikopour, H. (2020) · IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc48557.2020.9154250 · Cited by 32
Uplink Power Control Framework Based on Reinforcement Learning for 5G Networks
Neto, F. H. C., Araújo, D. C., Mota, M. P., Maciel, T. F., & de Almeida, A. L. F. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3074892 · Cited by 36
Deep Reinforcement Learning-Based Sum Rate Fairness Trade-Off for Cell-Free mMIMO
Rahmani, M., Bashar, M., Dehghani, M. J., Akbari, A., Xiao, P., Tafazolli, R., & Debbah, M. A. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3230041 · Cited by 39
Dynamic Resource Allocation With Deep Reinforcement Learning in Multibeam Satellite Communication
Deng, D., Wang, C., Pang, M., & Wang, W. (2022) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2022.3217316 · Cited by 36
Distributed Resource Allocation With Federated Learning for Delay-Sensitive IoV Services
Song, X., Hua, Y., Yang, Y., Xing, G., Liu, F., Xu, L., & Song, T. (2023) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2023.3328988 · Cited by 32
Multi-agent task planning and resource apportionment in a smart grid
Chen, M., Sharma, A., Bhola, J., Nguyễn, V. T., & Truong, C. V. (2021) · International Journal of Systems Assurance Engineering and Management · doi:10.1007/s13198-021-01467-3 · Cited by 29
Multi-Agent Reinforcement Learning-Based Pilot Assignment for Cell-Free Massive MIMO Systems
Rahmani, M., Dehghani, M. J., Xiao, P., Bashar, M., & Debbah, M. A. (2022) · IEEE Access · doi:10.1109/access.2022.3221935 · Cited by 28
EWPS: Emergency Data Communication in the Internet of Medical Things
Gopikrishnan, S., Priakanth, P., Srivastava, G., & Fortino, G. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3053419 · Cited by 27
Network slicing for vehicular communications: a multi-agent deep reinforcement learning approach
Mlika, Z., & Cherkaoui, S. (2021) · Annals of Telecommunications · doi:10.1007/s12243-021-00872-w · Cited by 33
Sohaib, M., Jeong, J., & Jeon, S.-W. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3126112 · Cited by 35
Knowledge-defined networking: Applications, challenges and future work
Ashtari, S., Zhou, I., Abolhasan, M., Shariati, N., Lipman, J., & Ni, W. (2022) · Array · doi:10.1016/j.array.2022.100136 · Cited by 37
Learning-Based Off-Chain Transaction Scheduling in Prioritized Payment Channel Networks
Luo, X., & Li, P. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3213333 · Cited by 28
Scalable Multi-Agent Reinforcement Learning for Dynamic Coordinated Multipoint Clustering
Hu, F., Deng, Y., & Aghvami, A. H. (2022) · IEEE Transactions on Communications · doi:10.1109/tcomm.2022.3220870 · Cited by 34
Hu, F., Deng, Y., & Aghvami, A. H. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3126147 · Cited by 31
Deep Q‐network application for optimal energy management in a grid‐tied solar PV‐Battery microgrid
Muriithi, G., & Chowdhury, S. (2022) · The Journal of Engineering · doi:10.1049/tje2.12128 · Cited by 27
State-Augmented Learnable Algorithms for Resource Management in Wireless Networks
Naderializadeh, N., Eisen, M., & Ribeiro, A. (2022) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2022.3229948 · Cited by 39
Mobility-aware task offloading in MEC with task migration and result caching
Lai, S., Huang, L., Ning, Q., & Zhao, C. (2024) · Ad Hoc Networks · doi:10.1016/j.adhoc.2024.103411 · Cited by 28
Bilen, T., Canberk, B., Sharma, V., Fahim, M., & Duong, T. Q. (2022) · Sensors · doi:10.3390/s22103731 · Cited by 26
Decentralized Resource Allocation-Based Multiagent Deep Learning in Vehicular Network
Mafuta, A. D., Maharaj, B. T., & Alfa, A. S. (2022) · IEEE Systems Journal · doi:10.1109/jsyst.2022.3163235 · Cited by 26
Deep-Learning-Based Recovery of Frequency-Hopping Sequences for Anti-Jamming Applications
Zhu, J., Wang, A., Wu, W., Zhao, Z., Xu, Y., Lei, R., & Yue, K. (2023) · Electronics · doi:10.3390/electronics12030496 · Cited by 25
Deep Learning-Based Resource Allocation Scheme for Heterogeneous NOMA Networks
Kim, D., Kwon, S.-C., Jung, H., & Lee, I.-H. (2023) · IEEE Access · doi:10.1109/access.2023.3307407 · Cited by 28
Achieving Fast Environment Adaptation of DRL-Based Computation Offloading in Mobile Edge Computing
Hu, Z., Niu, J., Ren, T., & Guizani, M. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3320253 · Cited by 28
Digital Twin: Architectures, Networks, and Applications
Zhang, Y. (2024) · Simula SpringerBriefs on computing · doi:10.1007/978-3-031-51819-5 · Cited by 48
Offline Reinforcement Learning for Wireless Network Optimization With Mixture Datasets
Yang, K., Shi, C., Shen, C., Yang, J., Yeh, S., & Sydir, J. J. (2024) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2024.3395624 · Cited by 38
Zhang, X., Zhao, H., Xiong, J., Liu, X., Yin, H., Zhou, X., & Wei, J. (2024) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2024.3360517 · Cited by 28
Intelligent User Association for Symbiotic Radio Networks Using Deep Reinforcement Learning
Zhang, Q., Liang, Y., & Poor, H. V. (2019) · Globecom · doi:10.1109/globecom38437.2019.9014223 · Cited by 24
Resource Allocation via Model-Free Deep Learning in Free Space Optical Communications
Gao, Z., Eisen, M., & Ribeiro, A. (2021) · IEEE Transactions on Communications · doi:10.1109/tcomm.2021.3129199 · Cited by 31
Dynamic spectrum access and sharing through actor-critic deep reinforcement learning
Dong, L. F., Qian, Y., & Xing, Y. (2022) · EURASIP Journal on Wireless Communications and Networking · doi:10.1186/s13638-022-02124-4 · Cited by 28
AutoMan: Resource-efficient provisioning with tail latency guarantees for microservices
Cai, B., Wang, B., Yang, M., & Guo, Q. (2023) · Future Generation Computer Systems · doi:10.1016/j.future.2023.01.014 · Cited by 30
Choi, S., Choi, S., Lee, G., Yoon, S., & Bahk, S. (2023) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2023.3302416 · Cited by 29
Khan, N., & Çöleri, S. (2024) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2024.3424398 · Cited by 28
Hybrid Beamforming for mmWave MU-MISO Systems Exploiting Multi-Agent Deep Reinforcement Learning
Wang, Q., Li, X., Jin, S., & Chen, Y. (2021) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2021.3056702 · Cited by 24
Zhou, H., Wang, X., Umehira, M., Chen, X., Wu, C., & Ji, Y. (2021) · IEEE Access · doi:10.1109/access.2021.3067662 · Cited by 24
Hierarchical Digital-Twin-Enhanced Cooperative Sensing for UAV Swarms
Zhou, L., Leng, S., & Quek, T. Q. S. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3428476 · Cited by 23
Cellular Network Capacity and Coverage Enhancement with MDT Data and Deep Reinforcement Learning
Skocaj, M., Amorosa, L. M., Ghinamo, G., Muratore, G., Micheli, D., Zabini, F., & Verdone, R. (2022) · Computer Communications · doi:10.1016/j.comcom.2022.09.005 · Cited by 25
Birabwa, D. J., Ramotsoela, D. T., & Ventura, N. (2023) · Computer Networks · doi:10.1016/j.comnet.2023.109827 · Cited by 30
Multi-Agent Deep Reinforcement Learning for Coordinated Multipoint in Mobile Networks
Schneider, S., Karl, H., Khalili, R., & Hecker, A. (2023) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2023.3300962 · Cited by 31
Alwarafy, A., Abdallah, M. M., Çiftler, B. S., Al‐Fuqaha, A., & Hamdi, M. (2021) · doi:10.36227/techrxiv.14672643 · Cited by 56
Artificial Intelligence Empowered Power Allocation for Smart Railway
Xu, J., & Ai, B. (2021) · IEEE Communications Magazine · doi:10.1109/mcom.001.2000634 · Cited by 23
Zhang, J., Xu, X., Zhang, K., Han, S., Tao, X., & Zhang, P. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3076230 · Cited by 23
5GhNet: an intelligent QoE aware RAT selection framework for 5G-enabled healthcare network
Priya, B., & Malhotra, J. (2021) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-021-03606-x · Cited by 23
Cai, H. W. (2022) · The Journal of Supercomputing · doi:10.1007/s11227-021-04145-0 · Cited by 25
AI Empowered Resource Management for Future Wireless Networks
Shen, Y., Zhang, J., Song, S. H., & Letaief, K. B. (2021) · 2021 IEEE International Mediterranean Conference on Communications and Networking (MeditCom) · doi:10.1109/meditcom49071.2021.9647580 · Cited by 22
Multi-agent deep reinforcement learning based resource management in heterogeneous V2X networks
Zhao, J., Hu, F., Li, J., & Nie, Y. (2025) · Digital Communications and Networks · doi:10.1016/j.dcan.2023.06.003 · Cited by 21
Li, X., Zhou, Z., Wei, C., Gao, X., & Zhang, Y. (2025) · Energy and AI · doi:10.1016/j.egyai.2025.100491 · Cited by 30
Decentralized Multi-Agent Power Control in Wireless Networks With Frequency Reuse
Wang, Z., Zong, J., Zhou, Y., Shi, Y., & Wong, V. W. S. (2021) · IEEE Transactions on Communications · doi:10.1109/tcomm.2021.3135540 · Cited by 23
Zhang, Y., Zhang, Z., Lu, Y., Zhu, H., & Tang, D. (2023) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2023.102712 · Cited by 21
Metadata
- Authors
- Nasir, Y. S., & Guo, D.
- Affiliations
- Northwestern University (US)
- Venue
- IEEE Journal on Selected Areas in Communications
- Published
- 2019-10
- Volume
- 37
- Issue
- 10
- Pages
- 2239-2250
- ISSN
- 0733-8716 (ISSN-L)
- 1558-0008
- OpenAlex
- W2969195240
- Cited by
- 660
- References
- 40
- Citations by year
- 2026: 57 · 2025: 75 · 2024: 103 · 2023: 115 · 2022: 113 · 2021: 117 · 2020: 61 · 2019: 17
- FWCI
- 27.65
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Journal on Selected Areas in Communications (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (CCF-1423040)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Wireless Network Optimization
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced MIMO Systems Optimization
- Physical Sciences › Computer Science › Computer Networks and Communications › Wireless Communication Networks Research
- Keywords
- transmission power control, dynamic power allocation, multi-agent deep reinforcement learning, deep Q-learning, wireless networks, distributed power allocation, delayed channel state information, sum rate maximization, proportional fair scheduling, quality of service, model-free reinforcement learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.