The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Power Allocation in Multi-User Cellular Networks: Deep Reinforcement Learning Approaches
Abstract
The model-based power allocation has been investigated for decades, but this approach requires mathematical models to be analytically tractable and it has high computational complexity. Recently, the data-driven model-free approaches have been rapidly developed to achieve near-optimal performance with affordable computational complexity, and deep reinforcement learning (DRL) is regarded as one such approach having great potential for future intelligent networks. In this paper, a dynamic downlink power control problem is considered for maximizing the sum-rate in a multi-user wireless cellular network. Using cross-cell coordinations, the proposed multi-agent DRL framework includes off-line and on-line centralized training and distributed execution, and a mathematical analysis is presented for the top-level design of the near-static problem. Policy-based REINFORCE, value-based deep Q-learning (DQL), actor-critic deep deterministic policy gradient (DDPG) algorithms are proposed for this sum-rate problem. Simulation results show that the data-driven approaches outperform the state-of-art model-based methods on sum-rate performance. Furthermore, the DDPG outperforms the REINFORCE and DQL in terms of both sum-rate performance and robustness.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
Reinforcement Learning: An Introduction
Johnson, J. D., Li, J., & Chen, Z. (2000) · Neurocomputing · doi:10.1016/s0925-2312(00)00324-6 · Cited by 8,414
(1999) · Cited by 5,147
Five disruptive technology directions for 5G
Boccardi, F., Heath, R. W., Lozano, A., Marzetta, T. L., & Popovski, P. (2014) · IEEE Communications Magazine · doi:10.1109/mcom.2014.6736746 · Cited by 3,709
An Introduction to Deep Learning for the Physical Layer
O'Shea, T., & Hoydis, J. (2017) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2017.2758370 · Cited by 2,980 · cited 1×
“These methods are usually modelfree and data-driven [11], [12], and the solutions are obtained through data learning instead of model-oriented analysis and design.”
MethodPattern recognition and machine learning
(2007) · Choice Reviews Online · doi:10.5860/choice.44-5091 · Cited by 2,650
Shi, Q., Razaviyayn, M., Luo, Z.-Q., & He, C. (2011) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2011.2147784 · Cited by 2,129
Power of Deep Learning for Channel Estimation and Signal Detection in OFDM Systems
Ye, H., Li, G. Y., & Juang, B.-H. (2018) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2017.2757490 · Cited by 2,000
Fractional Programming for Communication Systems—Part I: Power Control and Beamforming
Shen, K., & Yu, W. (2018) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2018.2812733 · Cited by 1,935
Dynamic Spectrum Management: Complexity and Duality
Luo, Z.-Q., & Zhang, S. (2008) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2007.914876 · Cited by 929
Reinforcement Learning and Dynamic Programming Using Function Approximators
Busoniu, L., Babuska, R., De Schutter, B., & Ernst, D. (2017) · CRC Press eBooks · doi:10.1201/9781439821091 · Cited by 919
Learning to Optimize: Training Deep Neural Networks for Interference Management
Sun, H., Chen, X., Shi, Q., Hong, M., Fu, X., & Sidiropoulos, N. D. (2018) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2018.2866382 · Cited by 874
Shi, Q., Razaviyayn, M., Luo, Z.-Q., & He, C. (2011) · 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2011.5946304 · Cited by 873
Deep Reinforcement Learning: An Overview
Li, Y. (2017) · arXiv · doi:10.48550/arxiv.1701.07274 · Cited by 762
Multi-Agent Deep Reinforcement Learning for Dynamic Power Allocation in Wireless Networks
Nasir, Y. S., & Guo, D. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2933973 · Cited by 660
Deep learning for wireless physical layer: Opportunities and challenges
Wang, T., Wen, C.-K., Wang, H., Gao, F., Jiang, T., & Jin, S. (2017) · China Communications · doi:10.1109/cc.2017.8233654 · Cited by 606
An energy efficient and spectrum efficient wireless heterogeneous network framework for 5G systems
Hu, R. Q., & Qian, Y. (2014) · IEEE Communications Magazine · doi:10.1109/mcom.2014.6815898 · Cited by 445
Automatic Modulation Classification: A Deep Learning Enabled Approach
Meng, F., Chen, P., Wu, L., & Wang, X. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2868698 · Cited by 413
Self-citationCoexistence of Wi-Fi and heterogeneous small cell networks sharing unlicensed spectrum
Zhang, H., Chu, X., Guo, W., & Wang, S. (2015) · IEEE Communications Magazine · doi:10.1109/mcom.2015.7060498 · Cited by 406
Power Control in Wireless Cellular Networks
Chiang, M., Hande, P., Lan, T., & Tan, C. W. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601981370 · Cited by 361
Power Control in Wireless Cellular Networks
Chiang, M., Hande, P., Lan, T., & Tan, C. W. (2008) · Foundations and Trends in Networking · doi:10.1561/1300000009 · Cited by 304
Wei, Y., Yu, F. R., Song, M., & Han, Z. (2018) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2017.2769644 · Cited by 301
Towards Optimal Power Control via Ensembling Deep Neural Networks
Liang, F., Shen, C., Yu, W., & Wu, F. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2957482 · Cited by 268
Li, X., Fang, J., Cheng, W., Duan, H., Chen, Z., & Li, H. (2018) · IEEE Access · doi:10.1109/access.2018.2831240 · Cited by 192 · cited 1×
“The QL or DQL is widely applied to various communication scenarios having different power allocation problems, such as general interference management in heterogeneous networks that are typically composed of a macro base station and several femto-cells [25]–[28]; sum-rate maximization or proportionally fair scheduling…”
BackgroundMulticell Coordination via Joint Scheduling, Beamforming, and Power Spectrum Adaptation
Yu, W., Kwon, T., & Shin, C. (2013) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2013.052313.121128 · Cited by 171
A Q-learning based approach to interference avoidance in self-organized femtocell networks
Bennis, M., & Niyato, D. (2010) · 2010 IEEE Globecom Workshops · doi:10.1109/glocomw.2010.5700414 · Cited by 161
Learning Radio Resource Management in RANs: Framework, Opportunities, and Challenges
Calabrese, F. D., Wang, L., Ghadimi, E., Peters, G., Hanzo, L., & Soldati, P. (2018) · IEEE Communications Magazine · doi:10.1109/mcom.2018.1701031 · Cited by 154 · cited 1×
“A framework of centralized training and distributed execution [36] was proposed to address these challenges.”
BackgroundZhang, H., Venturino, L., Prasad, N., Li, P., Rangarajan, S., & Wang, X. (2011) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2011.110609 · Cited by 147
A Machine Learning Approach for Power Allocation in HetNets Considering QoS
Amiri, R., Mehrpouyan, H., Fridman, L., Mallik, R. K., Nallanathan, A., & Matolak, D. W. (2018) · International Conference on Communications · doi:10.1109/icc.2018.8422864 · Cited by 134
Learning Based Frequency- and Time-Domain Inter-Cell Interference Coordination in HetNets
Simsek, M., Bennis, M., & Güvenç, İ. (2014) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2014.2374237 · Cited by 109
Improved decentralized Q-learning algorithm for interference reduction in LTE-femtocells
Simsek, M., Czylwik, A., Galindo‐Serrano, A., & Giupponi, L. (2011) · Wireless Advanced (WiAd) · doi:10.1109/wiad.2011.5983301 · Cited by 51
Thomas, P. S., & Brunskill, E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.06643 · Cited by 44
Deep Reinforcement Learning for Distributed Dynamic Power Allocation in Wireless Networks.Preprint
Nasir, Y. S., & Guo, D. (2018) · arXiv (Cornell University) · Cited by 34
Power Allocation in Multi-User Cellular Networks: Deep Reinforcement Learning ApproachesPreprint
Meng, F. Y., Chen, P., Wu, L., & Cheng, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.07159 · Cited by 13
Self-citationPolicy Gradient SMDP for Resource Allocation and Routing in Integrated Services Networks
Việt, N. H., Vien, N. A., & Chung, T. (2008) · IEEE International Conference on Networking, Sensing and Control (ICNSC) · doi:10.1109/icnsc.2008.4525466 · Cited by 3
NN‐based IDF demodulator in band‐limited communication system
Meng, F. Y., Chen, P., & Wu, L. (2017) · IET Communications · doi:10.1049/iet-com.2017.0643 · Cited by 2
Self-citation
Research works printed but not linked: 3
- Goodfellow, 2016, Deep Learning
- Ye, Deep reinforcement learning based distributed resource allocation for V2 V broadcasting, 440
- 10.1049/el:19930777 · doi:10.1049/el:19930777
Cited by
Edge artificial intelligence for 6g: vision, enabling technologies, and applications
Letaief, K. B., Shi, Y., Lu, J., & Lu, J. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126076 · Cited by 829
“By considering CSI variations [275], [55], [276] and stochastic task arrivals [85], [84], the dynamic”
BackgroundXu, W., Yang, Z., Ng, D. W. K., Levorato, M., Eldar, Y. C., & Debbah, M. (2023) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2023.3239189 · Cited by 660
Federated Learning in Edge Computing: A Systematic Survey
Abreha, H. G., Hayajneh, M., & Serhani, M. A. (2022) · Sensors · doi:10.3390/s22020450 · Cited by 342
Optimal Wireless Resource Allocation With Random Edge Graph Neural Networks
Eisen, M., & Ribeiro, A. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.2988255 · Cited by 327
Energy Efficiency Maximization in RIS-Assisted SWIPT Networks With RSMA: A PPO-Based Approach
Zhang, R., Xiong, K., Lu, Y., Fan, P., Ng, D. W. K., & Letaief, K. B. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2023.3240707 · Cited by 290
Metadata
- Authors
- Meng, F., Chen, P., Wu, L., & Cheng, J.
- Venue
- IEEE Transactions on Wireless Communications
- Published
- 2020-10
- Volume
- 19
- Issue
- 10
- Pages
- 6255-6267
- ISSN
- 1536-1276 (ISSN-L)
- 1558-2248
- OpenAlex
- W3036160090
- Cited by
- 288
- References
- 41
- FWCI
- 13.59
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Funders
- National Natural Science Foundation of China (61801112, 61601281)
- Natural Science Foundation of Jiangsu Province (BK20180357)
- foundation of Shannxi Key Laboratory of Integrated and Intelligent Navigation (SKLIIN-20190204)
- Open Program of State Key Laboratory of Millimeter Waves, Southeast University (K202029)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.