Intelligent Power Control for Spectrum Sharing in Cognitive Radios: A Deep Reinforcement Learning Approach
Open accessThe DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
We consider the problem of spectrum sharing in a cognitive radio system consisting of a primary user and a secondary user. The primary user and the secondary user work in a non-cooperative manner. Specifically, the primary user is assumed to update its transmitted power based on a pre-defined power control policy. The secondary user does not have any knowledge about the primary user's transmit power, or its power control strategy. The objective of this paper is to develop a learning-based power control method for the secondary user in order to share the common spectrum with the primary user. To assist the secondary user, a set of sensor nodes are spatially deployed to collect the received signal strength information at different locations in the wireless environment. We develop a deep reinforcement learning-based method, which the secondary user can use to intelligently adjust its transmit power such that after a few rounds of interaction with the primary user, both users can transmit their own data successfully with required qualities of service. Our experimental results show that the secondary user can interact with the primary user efficiently to reach a goal state (defined as a state in which both users can successfully transmit their data) from any initial states within a few number of steps.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Such dynamic sharing of spectrum aims at enhancing the spectrum utilization efficiency through the provision of access of under-utilized spectrum to the secondary network users [111].”
From Quantum Machine Learning for 6G Communication Networks: State-of-the-Art and Vision for the Future (2019) · cites this paper as [111]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · cited 1×
“The Adam algorithm [28] is adopted for updating the weights θ, where the size of a minibatch is set to 256.”
MethodHuman-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Wireless Communications: Principles and Practice
Rappaport, T. S. (1996) · Cited by 17,370
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
Cognitive radio: brain-empowered wireless communications
Haykin, S. (2005) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2004.839380 · Cited by 11,916 · cited 1×
“In order to improve the spectrum efficiency, the notion of spectrum sharing with secondary users through cognitive radios is highly motivated [2].”
BackgroundPlaying Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471 · cited 1×
“Recently, deep reinforcement learning was introduced and proves its competence for challenging tasks, say Go and Atari games [32]–[34].”
BackgroundWatkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Wireless sensor network survey
Yick, J., Mukherjee, B., & Ghosal, D. (2008) · Computer Networks · doi:10.1016/j.comnet.2008.04.002 · Cited by 6,255
Cited by
Applications of Deep Reinforcement Learning in Communications and Networking: A Survey
Luong, N. C., Hoang, D. T., Gong, S., Niyato, D., Wang, P., Liang, Y.-C., & Kim, D. I. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2916583 · Cited by 2,060
“The authors in [166] consider spectrum sensing and power control in non-cooperative cognitive radio networks.”
BackgroundDeep Learning in Mobile and Wireless Networking: A Survey
Zhang, C., Patras, P., & Haddadi, H. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2904897 · Cited by 1,768
Wireless Networks Design in the Era of Deep Learning: Model-Based, AI-Based, or Both?
Zappone, A., Di Renzo, M., & Debbah, M. (2019) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2924010 · Cited by 684
Wireless Networks Design in the Era of Deep Learning: Model-Based, AI-Based, or Both?
Zappone, A., Di Renzo, M., & Debbah, M. (2019) · arXiv · doi:10.48550/arxiv.1902.02647 · Cited by 685
Quantum Machine Learning for 6G Communication Networks: State-of-the-Art and Vision for the Future
Nawaz, S. J., Sharma, S. K., Wyne, S., Patwary, M. N., & Asaduzzaman, M. (2019) · IEEE Access · doi:10.1109/access.2019.2909490 · Cited by 658
“A deep reinforcement learning based power control method for spectrum sharing in cognitive radios has been proposed in [110].”
MethodZhao, N., Liang, Y.-C., Niyato, D., Pei, Y., Wu, M., & Jiang, Y. (2019) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2933417 · Cited by 461
Hussain, F., Hassan, S. A., Hussain, R., & Hossain, E. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2964534 · Cited by 395
“Development of new IoT applications advocates for an improved spectral efficiency, high data rates and throughput as well as consideration of context and personalization of the IoT services, and consequently, the problem of resource management becomes crucial [4], [5].”
BackgroundMachine learning for wireless communications in the Internet of Things: A comprehensive survey
Jagannath, J., Polosky, N., Jagannath, A., Restuccia, F., & Melodia, T. (2019) · Ad Hoc Networks · doi:10.1016/j.adhoc.2019.101913 · Cited by 288
Power Allocation in Multi-User Cellular Networks: Deep Reinforcement Learning Approaches
Meng, F., Chen, P., Wu, L., & Cheng, J. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3001736 · Cited by 288
“The QL or DQL is widely applied to various communication scenarios having different power allocation problems, such as general interference management in heterogeneous networks that are typically composed of a macro base station and several femto-cells [25]–[28]; sum-rate maximization or proportionally fair scheduling…”
BackgroundA Gentle Introduction to Reinforcement Learning and its Application in Different Fields
Naeem, M., Rizvi, S. T. H., & Coronato, A. (2020) · IEEE Access · doi:10.1109/access.2020.3038605 · Cited by 257
“In addition, few other miscellaneous applications of RL related to communications and networking include user localization ( [72], [203], [204]); direction of arrival estimation [205]; data collection ( [206]–[210]); power control ([211]–[213]); signal detection [214] and traffic engineering and routing ([214]–[221]).”
BackgroundGAN-Powered Deep Distributional Reinforcement Learning for Resource Management in Network Slicing
Hua, Y., Li, R., Zhao, Z., Chen, X., & Zhang, H. (2020) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2959185 · Cited by 240
Machine Learning in Wireless Sensor Networks for Smart Cities: A Survey
Sharma, H., Haque, A., & Blaabjerg, F. (2021) · Electronics · doi:10.3390/electronics10091012 · Cited by 229
“10 Energy Efficient Street Lighting, Smart environment monitoring Spectrum Sharing Deep Reinforcement Learning [90,91] Spectrum sharing is Self-learning, rewards system tasks in ML.”
BackgroundA Survey of Blockchain and Artificial Intelligence for 6G Wireless Communications
Zuo, Y., Guo, J., Gao, N., Zhu, Y., Jin, S., & Li, X. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3315374 · Cited by 192
“Reference [150] was aimed at the single-user power control problem, which cannot be applied to multi-user scenarios.”
BackgroundInfluentialSelf-citationResource Management in Wireless Networks via Multi-Agent Deep Reinforcement Learning
Naderializadeh, N., Sydir, J. J., Simsek, M., & Nikopour, H. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3051163 · Cited by 187
“In [18], [19], the authors use deep RL for the problem of spectrum sharing and resource allocation in cognitive radio networks.”
BackgroundGraph Embedding-Based Wireless Link Scheduling With Few Training Samples
Lee, M., Yu, G., & Li, G. Y. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3040983 · Cited by 180
Lee, S.-S., & Lee, S. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2996213 · Cited by 169
“Moreover, an RL-based power control algorithm was proposed for spectrum sharing [33].”
MethodWang, C., Deng, D., Xu, L., & Wang, W. (2022) · IEEE Transactions on Communications · doi:10.1109/tcomm.2022.3170458 · Cited by 170
Bruce Lee-Inspired Fluid Antenna System: Six Research Topics and the Potentials for 6G
Wong, K., Tong, K., Shen, Y., Chen, Y., & Zhang, Y. (2022) · Frontiers in Communications and Networks · doi:10.3389/frcmn.2022.853416 · Cited by 201
“…channel estimation for massive MIMO systems (Huang et al., 2018; Wen et al., 2018) to cognitive radios and spectrum sharing (Bkassiny et al., 2013; Li H et al., 2018; Chang et al., 2019), to signal classi fi cation (O ’ Shea et al., 2018), to localization (Wang et al., 2017), to physical layer…”
Deep Learning for Radio Resource Allocation in Multi-Cell Networks
Ahmed, K. I., Tabassum, H., & Hossain, E. (2019) · IEEE Network · doi:10.1109/mnet.2019.1900029 · Cited by 173
“In [9], the authors develop a deep Q-learning based spectrum sharing approach for primary and secondary users in a non-cooperative fashion.”
BackgroundZhang, L., Tan, J., Liang, Y., Feng, G., & Niyato, D. T. (2019) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2912754 · Cited by 171
Deep Reinforcement Learning for Joint Channel Selection and Power Control in D2D Networks
Tan, J., Liang, Y., Zhang, L., & Feng, G. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3032991 · Cited by 153
“Although DRL has been investigated for channel selection and power control separately in the literature, e.g., [20]–[25], there still lacks of a joint design scheme, especially for D2D networks.”
BackgroundDeep-Waveform: A Learned OFDM Receiver Based on Deep Complex-Valued Convolutional Networks
Zhao, Z., Vuran, M. C., Guo, F., & Scott, S. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3087241 · Cited by 155
“Above the PHY, deep learning is also used in resource allocation and network management, such as traffic prediction [29], interference alignment [30], power control [31], spectrum sharing [32], and scheduling [33].”
MethodGame Theory and Reinforcement Learning Based Secure Edge Caching in Mobile Social Networks
Xu, Q., Su, Z., & Lu, R. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.2980823 · Cited by 105
“[37] focused on the problem of spectrum sharing in a cognitive radio system, and developed a deep reinforcement learning-based method for the secondary user to share the common spectrum with the primary user, where users can transmit their own data successfully with required qualities of service.”
BackgroundRahman, G., Dang, T., & Ahmed, M. (2020) · Intelligent and Converged Networks · doi:10.23919/icn.2020.0020 · Cited by 101
“[30, 31] to gain a high throughput in the network where DRL is used to allocate an optimal amount of power resources.”
Ssengonzi, C., Kogeda, O. P., & Olwal, T. O. (2022) · Array · doi:10.1016/j.array.2022.100142 · Cited by 102
Machine learning for cooperative spectrum sensing and sharing: A survey
Janu, D., Singh, K., & Kumar, S. (2021) · Transactions on Emerging Telecommunications Technologies · doi:10.1002/ett.4352 · Cited by 100
“83 The power control problem is addressed in Reference 84 by constructing an information interaction model among PU, SU and wireless sensors and investigating with the application of deep RL methods such A3C and distributed proximal policy optimization, etc.”
MethodDeep Learning Challenges and Prospects in Wireless Sensor Network Deployment
Qiu, Y., Ma, L., & Priyadarshi, R. (2024) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-024-10079-6 · Cited by 97
“These given solutions and optimization techniques make an effort to overcome the challenges that have been discovered throughout the process of implementing deep learning in WSNs [176–182].”
Learning Decentralized Wireless Resource Allocations With Graph Neural Networks
Wang, Z., Eisen, M., & Ribeiro, A. (2022) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2022.3163626 · Cited by 100
Alwarafy, A., Abdallah, M. M., Çiftler, B. S., Al‐Fuqaha, A., & Hamdi, M. (2022) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2022.3153226 · Cited by 148
“[99] Power control Single-agent DQN D2D networks Nguyen et al.”
BackgroundJoint Interference Alignment and Power Control for Dense Networks via Deep Reinforcement Learning
Wang, C., Deng, D., Xu, L., Wang, W., & Gao, F. (2021) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2021.3052079 · Cited by 69
“Recently, deep reinforcement learning (DRL) algorithm-based power control has received widespread attention [8]–[11].”
BackgroundMethodA Novel Deep Learning Framework Based RNN-SAE for Fault Detection of Electrical Gas Generator
Alrifaey, M., Lim, W. H., & Ang, C. K. (2021) · IEEE Access · doi:10.1109/access.2021.3055427 · Cited by 72
“According to [23], DL models can offer promising tools that can assist a decision-maker in planning and management decisions.”
BackgroundAslam, M. M., Du, L., Zhang, X., Chen, Y., Ahmed, Z., & Qureshi, B. (2021) · Wireless Communications and Mobile Computing · doi:10.1155/2021/1331428 · Cited by 79
A Review of End-to-End Autonomous Driving in Urban Environments
Coelho, D., & de Oliveira, M. A. R. (2022) · IEEE Access · doi:10.1109/access.2022.3192019 · Cited by 93
Zhao, B., & Zhao, X. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3094465 · Cited by 75
Deep-Reinforcement-Learning-Based Spectrum Resource Management for Industrial Internet of Things
Shi, Z., Xie, X., Lu, H., Yang, H., Kadoch, M., & Cheriet, M. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3022861 · Cited by 62
“Examples of this include hardware overhead (requiring precise spectrum sensing detector instrumentation [20], or requiring additional sensors [15]), signaling overhead (requiring collaboration between the BS and UEs [19]), and computational complexity overhead (requiring the introduction of LSTM or…”
BackgroundMethodInfluentialGuo, S., & Zhao, X. (2022) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2022.3142727 · Cited by 57
Spectrum Sharing Schemes From 4G to 5G and Beyond: Protocol Flow, Regulation, Ecosystem, Economic
Parvini, M., Zarif, A. H., Nouruzi, A., Mokari, N., Javan, M. R., Arand, B. A., Ghasemi, A., & Yanıkömeroğlu, H. (2023) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2023.3238569 · Cited by 83
“In both [221] and [222], the authors considered a cognitive radio system consisting of a PU, a SU, and wireless sensors, where the SU could not sense the spectrum and needed to use the”
BackgroundPower Control in Energy Harvesting Multiple Access System With Reinforcement Learning
Chu, M., Liao, X., Li, H., & Cui, S. R. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2928837 · Cited by 58
“Similarly, the approximate computational complexity at each TS for the methods [18] and [19] are O(K ·|θ |) and O(K ·(|θDQN a |+|θ b |)), respectively, where |θ | is the parameter in [18], θDQN a and θ b are the network parameters in [19].”
BackgroundMethodInfluentialSelf-citationQ-Learning-Based Spectrum Access for Multimedia Transmission Over Cognitive Radio Networks
Huang, X., Li, Y., Gao, Y. M., & Tang, X.-W. (2020) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2020.3027297 · Cited by 55
“In [17], a reinforcement learning based power control method was proposed to realize spectrum sharing after several rounds of consultation among PUs and SUs.”
MethodAn overview of deep reinforcement learning for spectrum sensing in cognitive radio networks
Obite, F., Usman, A. D., & Okafor, E. (2021) · Digital Signal Processing · doi:10.1016/j.dsp.2021.103014 · Cited by 58
AI-Based Abnormality Detection at the PHY-Layer of Cognitive Radio by Learning Generative Models
Toma, A., Krayani, A., Farrukh, M., Qi, H., Marcenaro, L., Gao, Y., & Regazzoni, C. S. (2020) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2020.2970693 · Cited by 49
“The objective in [17] is to develop a deep reinforcement learning-based power control method for the problem of spectrum sharing in a CR system consisting of a primary user and a secondary user which work in a non-cooperative manner.”
BackgroundWhen Machine Learning Meets Spectrum Sharing Security: Methodologies and Challenges
Wang, Q., Sun, H., Hu, R. Q., & Bhuyan, A. (2022) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2022.3146364 · Cited by 64
Zhang, Y., Cai, P., Pan, C., & Zhang, S. (2019) · IEEE Access · doi:10.1109/access.2019.2937108 · Cited by 46
Congestion free opportunistic multipath routing load balancing scheme for Internet of Things (IoT)
Adil, M. (2020) · Computer Networks · doi:10.1016/j.comnet.2020.107707 · Cited by 46
Learning Based Joint Cache and Power Allocation in Fog Radio Access Networks
Rahman, G., Peng, M., Yan, S., & Dang, T. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.2975849 · Cited by 43
Samanta, R. K., Sadhukhan, B., Samaddar, H., Sarkar, S., Koner, C., & Ghosh, M. (2022) · CAAI Transactions on Intelligence Technology · doi:10.1049/cit2.12114 · Cited by 53
Cai, P., & Zhang, Y. (2020) · Intelligent and Converged Networks · doi:10.23919/icn.2020.0006 · Cited by 47
“[61], the power control and dynamic spectrum access are combined and optimized.”
Background5G Cognitive Radio Networks Using Reliable Hybrid Deep Learning Based on Spectrum Sensing
Mohanakurup, V., Baghela, V. S., Kumar, S., Srivastava, P. K., Doohan, N. V., Soni, M., & Halifa, A. (2022) · Wireless Communications and Mobile Computing · doi:10.1155/2022/1830497 · Cited by 51
RetractedDesign of deep learning model for radio resource allocation in 5G for massive iot device
Saravanan, V., Sreelatha, P. N. K., Atyam, N. R., Madiajagan, M., Saravanan, D., Kumar, T. A., & Sultana, H. P. (2023) · Sustainable Energy Technologies and Assessments · doi:10.1016/j.seta.2023.103054 · Cited by 48
Distributed DRL-Based Downlink Power Allocation for Hybrid RF/VLC Networks
Çiftler, B. S., Alwarafy, A., & Abdallah, M. M. (2021) · IEEE photonics journal · doi:10.1109/jphot.2021.3139678 · Cited by 49
Applications and prospects of artificial intelligence in covert satellite communication: a review
Lu, K., Liu, H., Zeng, L., Wang, J., Zhang, Z., & An, J. (2023) · Science China Information Sciences · doi:10.1007/s11432-022-3566-4 · Cited by 39
“For overcoming the difficulties caused by the random variation of the RSS collected by the sensor, Li et al. [130] used DRL to assist the transmit power control and ensure the QoS of users in the network.”
MethodDeep-EERA: DRL-Based Energy-Efficient Resource Allocation in UAV-Empowered Beyond 5G Networks
Ahmad, S., Zhang, J., Nauman, A., Khan, A. S., Abbas, K., & Hayat, B. (2024) · Tsinghua Science & Technology · doi:10.26599/tst.2024.9010071 · Cited by 43
Deep Q-Learning with Multiband Sensing for Dynamic Spectrum Access
Nguyen, H. Q., Nguyen, B. T., Dong, Q. T., Ngo, D. T., & Nguyen, A.-T. (2018) · IEEE International Symposium on Dynamic Spectrum Access Networks · doi:10.1109/dyspan.2018.8610402 · Cited by 37
Intelligent Dynamic Spectrum Access Using Deep Reinforcement Learning for VANETs
Wang, Y., Li, X., Wan, P., & Shao, R. (2021) · IEEE Sensors Journal · doi:10.1109/jsen.2021.3056463 · Cited by 39
Self-citationLi, M., Zhao, X., Liang, H. P., & Hu, F. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2911544 · Cited by 34
“In [31], [32], the authors use DQN to solve”
MethodCognitive Dynamic Systems: A Review of Theory, Applications, and Recent Advances
Hilal, W., Gadsden, S. A., & Yawney, J. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3272577 · Cited by 46
“As such, we refer the reader to [19] and [62] for surveys on the topic of RL-based spectrum access.”
BackgroundFast Learning for Dynamic Resource Allocation in AI-Enabled Radio Networks
Qureshi, M. A., & Tekin, C. (2019) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2019.2953607 · Cited by 37
“Similarly, [28] studies intelligent power control in cognitive communications by means of deep reinforcement learning but without exploiting the unimodal structure in power levels.”
BackgroundA Deep Q-Learning Method for Downlink Power Allocation in Multi-Cell NetworksPreprint
Ahmed, K. I., & Hossain, E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.13032 · Cited by 52
“In [14], the authors develop a distributed DQL based spectrum sharing approach for primary and secondary users in a non-cooperative fashion.”
Tefera, M. K., Zhang, S., & Jin, Z. (2023) · Entropy · doi:10.3390/e25030413 · Cited by 42
“A distributed DQL-based spectrum-sharing scheme was proposed in [32] for multiple users in a non-cooperative manner.”
BackgroundDeep-Learning-Aided Cross-Layer Resource Allocation of OFDMA/NOMA Video Communication Systems
Tseng, S., Chen, Y., Tsai, C.-S., & Tsai, W. (2019) · IEEE Access · doi:10.1109/access.2019.2950127 · Cited by 30
Olatinwo, S. O., & Joubert, T.-H. (2022) · IEEE Access · doi:10.1109/access.2022.3195898 · Cited by 35
Deep Reinforcement Learning-Based Sum Rate Fairness Trade-Off for Cell-Free mMIMO
Rahmani, M., Bashar, M., Dehghani, M. J., Akbari, A., Xiao, P., Tafazolli, R., & Debbah, M. A. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3230041 · Cited by 39
“In [8], [9], [10], [11] the problem of power allocation is modeled based on single-agent DRL.”
MethodUplink Power Control Framework Based on Reinforcement Learning for 5G Networks
Neto, F. H. C., Araújo, D. C., Mota, M. P., Maciel, T. F., & de Almeida, A. L. F. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3074892 · Cited by 36
Dynamic Spectrum Sharing Based on Deep Reinforcement Learning in Mobile Communication Systems
Liu, S., Pan, C., Zhang, C., Yang, F. C., & Song, J. (2023) · Sensors · doi:10.3390/s23052622 · Cited by 46
“If the i -th SU selects a channel that is not occupied by the PU, the SINR value at the i -th secondary receiver is determined by [1,19] where the channel gain from the i -th transmitter to the i -th receiver and from the k -th transmitter to the i -th receiver are represented by h ii and h ki ,…”
BackgroundAlwarafy, A., Abdallah, M. M., Çiftler, B. S., Al‐Fuqaha, A., & Hamdi, M. (2021) · doi:10.36227/techrxiv.14672643.v1 · Cited by 29
Lin, R., Qiu, H., Wang, J., Zhang, Z., Wu, L., & Shu, F. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3300770 · Cited by 28
“The n th ST S n can obtain an indicator signal from the PR, e.g., the ACK signal, which represents whether the QoS received by the PR is satisfied [34].”
BackgroundAsuhaimi, F. A., Bu, S., Klaine, P. V., & Imran, M. A. (2019) · IEEE Access · doi:10.1109/access.2019.2939827 · Cited by 28
“Therefore, the task becomes learning an optimal policy π that can maximize V π , which can be described as follows [18]”
BackgroundGAN-Based Deep Distributional Reinforcement Learning for Resource Management in Network Slicing
Hua, Y., Li, R., Zhao, Z., Zhang, H., & Chen, X. (2019) · Globecom · doi:10.1109/globecom38437.2019.9014217 · Cited by 31
“On the other hand, DRL has triggered tremendous research attention in the communications and networking area to solve resource allocation issues in some specific fields like power control [14], green communications [15], cloud radio access networks [16], mobile edge computing and caching [17].”
BackgroundLi, Y., Zhao, X., & Liang, H. P. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3002936 · Cited by 34
“The indicator collected here is to observe the size of the loss function (23).”
BackgroundLiu, J., Lin, C. R., Hu, Y., & Donta, P. K. (2022) · Sensors · doi:10.3390/s22062328 · Cited by 33
“Among these variables, the transmit power is usually the only parameter to be considered in many previous works [27,62].”
BackgroundAccurate Path Loss Prediction Using a Neural Network Ensemble Method
Kwon, B., & Son, H. (2024) · Sensors · doi:10.3390/s24010304 · Cited by 34
“Reinforcement learning has been used for power control of base stations, scheduling, load balancing, and many more applications in wireless networks [33–37].”
MethodZhang, J., Xia, W., You, M., Zheng, G., Lambotharan, S., & Wong, K. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.2977340 · Cited by 34
“ining phase1, and hence the complexity during the online transmission phase is greatly reduced. The mostly successful applications of DL in this framework by far is power allocation [37], [38], [39], [40], [41], in which the power vector is treated as the training output, while the channel gains are taken into the inp…”
BackgroundSohaib, M., Jeong, J., & Jeon, S.-W. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3126112 · Cited by 35
Shi, Z., Xie, X., & Lu, H. (2019) · IEEE Access · doi:10.1109/access.2019.2932016 · Cited by 24
Reinforcement Learning for Intelligent Healthcare Systems: A Comprehensive SurveyPreprint
Abdellatif, A. A., Mhaisen, N., Chkirbene, Z., Mohamed, A. M. S., Erbad, A., & Guizani, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.04087 · Cited by 44
“In [96] the authors develop a distributed DQN-based spectrum sharing approach for primary and secondary users in a non-cooperative fashion.”
BackgroundDynamic spectrum access and sharing through actor-critic deep reinforcement learning
Dong, L. F., Qian, Y., & Xing, Y. (2022) · EURASIP Journal on Wireless Communications and Networking · doi:10.1186/s13638-022-02124-4 · Cited by 28
“[20] used deep reinforcement learning for the case of one primary user and one secondary user.”
BackgroundZhang, J., Xia, W., You, M., Zheng, G., Lambotharan, S., & Wong, K. (2020) · Figshare · Cited by 22
DQN-Based Multi-User Power Allocation for Hybrid RF/VLC Networks
Çiftler, B. S., Abdallah, M. M., Alwarafy, A., & Hamdi, M. (2021) · International Conference on Communications · doi:10.1109/icc42927.2021.9500564 · Cited by 22
“Power allocation in these networks is crucial in providing the necessary quality-of-service (QoS) for the applications while reducing the overconsumption of the power and possible interference with other network entities [8].”
BackgroundAlwarafy, A., Abdallah, M. M., Çiftler, B. S., Al‐Fuqaha, A., & Hamdi, M. (2021) · doi:10.36227/techrxiv.14672643 · Cited by 56
Cognitive Radio Made Practical: Forward-Lookingness and Calculated Competition
Ren, J., & Wong, K. (2018) · IEEE Access · doi:10.1109/access.2018.2886607 · Cited by 20
“In enhancing the environment awareness, [12] proposed to deploy sensor nodes at different locations and employ deep learning to optimise the transmit power of a cognitive radio given the sensing information.”
BackgroundA New Smart Router-Throttling Method to Mitigate DDoS Attacks
Xia, S., Guo, S., Bai, W., Qiu, J., Wei, H., & Pan, Z. (2019) · IEEE Access · doi:10.1109/access.2019.2930803 · Cited by 20
“actor-critic approach with insights from the recent success of Deep Q Network (DQN) [23]–[25].”
BackgroundLearning paradigms for communication and computing technologies in IoT systems
Ejaz, W., Basharat, M., Saadat, S., Khattak, A. M., Naeem, M., & Anpalagan, A. (2020) · Computer Communications · doi:10.1016/j.comcom.2020.01.043 · Cited by 22
5G New Radio: Dynamic Time Division Duplex Radio Resource Management Approaches
Samidi, F. S., Radzi, N. A. M., Ahmad, W. S. H. M. W., Abdullah, F., Jamaludin, M. Z., & Ismail, A. (2021) · IEEE Access · doi:10.1109/access.2021.3104277 · Cited by 22
“Other than that, Li et al. [75], establish an apprenticeship-based power control method to share the traditional spectrum with the primary consumer without causing harmful interference.”
BackgroundBENS−B5G: Blockchain-Enabled Network Slicing in 5G and Beyond-5G (B5G) Networks
Singh, S., Babu, C. R., Ramana, K., Ra, I.-H., & Yoon, B. (2022) · Sensors · doi:10.3390/s22166068 · Cited by 19
“developed the criteria for assessing the restrictions of 5G-driven applications (2018) [13].”
BackgroundHe, S., An, Z., Zhu, J., Zhang, M., Huang, Y., & Zhang, Y. (2022) · IEEE Transactions on Communications · doi:10.1109/tcomm.2022.3226487 · Cited by 19
“However, to the best of our knowledge, the problem of joint user scheduling and beamforming design for the downlink of multicell multiuser joint transmission networks is not well solved in the previous literatures [24], [25], [26], [27], [28], [29], [30], [31], [32], [33], [34], [35], [36], [37], [38], [39], [40], as…”
BackgroundKhalek, N. A., Abdolkhani, N., & Hamouda, W. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3416371 · Cited by 19
“The work in [31] introduced a power control strategy based on a DQN within a CR network consisting of a single SU and a primary network with a single PU.”
MethodWang, J., Wang, R., Zheng, Z., Lin, R., Wu, L., & Shu, F. (2024) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2024.3486015 · Cited by 21
“At the beginning of the t -th time block, PT updates its transmission power instanta-neously according to the power control strategy, but SU does not know [32].”
Deep reinforcement learning for resource allocation with network slicing in cognitive radio network
Yuan, S., Zhang, Y., Qie, W., Ma, T., & Li, S. (2020) · Computer Science and Information Systems · doi:10.2298/csis200710055y · Cited by 19
“However, [9] does not consider the channel selection strategy of secondary users.”
BackgroundMethodHan, S., Li, L., & Li, X. (2020) · Sensors · doi:10.3390/s20226519 · Cited by 18
Self-citationHenna, S., Minhas, A. A., Khan, M. S., & Iqbal, M. S. (2022) · Optics Communications · doi:10.1016/j.optcom.2022.129186 · Cited by 22
Li, W., Liu, W., Shao, S., Huang, S., & Song, A. (2023) · IEEE Transactions on Games · doi:10.1109/tg.2023.3263013 · Cited by 20
“…is competent with handling a range of problems in complex environments, such as group decision making [4], [5], [6], speech recognition [7], [8], natural language processing [9], [10], [11], [12], autonomous driving [13], [14], [15], intelligent control [16], [17], [18], and games [19], [20], [21].”
BackgroundKhuntia, P., & Hazra, R. (2019) · Transactions on Emerging Telecommunications Technologies · doi:10.1002/ett.3671 · Cited by 17
“In the work of Li et al, 24 the authors approached a power control strategy for resource sharing in cognitive radios.”
BackgroundFair and Scalable Orchestration of Network and Compute Resources for Virtual Edge Services
Tripathi, S., Puligheddu, C., Pramanik, S., García‐Saavedra, A., & Chiasserini, C. F. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3254999 · Cited by 18
“Several resource allocation problems in computationally constrained environments [12], [13], [14], [15] and other related issues like joint server selection, task offloading, and handover [16], [17], [18], [19], [20], [21], [22], [23] in multi-access edge computing wireless networks have been…”
BackgroundMethodSi, J., Huang, R., Li, Z., Hu, H., Jin, Y., Cheng, J., & Al‐Dhahir, N. (2023) · IEEE Network · doi:10.1109/mnet.130.2200390 · Cited by 18
“The development of software-defined networks (SDNs), network virtualization, resource reconfiguration techniques, cross-layer protocol design, and machine learning offer the possibility to address the limitations of spectrum sharing for CNs [2], [3].”
BackgroundUmar, A., Khalid, Z., Ali, M., Abazeed, M. B., Alqahtani, A., Ullah, R., & Safdar, H. (2023) · Applied Sciences · doi:10.3390/app132212384 · Cited by 19
Lin, R., Qiu, H., Jiang, W., Jiang, Z., Li, Z., & Wang, J. (2023) · Sensors · doi:10.3390/s23020807 · Cited by 15
“Similar to [27], we use the indicator “average number of transition steps,” which is defined as the average number of continuous transition steps agents take from an initial state to a target state, to measure the robustness performance for our proposed algorithm.”
BackgroundMethodInfluentialA Context-Aware Radio Resource Management in Heterogeneous Virtual RANs
Tripathi, S., Puligheddu, C., Chiasserini, C. F., & Mungari, F. (2021) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2021.3115098 · Cited by 16
Sultana, A., Bardalai, A., & Sarma, K. K. (2020) · Neural Processing Letters · doi:10.1007/s11063-020-10270-3 · Cited by 15
Deep Multi-User Reinforcement Learning for Centralized Dynamic Multichannel Access
Cong, Q., & Lang, W. (2021) · International Conference on Intelligent Computing and Signal Processing (ICSP) · doi:10.1109/icsp51882.2021.9408908 · Cited by 14
“According to Federal Communications Commission (FCC), the spectrum in general is severely underutilized with the utilization rate of some bands as low as 15% [2].”
BackgroundYuan, S., Zhang, Y., Ma, T., Cheng, Z., & Guo, D. (2022) · IET Communications · doi:10.1049/cmu2.12527 · Cited by 14
Metadata
- Authors
- Li, X., Fang, J., Cheng, W., Duan, H., Chen, Z., & Li, H.
- Affiliations
- University of Electronic Science and Technology of China (CN)
- Stevens Institute of Technology (US)
- Venue
- IEEE Access
- Published
- 2018
- Volume
- 6
- Pages
- 25463-25473
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2783558323
- Cited by
- 192
- References
- 40
- Citations by year
- 2026: 6 · 2025: 10 · 2024: 17 · 2023: 25 · 2022: 34 · 2021: 37 · 2020: 31 · 2019: 28 · 2018: 4
- FWCI
- 15.48
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- arXiv (Cornell University)
- Funders
- National Science Foundation of China (61522104)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Cognitive Radio Networks and Spectrum Sensing
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Wireless Communication Security Techniques
- Physical Sciences › Computer Science › Computer Networks and Communications › Wireless Communication Networks Research
- Keywords
- spectrum sharing, cognitive radio, transmission power control, deep reinforcement learning, primary and secondary users, sensor nodes, quality of service
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.