Intelligent Power Control for Spectrum Sharing in Cognitive Radios: A Deep Reinforcement Learning Approach
Open accessThe DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
We consider the problem of spectrum sharing in a cognitive radio system consisting of a primary user and a secondary user. The primary user and the secondary user work in a non-cooperative manner. Specifically, the primary user is assumed to update its transmitted power based on a pre-defined power control policy. The secondary user does not have any knowledge about the primary user's transmit power, or its power control strategy. The objective of this paper is to develop a learning-based power control method for the secondary user in order to share the common spectrum with the primary user. To assist the secondary user, a set of sensor nodes are spatially deployed to collect the received signal strength information at different locations in the wireless environment. We develop a deep reinforcement learning-based method, which the secondary user can use to intelligently adjust its transmit power such that after a few rounds of interaction with the primary user, both users can transmit their own data successfully with required qualities of service. Our experimental results show that the secondary user can interact with the primary user efficiently to reach a goal state (defined as a state in which both users can successfully transmit their data) from any initial states within a few number of steps.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Such dynamic sharing of spectrum aims at enhancing the spectrum utilization efficiency through the provision of access of under-utilized spectrum to the secondary network users [111].”
From Quantum Machine Learning for 6G Communication Networks: State-of-the-Art and Vision for the Future (2019) · cites this paper as [111]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · cited 1×
“The Adam algorithm [28] is adopted for updating the weights θ, where the size of a minibatch is set to 256.”
MethodHuman-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Wireless Communications: Principles and Practice
Rappaport, T. S. (1996) · Cited by 17,370
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
Cognitive radio: brain-empowered wireless communications
Haykin, S. (2005) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2004.839380 · Cited by 11,916 · cited 1×
“In order to improve the spectrum efficiency, the notion of spectrum sharing with secondary users through cognitive radios is highly motivated [2].”
BackgroundPlaying Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471 · cited 1×
“Recently, deep reinforcement learning was introduced and proves its competence for challenging tasks, say Go and Atari games [32]–[34].”
BackgroundWatkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Wireless sensor network survey
Yick, J., Mukherjee, B., & Ghosal, D. (2008) · Computer Networks · doi:10.1016/j.comnet.2008.04.002 · Cited by 6,255
Cited by
Items 101–191 of 191
Zhang, T., & Mao, S. (2019) · IEEE Access · doi:10.1109/access.2019.2961914 · Cited by 14
“There is now an increasing interest on incorporating DRL into the design of wireless networking algorithms [20], such asmobile off-loading [21], dynamic channel access [22], [23], mobile edge computing and caching [24], [25], dynamic base station on and off [26], TCP congestion control [27], and resource allocation [2…”
BackgroundSun, M. Y., Jin, Y., Wang, S., & Mei, E. (2022) · Entropy · doi:10.3390/e24121722 · Cited by 12
Multi-Agent Double Deep Q-Learning for Fairness in Multiple-Access Underlay Cognitive Radio Networks
Ali, Z., Rezki, Z., & Sadjadpour, H. R. (2024) · IEEE Transactions on Machine Learning in Communications and Networking · doi:10.1109/tmlcn.2024.3391216 · Cited by 10
“Considering an underlay CR system, the work in [17] proposed a Q-learning-based framework for power allocation at ST such that the ST can simultaneously transmit with the PT while avoiding the outage at the primary system.”
MethodQuantum-Based Deep Q-Network Bandwidth Resource Allocation Algorithm for UASN
Gao, J., Wang, J., Gu, J., & Shi, W. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3449045 · Cited by 10
Huang, J., Xing, C.-C., Gu, S., & Baker, E. J. (2022) · ACM SIGAPP Applied Computing Review · doi:10.1145/3530043.3530044 · Cited by 11
“We tested DQN Res by adopting the source code of [14] with some modifications(2) in a comparatively simple setting – one D2D link co-exists with one cellular user.”
MethodPower Control for Cognitive Users of Perception Layer in Complex Industrial CPS Based on DQN
Zhang, X., & Li, J. (2021) · IEEE Access · doi:10.1109/access.2021.3057911 · Cited by 10
“In [25], a deep reinforcement learning-based power control method is proposed to adjust transmit power of a CU with assistance of several sensor nodes, where the sensor nodes are used to collect the received signal strength information (RSSI) of the CU at different locations.”
BackgroundMethodDeep Reinforcement Learning for Power Control in Next-Generation WiFi Network Systems
Jamous, Z. E., Davaslıoğlu, K., & Sagduyu, Y. E. (2022) · IEEE Military Communications Conference (MILCOM) · doi:10.1109/milcom55135.2022.10017530 · Cited by 14
“The RL solutions have been studied for general communication systems with various tasks including channel access [3]– [13] and power control [14]–[19].”
BackgroundReliable hybrid deep learning technique for an effective spectrum sensing in cognitive radio
Sivaranjani, S., & Vivek, C. (2023) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-224376 · Cited by 12
RetractedDeep Learning for MANET Routing
Danilchenko, K., Azoulay, R., Reches, S., & Haddad, Y. (2023) · IEEE Transactions on Machine Learning in Communications and Networking · doi:10.1109/tmlcn.2023.3324280 · Cited by 16
“Li et al. [22] considered a cognitive radio system that consisted of a primary user and a secondary user.”
BackgroundDeep Reinforcement Learning for Modulation and Coding Scheme Selection in Cognitive HetNets
Zhang, L., Tan, J., Liang, Y., Feng, G., & Niyato, D. T. (2019) · International Conference on Communications · doi:10.1109/icc.2019.8761663 · Cited by 9
Musaddiq, A., Ali, R., Choi, J., Kim, B.-S., & Kim, S. W. (2021) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2021.014751 · Cited by 13
Dueling deep Q-networks for social awareness-aided spectrum sharing
Wang, Y., Li, X.-Y., Wan, P., Chang, L., & Deng, X. (2021) · Complex & Intelligent Systems · doi:10.1007/s40747-021-00382-1 · Cited by 9
Self-citationPeng, X., Xu, H., Qi, Z., Wang, D., Zhang, Y., Rao, N., & Pang, Y. (2024) · IEEE Communications Letters · doi:10.1109/lcomm.2024.3377447 · Cited by 9
“Most existing studies assume that the sensor can obtain perfect SSI, such as the SSI of sensor n at time t is represented by ˙ O t,n = P ( t ) [11], which is regarded as the observation of sensor n .”
BackgroundMethodInfluentialSpectrum-Agile Cognitive Interference Avoidance Through Deep Reinforcement Learning
Aref, M. A., & Jayaweera, S. K. (2019) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-030-25748-4_17 · Cited by 8
Giang, H. T. H., Hoan, T. N. K., & Koo, I. (2021) · Wireless Networks · doi:10.1007/s11276-020-02520-y · Cited by 7
Jagannath, J., Hamedani, K., Farquhar, C., Ramezanpour, K., & Jagannath, A. (2022) · ACM Workshop on Wireless Security and Machine Learning (WiseML) · doi:10.1145/3522783.3529530 · Cited by 14
“For each experiment 1000 packets were transmitted and in total 16 experiments were performed where each experiment corresponded to a different combination of # of Experiment 2 4 6 8 10 12 14 16 E st im at ed P o w er 0 0.2 0.4 0.6 0.8 1 DCPC Average Power of 3 Pairs DRL Average Power of 3 Pairs Figure 8: Estimated pow…”
MethodInfluentialDeep Q-network Based Reinforcement Learning for Distributed Dynamic Spectrum Access
Yadav, M. A., Li, Y., Fang, G., & Shen, B. (2022) · International Conference on Computer Communication and Artificial Intelligence (CCAI) · doi:10.1109/ccai55564.2022.9807797 · Cited by 7
“There are several works [15], [16] that use a single Q-network for selecting action as well as updating the Q-values associated with a particular state-action pair.”
BackgroundDecentralized Wireless Resource Allocation with Graph Neural Networks
Wang, Z., Eisen, M., & Ribeiro, A. (2020) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/ieeeconf51394.2020.9443326 · Cited by 9
Zuo, Y., Li, Q., Lu, G., & Xiong, H. (2021) · IEEE Access · doi:10.1109/access.2021.3100260 · Cited by 6
“So far, there have been some successful studies for optimization problems of channel selection and power control [32]–[38].”
BackgroundA Learning Approach Towards Power Control in Full-Duplex Underlay Cognitive Radio Networks
Lu, M., Zhou, B., Bu, Z., & Zhao, Y. (2022) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc51071.2022.9771806 · Cited by 6
“In [10], a power control problem in HD underlay CRNs was studied.”
BackgroundMethodInfluentialSmooth Deep Reinforcement Learning for Power Control for Spectrum Sharing in Cognitive Radios
Dang, L., Wang, W., Tse, C. K., Lau, F. C. M., & Wang, S. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3185545 · Cited by 6
“Then, parameter θ in (9) is optimized by minimizing the difference between estimated Q -values and constructive targets [5], i.e., where Ω k and j Ω k j denote the index set of the randomly chosen minibatch at discrete time k and its corresponding cardinality.”
BackgroundMethodInfluentialYe, Z., Wang, Y., & Wan, P. (2020) · Complexity · doi:10.1155/2020/1628023 · Cited by 6
“We also adopt the more intelligent strategy proposed in [22] as follows: Pi(t + 1) � Pi(t) + ΔP, SINRi(t)≤ μi and SINRi ′(t)≥ μi,”
Multi-Agent Reinforcement Learning for Dynamic Spectrum Access
Jiang, H., Wang, T., & Wang, S. (2019) · International Conference on Communications · doi:10.1109/icc.2019.8761786 · Cited by 6
Deep Reinforcement Learning for Distributed Uncoordinated Cognitive Radios Resource AllocationPreprint
Tondwalkar, A. V., & Kwasinski, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.03366 · Cited by 7
“In [3], a single-agent power control Deep Q-learning (DQL) technique was introduced for an underlay CR system consisting of a single primary and a single secondary link.”
MethodAn Offline Multi-Agent Reinforcement Learning Framework for Radio Resource Management
Eldeeb, E., & Alves, H. (2025) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2025.3599918 · Cited by 15
“Then, [26] proposes a deep RL algorithm for the spectrum sharing and resource allocation problem in cognitive radio systems.”
Over-the-Air Modulation Classification using Deep Learning in Fading Channels for Cognitive Radio
Arjun, K. R., & Surekha, T. P. (2021) · Indian Journal of Science and Technology · doi:10.17485/ijst/v14i46.2073 · Cited by 5
“As illustrated in Figure 2 (18) , Networks that use Deep Neural Networks are made up of a number of hidden layers.”
Distributed and Secure Uplink Power Control in Dynamic Spectrum Access
Lin, Y., Yang, Y., Du, X., & Wu, J. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3183078 · Cited by 5
“Second group of approaches [6], [7] focus on distributed SU power control strategies, where SUs distributively adapt the transmit power based on some optimal formulation with target objective and constraints.”
BackgroundDai, P., Wang, H., Hou, H., Qian, X., & Yu, W. (2024) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2024.3360305 · Cited by 5
“In recentyears,theRLhasalsobeenappliedinwirelesscommuni-cation,particularlyinthechannelselectionproblems[23],[24], [25]andpowerallocationproblems[26],[27],[28].”
Uncertainty Propagation in Neural Network Enabled Multi-Channel Optimisation
Li, C., Sun, S. C., Al–Rubaye, S., Tsourdos, A., & Guo, W. (2020) · IEEE Vehicular Technology Conference · doi:10.1109/vtc2020-spring48590.2020.9128702 · Cited by 5
“Other power allocation employ DRL, which adds a learning agent [10], [11].”
MethodProximal Policy Optimization Based Continuous Intelligent Power Control in Cognitive Radio Network
Fan, Z., Xianzhong, X., Shi, Z., & Chen, X. (2020) · IEEE International Conference on Computer and Communications (ICCC) · doi:10.1109/iccc51575.2020.9345062 · Cited by 6
“The authors in [5] leveraged DQN algorithm to realize the power control of SU to share the spectrum of PU in non-cooperative cognitive radio networks, environment sensing is achieved through sensors deployed in the communication environment.”
BackgroundDouble Deep Recurrent Reinforcement Learning for Centralized Dynamic Multichannel Access
Cong, Q., & Lang, W. (2021) · Wireless Communications and Mobile Computing · doi:10.1155/2021/5577756 · Cited by 5
“According to Federal Communications Commission (FCC), the spectrum is severely underutilized with the utilization rate of some bands as low as 15% in general [2].”
BackgroundChannel Estimation for Spectrum Sharing in Massive MIMO Communications
Pourgharehkhan, Z., Shahbazpanahi, S., Bavand, M., & Boudreau, G. (2023) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2023.3261304 · Cited by 5
Heterogeneous Transfer in Deep Learning for Spectrogram Classification in Cognitive Communications
Cody, T., & Beling, P. A. (2021) · IEEE Cognitive Communications for Aerospace Applications Workshop (CCAAW) · doi:10.1109/ccaaw50069.2021.9527298 · Cited by 5
Du, Z., Deng, Y., Guo, W., Nallanathan, A., & Wu, Q. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.05054 · Cited by 5
“anism Random Access Control [4] historical number of idle, collided number of allocated RACH, full connection value function and successful channels preambles and repetition values Power Control [5], [6] require load and interference values; power allocation (continuous); convolution layer; policy based; RSS measureme…”
BackgroundPower Allocation for Full-Duplex Communication Systems Based on Deep Deterministic Policy Gradient
Qu, J., Zhu, C., Liu, S., Yu, G., & Yin, R. (2020) · IEEE Globecom Workshops (GC Wkshps) · doi:10.1109/gcwkshps50303.2020.9367558 · Cited by 4
“A DRL-based algorithm is proposed in [13] for users to intelligently control its power in cognitive radio system.”
MethodSinghal, C., & Thanikaiselvan, V. (2022) · International journal of Computer Networks & Communications · doi:10.5121/ijcnc.2022.14401 · Cited by 4
“Authors in [7] [8] to improve Signal-to-Noise Ratio (SNR) and packet delivery statistics and f) Energy Efficiency method[9] to reduce energy consumption.”
MethodGeneralization of Deep Reinforcement Learning for Jammer-Resilient Frequency and Power Allocation
Kafle, S., Jagannath, J., Kane, Z., Biswas, N., Kumar, P. S. V., & Jagannath, A. (2023) · IEEE Communications Letters · doi:10.1109/lcomm.2023.3274594 · Cited by 4
“In the last decade, several classes of machine learning algorithms were developed that have expedited research and development in different domains, including the wireless networks [1], [2], [3], [4],”
BackgroundYang, D., Tao, Y., Cui, C., & Zhang, L. (2018) · International Conference on Cloud Computing and Internet of Things (CCIOT) · doi:10.1145/3291064.3291077 · Cited by 4
“In [11], a deep reinforcement learning-based method was developed to ensure that both the secondary user and the primary user can transmit their respective data successfully.”
MethodRecent Advances on Artificial Intelligence in Cognitive Radio Networks
Benmammar, B. (2020) · International Journal of Wireless Networks and Broadband Technologies · doi:10.4018/ijwnbt.2020010102 · Cited by 4
An RL Approach to Radio Resource Management in Heterogeneous Virtual RANs
Tripathi, S., Puligheddu, C., & Chiasserini, C. F. (2021) · Annual Conference on Wireless On-demand Network Systems and Services (WONS) · doi:10.23919/wons51326.2021.9415591 · Cited by 4
“In a similar setting, [19] investigates a deep learning dynamic power control for a secondary user to coexist with the primary user.”
BackgroundTondwalkar, A. V., & Kwasinski, A. (2025) · IEEE Access · doi:10.1109/access.2025.3534657 · Cited by 6
“In [24], a single agent power control deep Q-learning (DQL) technique was introduced for an underlay CR system consisting of a single primary and secondary link.”
Jiang, J., Qiu, Y., Su, Y. T., & Zhou, J. (2021) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1827/1/012071 · Cited by 3
“And a research applied a reinforcement learning-based solution to facilitate bandwidth allocation, but it didn’t consider the allocation on time slot [10,11].”
MethodMulti-Agent Reinforcement Learning for Distributed Cooperative Vehicular Positioning
Tedeschini, B. C., Brambilla, M., Nicoli, M., & Win, M. Z. (2024) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2024.3471909 · Cited by 9
“Thisapproachhasbeensuccessfullyappliedin severalfields,varyingfromrateandpowercontrol[66],[67], [68],[69]todynamicspectrumaccessinmulti-userscenarios andefficientschedulinginvehicularnetworks[70],[71],[72], [73].”
Adaptive RL-driven spectrum allocation in multi-cell cognitive B5G networks
Salameh, H. B., Shatara, M., Halloush, R. D., Musa, A., & Alhafnawi, M. (2025) · Wireless Networks · doi:10.1007/s11276-025-03940-4 · Cited by 3
“In [22], a DRL-based spectrum sharing was proposed to enable SUs to dynamically control their power to maintain acceptable performance levels for PUs and SUs.”
Zheng, W., Wu, G., Qie, W., & Zhang, Y. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-37429-7_69 · Cited by 3
Power Control Based on Deep Q Network with Modified Reward Function in Cognitive Networks
Ye, F., Zhang, Y., Li, Y., Jiang, T., & Li, Y. (2020) · USNC-URSI Radio Science Meeting · doi:10.23919/usnc/ursi49741.2020.9321658 · Cited by 3
“Moreover, there are N sensor nodes to spatially collect the received signal strength information[5].”
BackgroundMethodInfluentialDistributed Deep Reinforcement Learning for Collaborative Spectrum SharingPreprint
Pawar, P. M., & Leshem, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.02059 · Cited by 3
“Spectrum resource allocation in a cognitive radio network is explored in [8].”
BackgroundOptimizing Spectrum Efficiency in Hybrid Cognitive Radios Through Unsupervised Learning
Khalek, N. A., & Hamouda, W. (2024) · Globecom · doi:10.1109/globecom52923.2024.10901689 · Cited by 2
“The level of interference tolerated by the primary network is dependent on the currently active PUs [4], [5].”
Hanjani, Z. T., Mohammadi, A., Dosaranian‐Moghadam, M., & Kazemi, M. (2022) · Transactions on Emerging Telecommunications Technologies · doi:10.1002/ett.4470 · Cited by 2
“The authors in Reference 22 propose a spectrum sharing scheme in a CRN via a deep reinforcement learning-based PC method for secondary users with using sensor nodes at various locations.”
BackgroundResource optimization-based network selection model for heterogeneous wireless networks
Nayakwadi, N. B., & Fatima, R. (2022) · IAES International Journal of Artificial Intelligence · doi:10.11591/ijai.v12.i1.pp357-366 · Cited by 3
A Petri Net Model for Cognitive Radio Internet of Things Networks Exploiting GSM Bands
Serrano, S., & Scarpa, M. L. (2023) · Future Internet · doi:10.3390/fi15030115 · Cited by 2
Secrecy-Enabled Resource Allocation in Cloud-Assisted Iot Networks
Dubey, K., Pandey, S., & Kumar, S. (2022) · Transactions on Emerging Telecommunications Technologies · doi:10.1002/ett.4870 · Cited by 3
Deep Reinforcement Learning Applications For Coexistence in Television Whitespace: A Mini-Review
Ukpong, U. C., Idowu-Bismark, O. B., Adetiba, E., Dare, O. E., Owolabi, E., & Kala, R. J. (2024) · International Conference on Science, Engineering and Business for Driving Sustainable Development Goals (SEB4SDG) · doi:10.1109/seb4sdg60871.2024.10629684 · Cited by 2
“As a result, it might not be practical to implement a cooperative approach for all secondary users [10].”
BackgroundA Survey of Deep Learning for Tactical Wireless Networks
Pawgasame, W. (2018) · Asian Conference on Defence Technology · doi:10.1109/acdt.2018.8593210 · Cited by 3
“spectrum sharing MAC protocol DQN [38], [39], [40], [41] availability reliability - Providing adaptive optimal solution - Finding solution quicker - Poor value function leads to system failure”
BackgroundArtificial Intelligence Application to Cognitive Radio Networks
Benmammar, B., & Amraoui, A. (2021) · Wiley eBooks · doi:10.1002/9781119817840.ch9 · Cited by 2
Li, W., Zheng, Z., Zheng, H., & Guan, Y. (2024) · Electronics Letters · doi:10.1049/ell2.70076 · Cited by 1
Software Defined Radio based Emulation of SAT-Terrestrial Network Coexistence
Mandava, S., Rashid, R. B., Vosoughitabar, S., Wu, C. M., Seskar, I., & Mandayam, N. B. (2025) · Globecom · doi:10.1109/globecom59602.2025.11432315 · Cited by 1
“Authors of [12] leverage COTS resources and implement a deep reinforcement learning approach.”
Li, X., Zhou, W., Zhang, H., Zhao, J., Zhao, D., & Dong, Z. (2023) · International Conference on Computer and Communication Systems (ICCCS) · doi:10.1109/icccs57501.2023.10150951 · Cited by 1
Self-citationSimulation of Intelligent Control Model of Electric Power System Based on Improved Genetic Algorithm
Zhao, T., Huang, L., Lin, M., Tian, R., & Fu, E. (2023) · International Conference on Artificial Intelligence and Autonomous Robot Systems (AIARS) · doi:10.1109/aiars59518.2023.00102 · Cited by 1
“Generally speaking, the purpose of reactive power optimization includes ensuring the reasonable balance of reactive power distribution in the system, controlling the voltage of power network in the normal range and reducing line loss[6].”
BackgroundHou, Z. (2023) · International Conference on Power, Electrical Engineering, Electronics and Control (PEEEC) · doi:10.1109/peeec60561.2023.00183 · Cited by 1
“Interconnected EPS is composed of several subsystems connected by tie lines, each subsystem has its own control center, and the control centers of each subsystem operate in coordination[11].”
BackgroundDynamic Power Control Method Based on Stacked SRU Network Combined with NoisyNet DQN for CRN
Wang, L., Wang, Y., & Zheng, B. (2023) · International Conference on Mobility, Sensing and Networking (MSN) · doi:10.1109/msn60784.2023.00028 · Cited by 1
Power Control in Energy Harvesting Multiple Access System with Reinforcement Learning
Chu, M., Liao, X., Li, H., & Cui, S. R. (2019) · Globecom · doi:10.1109/globecom38437.2019.9014132 · Cited by 1
“…the transmission power (in unit) of each UE is chosen from a predefined discrete set P = f 0 : 5 ; 1 : 0 ; 1 : 5 ; (cid:1) (cid:1) (cid:1) ; C g [12]; and 4) a modified version of linear water-filling algorithm [20], where the sum of the available uplink transmission power is set to be the total…”
BackgroundMethodSelf-citationDeep Reinforcement Learning for Spectrum Sharing in Future Mobile Communication System
Liu, S., Wang, T., Pan, C., Zhang, C., Yang, F. C., & Song, J. (2021) · IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB) · doi:10.1109/bmsb53066.2021.9547161 · Cited by 1
Deep Reinforcement Learning for Resource Allocation in Multi-cell Cellular Networks
Sun, M. Y., Hu, L., Wang, Y., Zhang, H., & Wang, J. (2021) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-3-030-92632-8_43 · Cited by 1
Reinforcement Learning-Based Interference Avoidance in Cognitive Radio Networks
Chen, J., Zhang, L., & Wang, A. (2020) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1550/5/052021
“The difference between [9] is that the number of transition steps is the number of adjustments required before reaching success.”
BackgroundMethodInfluentialDeep Learning for QoS-Aware Resource Allocation in Cognitive Radio Networks
Martyna, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-55789-8_28
Contextual multi-armed bandits with structured payoffs
Qureshi, M. A. (2020) · Bilkent University Institutional Repository (Bilkent University)
Sohaib, M., Jeong, J., & Jeon, S.-W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.04077
“Similarly in [22], [23], spectrum sharing strategies have been developed for cognitive radios, where primary and secondary users operate in a non-cooperative manner.”
BackgroundSpectrum Management Issues in Centralized and Distributed Dynamic Spectrum Access
Lin, Y. (2021) · VTechWorks (Virginia Tech)
Medium Access Control protocol for Collaborative Spectrum Learning in Wireless NetworksPreprint
Boyarski, T., Wang, W., & Leshem, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.12581
“DRL for power control of secondary users is explored in [39].”
BackgroundPower control of spectrum sharing for USVs via deep Q-networks
Zhu, S., Liu, S., Feng, S., Huang, M., & Sun, B. (2022) · International Conference on Cloud Computing, Performance Computing, and Deep Learning (CCPCDL) · doi:10.1117/12.2640882
“The power distribution problem was settled by the Deep Q-Network(DQN) 6 .”
BackgroundMethodCui, Z., Xu, W., Liu, P., Huang, Z., Zhang, Y., Wei, T., Qin, Z., Tang, J., & Feng, Y. (2022) · International Conference on Inventive Research in Computing Applications (ICIRCA) · doi:10.1109/icirca54612.2022.9985605
“As an effective tool for the monitoring, measuring and predicting short-term operational risks of the core system, operational reliability assessment will then provide decision support for the planning, operation and transaction of the integrated energy system, and play an important role in then ensuring the safe and…”
MethodSun, H., Hu, R. Q., & Qian, Y. (2023) · Wiley eBooks · doi:10.1002/9781119089469.biblio
Sultana, A., Bardalai, A., & Sarma, K. K. (2023) · Algorithms for intelligent systems · doi:10.1007/978-981-99-1431-9_39
Ahmadi, N., Kourtessis, P., & Senior, J. M. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4632577
Density-based anti-clustering for scheduling D2D communications
Elsheikh, A., Ibrahim, A. S., & Ismail, M. H. (2024) · Wireless Networks · doi:10.1007/s11276-023-03635-8
“…is one of the most challenging tasks in communication networks where previous research explored DL in power allocation in the framework of reinforcement learning and fusion [9–11], to learn optimization solutions for spectrum sharing [12], and to solve linear sum assignment problems [13].”
GPER-DDPG-Based Offloading Optimization for UAV-Assisted Mobile Edge Computing
Yu, S., Zhang, X., & Guo, Z. (2024) · Advances in transdisciplinary engineering · doi:10.3233/atde240511
Introductions and Preliminaries
Zhang, L., Xiao, M., Wang, Z., & Tang, W. (2024) · SpringerBriefs in computer science · doi:10.1007/978-981-97-7644-3_1
Da, H., Xiao, F., Ma, Z., Zhang, Z. S., & Guo, Q. (2025) · Telecommunication Systems · doi:10.1007/s11235-024-01256-w · Cited by 2
Zheng, Z., Li, W., Zheng, H., & Guan, Y. (2024) · IEEE International Conference on Computer and Communications (ICCC) · doi:10.1109/iccc62609.2024.10942187
“A learning-based power control method is developed to realize intelligent spectrum sharing in [9].”
To Trust or Not to Trust: On Calibration in ML-Based Resource Allocation for Wireless Networks
Raina, R., Simmons, N., Simmons, D. E., Yacoub, M. D., & Duong, T. Q. (2025) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2025.3636073 · Cited by 4
“…(DRL), for a wide range of wireless communication tasks, including mobile networking [19], [20], [21], spectrum sharing in cognitive radio networks [22], scheduler design [23], [24], [25], resource allocation [26], [27], [28], [29], [30], [31], [32], [33], [34], and energy efficiency optimization…”
Double Deep Q-Network Techniques for Optimizing Performance of 6G Wireless Network
Kamal, Y. B., & Abdulkafi, A. A. (2025) · Wasit Journal of Engineering Sciences · doi:10.31185/wjes.vol13.iss4.726
“The weights of the online network are denoted as ℎ h , whereas the weights of the target network are designated as ℎ i .”
RL-Based Joint Latency Optimization for Software-Defined Wireless Cloud Fog Automation
Liu, Y., Pang, Z., Lu, R., & Ding, Y. (2025) · IEEE International Conference on Industrial Informatics (INDIN) · doi:10.1109/indin64977.2025.11279109
Spectrum Sharing and Cognitive Radio Applications for Urban Congestion in Klang Valley
Leong, W. Y. (2025) · RIVF International Conference on Computing and Communication Technologies (RIVF) · doi:10.1109/rivf68649.2025.11365181
Machine learning based power control in cellular and cell-free massive MIMO systems
Ahmadi, N., & Akbarizadeh, G. (2026) · Scientific Reports · doi:10.1038/s41598-026-38685-3 · Cited by 1
Zaidi, A. H. B., Asuhaimi, F. A., Ismail, A. I. B., Razali, M. A. I. B. M., Suhaimi, N. S., & Ramli, H. A. M. (2025) · International Conference on Computer and Communication Engineering · doi:10.1109/iccce66530.2025.11474131
Reinforcement learning Double Deep Q-Network Techniques for NextG Network
Kamal, Y. B., & Abdulkafi, A. A. (2026) · Wireless Personal Communications · doi:10.1007/s11277-026-12048-7
“The goal Q-value presented as follows [15]: The DDQN algorithm uses two maximum function estimators to differentiate action selection from value evaluation, replicating overestimation for a balanced Q-value [10]: Equation (35) illustrates that the estimation weights h m are utilized to determine…”
Actor-critic based deep reinforcement learning framework for underlay communication
Srivastava, V., & Prasad, B. (2026) · Wireless Networks · doi:10.1007/s11276-026-04161-z
“The work in [ 28 ] proposed a DQN-based strategy for power control in a cognitive radio network with a single secondary and primary user.”
Shaghluf, N., & Gulliver, T. A. (2026) · Wireless Networks · doi:10.1007/s11276-026-04176-6 · Cited by 1
“Cooperative spectrum prediction using Hidden Markov Models was investigated in [ 32] to improve spectrum sensing performance in CRNs. DRL-based spectrum access schemes for secondary users were explored in [ 33, 34 ].”
Chen, L., & Xu, X. (2026) · International Conference on Automation Control, Algorithm and Intelligent Bionics (ACAIB) · doi:10.1145/3828836.3828921
Yu, F., Li, Y., Yao, M., Tian, Q., & Zuo, W. (2026) · International Conference on Electromagnetic Engineering & Microwave Systems (EEMS) · doi:10.1109/eems71485.2026.11737351
“…effectiveness of the UAV swarm more intuitively, the jamming evaluation function is designed as (10) By jointly considering the jamming effectiveness and the power consumption of the UAVs, the comprehensive evaluation function is designed as where W I and W P are weighting coefficients [6]–[8].”
Metadata
- Authors
- Li, X., Fang, J., Cheng, W., Duan, H., Chen, Z., & Li, H.
- Affiliations
- University of Electronic Science and Technology of China (CN)
- Stevens Institute of Technology (US)
- Venue
- IEEE Access
- Published
- 2018
- Volume
- 6
- Pages
- 25463-25473
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2783558323
- Cited by
- 192
- References
- 40
- Citations by year
- 2026: 6 · 2025: 10 · 2024: 17 · 2023: 25 · 2022: 34 · 2021: 37 · 2020: 31 · 2019: 28 · 2018: 4
- FWCI
- 15.48
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- arXiv (Cornell University)
- Funders
- National Science Foundation of China (61522104)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Cognitive Radio Networks and Spectrum Sensing
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Wireless Communication Security Techniques
- Physical Sciences › Computer Science › Computer Networks and Communications › Wireless Communication Networks Research
- Keywords
- spectrum sharing, cognitive radio, transmission power control, deep reinforcement learning, primary and secondary users, sensor nodes, quality of service
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.