Cited by 123Wireless Networks and ProtocolsCognitive Radio Networks and Spectrum SensingAdvanced Wireless Network Optimization

The DOI matches its Crossref record; 36 of the 37 references it cites were found in a registry or an index.

A Deep Actor-Critic Reinforcement Learning Framework for Dynamic Multichannel Access

Open access

Zhong, Chen, Lu, Ziyang, Gursoy, M. Cenk, Velipasalar, Senem·2019·IEEE Transactions on Cognitive Communications and Networking

DOI 10.1109/tccn.2019.2952909

Open this paper in CoChat — free account Open PDF

Abstract

To make efficient use of limited spectral resources, we in this work propose a deep actor-critic reinforcement learning based framework for dynamic multichannel access. We consider both a single-user case and a scenario in which multiple users attempt to access channels simultaneously. We employ the proposed framework as a single agent in the single-user case, and extend it to a decentralized multi-agent framework in the multi-user scenario. In both cases, we develop algorithms for the actor-critic deep reinforcement learning and evaluate the proposed learning policies via experiments and numerical results. In the single-user model, in order to evaluate the performance of the proposed channel access policy and the framework's tolerance against uncertainty, we explore different channel switching patterns and different switching probabilities. In the case of multiple users, we analyze the probabilities of each user accessing channels with favorable channel conditions and the probability of collision. We also address a time-varying environment to identify the adaptive ability of the proposed framework. Additionally, we provide comparisons (in terms of both the average reward and time efficiency) between the proposed actor-critic deep reinforcement learning framework, Deep-Q network (DQN) based approach, random access, and the optimal policy when the channel dynamics are known.

Integrity signals

Registry

Crossref · 10.1109/tccn.2019.2952909

Cites

36 of 36 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
Applications of Deep Reinforcement Learning in Communications and Networking: A Survey
Luong, N. C., Hoang, D. T., Gong, S., Niyato, D. T., Wang, P., Liang, Y., & Kim, D. I. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2916583 · Cited by 2,181
Deep Learning in Mobile and Wireless Networking: A Survey
Zhang, C., Patras, P., & Haddadi, H. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2904897 · Cited by 1,913
Decentralized cognitive MAC for opportunistic spectrum access in ad hoc networks: A POMDP framework
Zhao, Q., Tong, L., Swami, A., & Chen, Y. (2007) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2007.070409 · Cited by 1,587
Monte-Carlo Planning in Large POMDPs
Silver, D., & Veness, J. (2010) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 886
Natural Actor-Critic
Peters, J., & Schaal, S. (2008) · Neurocomputing · doi:10.1016/j.neucom.2007.11.026 · Cited by 738
Deep Multi-User Reinforcement Learning for Distributed Dynamic Spectrum Access
Naparstek, O., & Cohen, K. (2018) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2018.2879433 · Cited by 504

Flagged first, then by citations

Show all 37 references

1 of the 37 references couldn’t be matched to a known paper.

Sorted by citations

Cooperative Multi-Agent Reinforcement-Learning-Based Distributed Dynamic Spectrum Access in Cognitive Radio Networks
Tan, X. L., Zhou, L., Wang, H., Sun, Y., Zhao, H., Seet, B., Wei, J., & Leung, V. C. M. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3168296 · Cited by 133
Deep Reinforcement Learning for Dynamic Spectrum Sensing and Aggregation in Multi-Channel Wireless Networks
Li, Y., Zhang, W., Wang, C., Sun, J. F., & Liu, Y. (2020) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2020.2982895 · Cited by 96
The Frontiers of Deep Reinforcement Learning for Resource Management in Future Wireless HetNets: Techniques, Challenges, and Research Directions
Alwarafy, A., Abdallah, M. M., Çiftler, B. S., Al‐Fuqaha, A., & Hamdi, M. (2022) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2022.3153226 · Cited by 130
Deep Reinforcement Learning for Energy Efficient Routing and Throughput Maximization in Various Networks
Mohanavel, V., Tamilselvi, M., Ramkumar, G., Prabu, R. T., & Anitha, G. (2022) · International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC) · doi:10.1109/i-smac55078.2022.9987395 · Cited by 65
Multi-Channel Opportunistic Access for Heterogeneous Networks Based on Deep Reinforcement Learning
Ye, X., Yu, Y., & Fu, L. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3099495 · Cited by 54
Joint Traffic Control and Multi-Channel Reassignment for Core Backbone Network in SDN-IoT: A Multi-Agent Deep Reinforcement Learning Approach
Wu, T., Zhou, P., Wang, B., Li, A., Tang, X., Xu, Z., Chen, K., & Ding, X. (2020) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2020.3036456 · Cited by 54
A tutorial on AI-powered 3D deployment of drone base stations: State of the art, applications and challenges
Parvaresh, N., Kulhandjian, M., Kulhandjian, H., D’Amours, C., & Kantarcı, B. (2022) · Vehicular Communications · doi:10.1016/j.vehcom.2022.100474 · Cited by 48
Federated Multi-Agent Deep Reinforcement Learning (Fed-MADRL) for Dynamic Spectrum Access
Chang, H.-H., Song, Y., Doan, T. T., & Liu, L. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3233436 · Cited by 47
Deep Dyna-Reinforcement Learning Based on Random Access Control in LEO Satellite IoT Networks
Liu, X., Zhang, H., Long, K., Nallanathan, A., & Leung, V. C. M. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3112907 · Cited by 44
Deep Reinforcement Learning for QoS provisioning at the MAC layer: A Survey
Abbasi, M., Shahraki, A., Piran, M. J., & Taherkordi, A. (2021) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2021.104234 · Cited by 39
Joint Network Control and Resource Allocation for Space-Terrestrial Integrated Network Through Hierarchal Deep Actor-Critic Reinforcement Learning
Shah, H. A., Zhao, L. Y., & Kim, I. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3071983 · Cited by 39
Better Late Than Never: GAN-Enhanced Dynamic Anti-Jamming Spectrum Access With Incomplete Sensing Information
Han, H., Wang, X., Gu, F., Li, W., Cai, Y., Xu, Y., & Xu, Y. (2021) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2021.3081509 · Cited by 36
Routing and Resource Allocation for IAB Multi-Hop Network in 5G Advanced
Yin, H., Roy, S., & Cao, L. (2022) · IEEE Transactions on Communications · doi:10.1109/tcomm.2022.3200673 · Cited by 35
Intelligent Spectrum Sensing and Access With Partial Observation Based on Hierarchical Multi-Agent Deep Reinforcement Learning
Li, X., Zhang, Y., Ding, H., & Fang, Y. M. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3305567 · Cited by 33
Applications of Multi-Agent Deep Reinforcement Learning: Models and Algorithms
Ibrahim, A. M., Yau, K. A., Chong, Y.-W., & Wu, C. (2021) · Applied Sciences · doi:10.3390/app112210870 · Cited by 39
Primary-User-Friendly Dynamic Spectrum Anti-Jamming Access: A GAN-Enhanced Deep Reinforcement Learning Approach
Han, H., Xu, Y., Jin, Z., Li, W., Chen, X., Fang, G., & Xu, Y. (2021) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2021.3125337 · Cited by 30
Hybrid NOMA/OMA-Based Dynamic Power Allocation Scheme Using Deep Reinforcement Learning in 5G Networks
Giang, H. T. H., Hoan, T. N. K., Thanh, P. D., & Koo, I. (2020) · Applied Sciences · doi:10.3390/app10124236 · Cited by 29
Multi-Objective Optimization of Energy Saving and Throughput in Heterogeneous Networks Using Deep Reinforcement Learning
Ryu, K., & Kim, W. (2021) · Sensors · doi:10.3390/s21237925 · Cited by 29
Learning-Aided Dynamic Access Control in MEC-Enabled Green IoT Networks: A Convolutional Reinforcement Learning Approach
Xu, L., Qin, M., Yang, Q., & Kwak, K. S. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3135885 · Cited by 29
Deep Reinforcement Learning for Radio Resource Allocation and Management in Next Generation Heterogeneous Wireless Networks: A SurveyPreprint
Alwarafy, A., Abdallah, M. M., Çiftler, B. S., Al‐Fuqaha, A., & Hamdi, M. (2021) · doi:10.36227/techrxiv.14672643.v1 · Cited by 29
Federated Reinforcement Learning for Wireless Networks: Fundamentals, Challenges and Future Research Trends
Das, S. K., Mudi, R., Rahman, M. S., Rabie, K. M., & Li, X. (2024) · IEEE Open Journal of Vehicular Technology · doi:10.1109/ojvt.2024.3466858 · Cited by 27
Deep Reinforcement Learning for Simultaneous Sensing and Channel Access in Cognitive Networks
Bokobza, Y., Dabora, R., & Cohen, K. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3230872 · Cited by 27
Dynamic Multichannel Access via Multi-Agent Reinforcement Learning: Throughput and Fairness Guarantees
Sohaib, M., Jeong, J., & Jeon, S.-W. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3126112 · Cited by 27
Machine Learning With Computer Networks: Techniques, Datasets, and Models
Afifi, H., Pochaba, S., Boltres, A., Laniewski, D., Haberer, J., Paeleke, L., Poorzare, R., Stolpmann, D., Wehner, N., Redder, A., et al. (2024) · IEEE Access · doi:10.1109/access.2024.3384460 · Cited by 36
Dynamic Multichannel Sensing in Cognitive Radio: Hierarchical Reinforcement Learning
Liu, S., Jiayun, W., & He, J. (2021) · IEEE Access · doi:10.1109/access.2021.3056670 · Cited by 22
Dynamic spectrum access and sharing through actor-critic deep reinforcement learning
Dong, L. F., Qian, Y., & Xing, Y. (2022) · EURASIP Journal on Wireless Communications and Networking · doi:10.1186/s13638-022-02124-4 · Cited by 24
Deep Reinforcement Learning for Radio Resource Allocation and Management in Next Generation Heterogeneous Wireless Networks: A SurveyPreprint
Alwarafy, A., Abdallah, M. M., Çiftler, B. S., Al‐Fuqaha, A., & Hamdi, M. (2021) · doi:10.36227/techrxiv.14672643 · Cited by 23
Multi-Agent Reinforcement Learning Based Uplink OFDMA for IEEE 802.11ax Networks
Han, M., Sun, X., Zhan, W., Gao, Y., & Jiang, Y. (2024) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2024.3355276 · Cited by 19
Deep reinforcement learning-based adaptive fuzzy control for electro-hydraulic servo system
Khater, A. A., Fekry, M., El-Bardini, M., & El-Nagar, A. M. (2025) · Neural Computing and Applications · doi:10.1007/s00521-024-10741-x · Cited by 17
“It requires consistently training the critic without divergence that delays learning and the propagation of value estimations through the target network [16].”
A Usage Aware Dynamic Spectrum Access Scheme for Interweave Cognitive Radio Network by Exploiting Deep Reinforcement Learning
Wang, X., Teraki, Y., Umehira, M., Zhou, H., & Ji, Y. (2022) · Sensors · doi:10.3390/s22186949 · Cited by 17
Decentralized Joint Pilot and Data Power Control Based on Deep Reinforcement Learning for the Uplink of Cell-Free Systems
Braga, I. M., Antonioli, R. P., Fodor, G., Silva, Y. C. B., & Freitas, W. C. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3211908 · Cited by 16
Toward a Fully-Observable Markov Decision Process With Generative Models for Integrated 6G-Non-Terrestrial Networks
Machumilane, A., Cassará, P., & Gotta, A. (2023) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2023.3307209 · Cited by 17
Traffic Priority-Aware Multi-User Distributed Dynamic Spectrum Access: A Multi-Agent Deep RL Approach
Zhang, S., Ni, Z., Kuang, L., Jiang, C., & Zhao, X. (2023) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2023.3307944 · Cited by 17
Multi-Agent Deep Stochastic Policy Gradient for Event Based Dynamic Spectrum Access
Kassab, R., Destounis, A., Tsilimantos, D., & Debbah, M. A. (2020) · IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC) · doi:10.1109/pimrc48278.2020.9217051 · Cited by 17
Learning-Inspired Immune Algorithm for Multiobjective-Optimized Multirobot Maritime Patrolling
Huang, L. Q., Zhou, M., Han, H., Wang, S., & Albeshri, A. A. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3326567 · Cited by 16
Massive connectivity with machine learning for the Internet of Things
Balcı, A., & SOKULLU, R. İ. (2020) · Computer Networks · doi:10.1016/j.comnet.2020.107646 · Cited by 16
A Cognitive Multi-Carrier Radar for Communication Interference Avoidance via Deep Reinforcement Learning
Shan, Z., Liu, P., Wang, L., & Liu, Y. (2023) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2023.3306854 · Cited by 15
Channel Allocation to GAA Users Using Double Deep Recurrent Q-Learning Based on Double Auction Method
Abbass, W., Hussain, R., Abbas, N., Malik, S. A., Javed, M. A., Khan, M. Z., Alsisi, R. H., Noorwali, A., & Pattanaik, P. A. (2023) · IEEE Access · doi:10.1109/access.2023.3326432 · Cited by 15
A Context-Aware Radio Resource Management in Heterogeneous Virtual RANs
Tripathi, S., Puligheddu, C., Chiasserini, C. F., & Mungari, F. (2021) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2021.3115098 · Cited by 16
Resilient Dynamic Channel Access via Robust Deep Reinforcement Learning
Wang, F., Zhong, C., Gursoy, M. C., & Velipasalar, S. (2021) · IEEE Access · doi:10.1109/access.2021.3133506 · Cited by 14
Self-citation
Learning-Based Autonomous Channel Access in the Presence of Hidden Terminals
Shao, Y., Cai, Y., Wang, T., Guo, Z., Liu, P., Luo, J., & Gündüz, D. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3282790 · Cited by 16
Gait Planning, and Motion Control Methods for Quadruped Robots: Achieving High Environmental Adaptability: A Review
Dong, S., Fan, F., Chen, Y., Guo, S., & Liu, J. (2025) · Computer Modeling in Engineering & Sciences · doi:10.32604/cmes.2025.062113 · Cited by 15
DRL-KeyAgree: An Intelligent Combinatorial Deep Reinforcement Learning-Based Vehicular Platooning Secret Key Generation
Kurunathan, H., Li, K., Tovar, E., Jorge, A., Ni, W., & Jamalipour, A. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3410534 · Cited by 12
Joint UAV Trajectory and RadCom Task Schedule for IVNs: A Game-Embedding Multi-Agent Deep Reinforcement Learning Approach
Cheng, S., Lin, X., Li, X., & Wang, J. (2024) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2024.3489624 · Cited by 12
Optimizing Spectrum Utilization and Security in SAS-Enabled CBRS Systems for Enhanced 5G Performance
Abbass, W., Khan, M. A., Farooqi, A. H., Nawaz, W., Abbas, N., & Ali, Z. (2024) · IEEE Access · doi:10.1109/access.2024.3495972 · Cited by 12
Dynamic Spectrum Aggregation and Access for Rescue Cognitive Networks Using Multi-Agent Actor-Critic Reinforcement Learning
Zhang, W., Ding, W., Wang, C., Chen, Y., de Abreu, G. T. F., Liu, Z., Sun, J. F., & Han, Z. (2025) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2025.3567099 · Cited by 12
Deep Reinforcement Learning-Based Scheduling for NR-U/WiGig Coexistence in Unlicensed mmWave Bands
Ye, X., Zhou, Q., & Fu, L. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3275945 · Cited by 11
An effective deep actor-critic reinforcement learning method for solving the flexible job shop scheduling problem
Wan, L., Cui, X., Zhao, H., Li, C., & Wang, Z. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-09654-6 · Cited by 11
A Heterogeneous-Agent Deep Reinforcement Learning Approach for Dynamic Spectrum Access in Cognitive Wireless Networks
Wang, Q., Xu, W., & Chen, H. (2025) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2025.3594035 · Cited by 10
CAPL: Criticality-Aware Adaptive Path Learning for Industrial Wireless Sensor–Actuator Networks
Park, H.-S., Moon, S., Kwak, J., & Park, K. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3217471 · Cited by 10
A Joint Scheme on Spectrum Sensing and Access with Partial Observation: A Multi-Agent Deep Reinforcement Learning Approach
Zhang, Y., Li, X., Ding, H., & Fang, Y. M. (2023) · IEEE/CIC International Conference on Communications in China (ICCC) · doi:10.1109/iccc57788.2023.10233366 · Cited by 9
Learning-Based Traffic Scheduling in Non-Stationary Multipath 5G Non-Terrestrial Networks
Machumilane, A., Gotta, A., Cassará, P., Amato, G. M., & Gennaro, C. (2023) · Remote Sensing · doi:10.3390/rs15071842 · Cited by 9
Dynamic Spectrum Aggregation and Access Scheme Based on Multi-Agent Actor-Critic Reinforcement Learning
Ding, W., Zhang, W., Wang, D., Sun, J. F., & Wang, C. (2021) · International Conference on Wireless Communications and Signal Processing (WCSP) · doi:10.1109/wcsp52459.2021.9613214 · Cited by 9
Dynamic Spectrum Sharing Based on Federated Learning and Multi-Agent Actor-Critic Reinforcement Learning
Yang, T., Zhang, W., Bo, Y., Sun, J. F., & Wang, C. (2023) · International Wireless Communications and Mobile Computing Conference (IWCMC) · doi:10.1109/iwcmc58020.2023.10182572 · Cited by 9
Dynamic Channel Access via Meta-Reinforcement Learning
Lu, Z., & Gursoy, M. C. (2021) · Globecom · doi:10.1109/globecom46510.2021.9685347 · Cited by 8
Self-citation
Intelligent Ultrareliable and Low-Latency Communications: Flexibility and Adaptation
Zhang, J., Xu, X., Han, S., Zhang, K., Zhang, P., & Quek, T. Q. S. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3150490 · Cited by 8
Actor-Critic Scheduling for Path-Aware Air-to-Ground Multipath Multimedia Delivery
Machumilane, A., Gotta, A., Cassará, P., Gennaro, C., & Amato, G. M. (2022) · IEEE Vehicular Technology Conference · doi:10.1109/vtc2022-spring54318.2022.9860760 · Cited by 8
FaaSCtrl: A Comprehensive-Latency Controller for Serverless Platforms
Panda, A., & Sarangi, S. R. (2024) · IEEE Transactions on Cloud Computing · doi:10.1109/tcc.2024.3473015 · Cited by 7
DQN Algorithm Based on Target Value Network Parameter Dynamic Update
Jia, W., Li, J., & Zhao, Y. (2021) · IEEE International Conference on Computer and Communication Engineering Technology (CCET) · doi:10.1109/ccet52649.2021.9544323 · Cited by 7
Priority‐aware intelligent device access management for carbon footprint monitoring in sustainable cites and society
Su, X., Liu, P., Wang, Z., Liao, H., Zhou, Z., Xu, G., Wang, Z., & Qin, Y. F. (2022) · IET Communications · doi:10.1049/cmu2.12551 · Cited by 7
An efficient Actor Critic DRL Framework for Resource Allocation in Multi-cell Downlink NOMA
Alajmi, A., & Ahsan, W. (2022) · Joint European Conference on Networks and Communications & 6G Summit (EuCNC/6G Summit) · doi:10.1109/eucnc/6gsummit54941.2022.9815638 · Cited by 6
Deep Reinforcement Learning for Dynamic Multichannel Access in Multi-Cognitive Radio Networks
Wang, A., Zhang, L., Chen, D., & Chen, J. (2020) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1550/3/032135 · Cited by 6
Sensing-Transmission Tradeoff for Multimedia Transmission in Cognitive Radio Networks
Sheng, X., & Wang, S. (2020) · Globecom · doi:10.1109/globecom42002.2020.9322250 · Cited by 6
Multi-view reinforcement learning for sequential decision-making with insufficient state information
Li, M., Zhu, W., & Wang, S. (2023) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-023-01981-9 · Cited by 5
Double Deep Recurrent Reinforcement Learning for Centralized Dynamic Multichannel Access
Cong, Q., & Lang, W. (2021) · Wireless Communications and Mobile Computing · doi:10.1155/2021/5577756 · Cited by 5
Visual servoing with deep reinforcement learning for rotor unmanned helicopter
Hu, C., Cao, W., & Ning, B. (2022) · International Journal of Advanced Robotic Systems · doi:10.1177/17298806221084825 · Cited by 6
Dynamic Spectrum Access in Non-stationary Environments: A DRL-LSTM Integrated Approach
Feng, M., Zhang, W., & Krunz, M. (2023) · 2012 International Conference on Computing, Networking and Communications (ICNC) · doi:10.1109/icnc57223.2023.10074454 · Cited by 4
Robust dynamic real-time control strategies for high-frequency bus service: a multi-agent reinforcement learning framework
Low, V. J. M., Khoo, H. L., & Khoo, W. C. (2024) · Journal of Intelligent Transportation Systems · doi:10.1080/15472450.2024.2425293 · Cited by 4
Dynamic Multichannel Access via Multi-agent Reinforcement Learning: Throughput and Fairness Guarantees
Sohaib, M., Jeong, J., & Jeon, S.-W. (2021) · International Conference on Communications · doi:10.1109/icc42927.2021.9500945 · Cited by 5
RevAP: A bankruptcy-based algorithm to solve the multi-agent credit assignment problem in task start threshold-based multi-agent systems
Yarahmadi, H., Shiri, M. E., Navidi, H., Sharifi, A., & Challenger, M. (2024) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2024.104631 · Cited by 4
An RL Approach to Radio Resource Management in Heterogeneous Virtual RANs
Tripathi, S., Puligheddu, C., & Chiasserini, C. F. (2021) · Annual Conference on Wireless On-demand Network Systems and Services (WONS) · doi:10.23919/wons51326.2021.9415591 · Cited by 4
Heterogeneous Multi-Agent Reinforcement Learning for Distributed Channel Access in WLANs
Yu, J., Liang, L., Guo, C., Guo, Z., Jin, S., & Li, G. Y. (2026) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2026.3670137 · Cited by 3
Decentralized Grant-Free mMTC Traffic Multiplexing With eMBB Data Through Deep Reinforcement Learning
Gennaro, G. D., Buonanno, A., Romano, G., Buzzi, S., & Palmieri, F. (2024) · IEEE Transactions on Machine Learning in Communications and Networking · doi:10.1109/tmlcn.2024.3467044 · Cited by 5
Long-Term Decision-Optimal Access Mechanism in the Large-Scale Satellite Network: A Multiagent Reinforcement Learning Approach
Zhang, B., Gu, Y., Wang, Y., & Yang, Z. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3521364 · Cited by 3
A Dueling Deep Recurrent Q‐Network Framework for Dynamic Multichannel Access in Heterogeneous Wireless Networks
Chen, H., Zhao, H., Zhou, L., Zhang, J., Liu, Y., Pan, X., Liu, X., & Wei, J. (2022) · Wireless Communications and Mobile Computing · doi:10.1155/2022/9446418 · Cited by 3
A PPA Study of Reinforced Placement Parameter Autotuning: Pseudo-3D vs. True-3D Placers
Murali, G., Agnesina, A., & Lim, S. K. (2023) · ACM Transactions on Design Automation of Electronic Systems · doi:10.1145/3582007 · Cited by 3
A tutorial on reinforcement learning in selected aspects of communications and networking
Boryło, P., Biernacka, E., Domżał, J., Kądziołka, B., Kantor, M., Rusek, K., Skała, M., Wajda, K., Wójcik, R., & Ząbek, W. (2023) · Computer Communications · doi:10.1016/j.comcom.2023.05.019 · Cited by 3
Distributed Resource Management and Task Scheduling in MEC Networks Against Intelligent Eavesdropping Jammer
Liu, S., Xu, Y., Wang, X., Li, W., Li, G., Li, Y., Gong, Y., & Zhang, X. (2024) · IEEE Transactions on Communications · doi:10.1109/tcomm.2024.3487525 · Cited by 3
Dynamic spectrum sharing based on federated learning in smart grids and power communication networks
Wang, X., Yu, Q., Lv, D., Yang, T., Wei, Y., Liu, L., Zhang, P., Zhang, Y., & Zhang, W. (2025) · IET Communications · doi:10.1049/cmu2.12766 · Cited by 3
Coexistence of Shared-Spectrum Radio Systems through Medium Access Pattern Learning using Artificial Neural Networks
Lindner, S., Fisser, L., & Timm‐Giel, A. (2020) · International Teletraffic Congress · doi:10.1109/itc3249928.2020.00028 · Cited by 3
Uncoordinated Grant-Free Radio Access via Diversity for Critical and Non-Critical IoT ServicesPreprint
Kassab, R., Munari, A., Clazzer, F., & Simeone, O. (2020) · arXiv (Cornell University) · Cited by 3
A Survey of AI-Enabled Architectures for Next-Generation Wireless Communication NetworksPreprint
Javed, A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5508578 · Cited by 3
Federated learning-based spectrum and energy efficiency enhancement in HAP-assisted LEO satellite communication
That, V., Muy, S., & Lee, J.-R. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128916 · Cited by 2
Model-Based Deep Reinforcement Learning Framework for Channel Access in Wireless Networks
Park, J. I., Chae, J.-B., & Choi, K. W. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3325575 · Cited by 2
Multi-channel real-time access with starvation avoidance for heterogeneous data in smart factories
Shi, H., Huang, J., Li, H., Ao, T., Wei, L., & Zhou, Y. F. (2025) · Computer Networks · doi:10.1016/j.comnet.2025.111236 · Cited by 2
A multi-agent system for outbound container storage location assignment problem based on hierarchical reinforcement learning
Dong, L., Liu, Y., Zhu, Z., & Yang, F. (2025) · Applied Intelligence · doi:10.1007/s10489-025-06880-w · Cited by 2
Deep Reinforcement Learning-Based Dynamic MultiChannel Access for Heterogeneous Wireless Networks with DenseNet
Zong, K. (2021) · IEEE/CIC International Conference on Communications in China (ICCC) · doi:10.1109/icccworkshops52231.2021.9538886 · Cited by 2
Distributed Learning for 6G–IoT Networks: A Comprehensive SurveyPreprint
Das, S. K., Mudi, R., Rahman, M. S., & Fapojuwo, A. O. (2022) · doi:10.36227/techrxiv.20069051.v1 · Cited by 2
Distributed Learning for 6G–IoT Networks: A Comprehensive SurveyPreprint
Das, S. K., Mudi, R., Rahman, M. S., & Fapojuwo, A. O. (2022) · doi:10.36227/techrxiv.20069051.v2 · Cited by 2
Distributed Learning for 6G–IoT Networks: A Comprehensive SurveyPreprint
Das, S. K., Mudi, R., Rahman, M. S., & Fapojuwo, A. O. (2022) · doi:10.36227/techrxiv.20069051.v3 · Cited by 2
Channel-hopping sequence generation for blind rendezvous in cognitive radio-enabled internet of vehicles: A multi-agent twin delayed deep deterministic policy gradient-based method
Vasfi, M. A., & Ghahfarokhi, B. S. (2025) · Computer Communications · doi:10.1016/j.comcom.2025.108318 · Cited by 1
Integrating Actor–Critic Reinforcement Learning With Evolutionary Algorithm for Multimodal Multiobjective Optimization
Xiang, K., Huang, T., Yang, L., & Lin, J. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3624785 · Cited by 1
Success-Rate-Based Asynchronous Federated Reinforcement Learning for Dynamic Spectrum Access in Time-Varying Environments
He, H., Bian, X., & Li, M. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3647452 · Cited by 1
A Multi-Agent Reinforcement Learning Based MAC Algorithm for FANETs
Hang, T., Yan, F., Shen, F., Xia, W., & 沈连丰 (2025) · International Conference on Future Communications and Networks (FCN) · doi:10.1109/fcn66513.2025.11296654 · Cited by 1
Simultaneous Sensing and Channel Access based on Partial Observations via Deep Reinforcement Learning
Bokobza, Y., Dabora, R., & Cohen, K. (2022) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit50566.2022.9834756 · Cited by 1
RETRACTED ARTICLE: Auto scheduling through distributed reinforcement learning in SDN based IoT environment
Wu, Y. (2023) · EURASIP Journal on Wireless Communications and Networking · doi:10.1186/s13638-023-02314-8 · Cited by 1
Retracted
Deep reinforcement learning enhances artistic creativity: The case study of program art students integrating computer deep learning
Zhao, F. H. (2024) · Journal of Intelligent Systems · doi:10.1515/jisys-2023-0292 · Cited by 1
Malicious Attacks and Defenses for Deep-Reinforcement-Learning-Based Dynamic Spectrum Access
Wang, Z., Huang, Y., Liu, W., & Wang, H. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3513332 · Cited by 1
Multi-Agent Proximal Policy Optimization for Dynamic Multi-Channel URLLC Access
Robaglia, B.-M., Coupechoux, M., & Tsilimantos, D. (2024) · IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC) · doi:10.1109/pimrc59610.2024.10817242 · Cited by 1
Energy-aware Multiple Access Using Deep Reinforcement Learning
Mazandarani, H., & Khorsandi, S. (2021) · Iranian Conference on Electrical Engineering · doi:10.1109/icee52715.2021.9544417 · Cited by 1

Authors: Zhong, C., Lu, Z., Gursoy, M. C., & Velipasalar, S.
Affiliations: Syracuse University (US)
ORCID: Zhong, Chen
Lu, Ziyang
Gursoy, M. Cenk
Velipasalar, Senem
Venue: IEEE Transactions on Cognitive Communications and Networking
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
Published: 2019-12
Volume: 5
Issue: 4
Pages: 1125-1139
ISSN: 2332-7731 (ISSN-L)
2372-2045
DOI: 10.1109/tccn.2019.2952909
OpenAlex: W2983432303
Cited by: 123
References: 37
Citations by year: 2026: 11 · 2025: 15 · 2024: 20 · 2023: 20 · 2022: 21 · 2021: 26 · 2020: 9 · 2019: 1
FWCI: 7.80
Type: journal article
Language: en
Open access: green
arxiv.org
Licence: ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html (vor)
doi.org/10.15223/policy-029 (stm-asf)
doi.org/10.15223/policy-037 (stm-asf)
Locations: IEEE Transactions on Cognitive Communications and Networking (publishedVersion)
arXiv (Cornell University) (submittedVersion)
arXiv (Cornell University)
Topics: Physical Sciences › Computer Science › Computer Networks and Communications › Wireless Networks and Protocols
Physical Sciences › Computer Science › Computer Networks and Communications › Cognitive Radio Networks and Spectrum Sensing
Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Wireless Network Optimization
Keywords: channel switching, multi-agent reinforcement learning, collision probability, deep Q-network comparison, random access, cognitive radio

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

A Deep Actor-Critic Reinforcement Learning Framework for Dynamic Multichannel Access

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks