Learning Radio Resource Management in RANs: Framework, Opportunities, and Challenges
The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
In the fifth generation (5G) of mobile broadband systems, radio resource management (RRM) will reach unprecedented levels of complexity. To cope with the ever more sophisticated RRM functionalities and the growing variety of scenarios, while carrying out the prompt decisions required in 5G, this manuscript presents a lean RRM architecture that capitalizes on recent advances in the field of machine learning in combination with the large amount of data readily available in the network from measurements and system observations. The architecture consists of a learner (or a few), which learns RRM policies directly from the data gathered in the network using a single general-purpose learning framework, and a set of distributed actors, which execute RRM policies issued by the learner and repeatedly generate samples of experience. Thus, the complexity of RRM is shifted to the design of the learning framework, while the RRM algorithms derived from this framework are executed in a computationally efficient distributed manner at the radio access nodes. The potential of this approach is verified in a pair of pertinent scenarios, and future directions on applications of machine learning to RRM are discussed. Although we focus on a mobile broadband context, the concepts proposed hereafter extend to any radio access network technology where one can conceive the idea of a central learning unit gathering data from distributed actors.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In addition, DL for radio resource management in 5G networks is also suggested in [94], and a users location-aware DL method for run-time optimal users association for the maximization of sum-rate in M-MIMO based land mobile radio cellular networks is proposed in [95].”
From Quantum Machine Learning for 6G Communication Networks: State-of-the-Art and Vision for the Future (2019) · cites this paper as [95]
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · cited 15×
“, using the same ANN weights) across different actors, 1 We follow the notation in [8] and note the difference between random variables and their instantiations with capital letters and lower letters, respectively.”
BackgroundMethodInfluentialReinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Andrews, J. G., Buzzi, S., Choi, W., Hanly, S. V., Lozano, A., Soong, A. C. K., & Zhang, J. C. (2014) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2014.2328098 · Cited by 8,106 · cited 1×
“Careful load balancing and efficient inter-cell interference mitigation will be crucial in ultra-dense small cell deployments [1].”
BackgroundAsynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132 · cited 1×
“, [10] or the A3C framework [11]), the intention of this work is to exemplify how one such framework would be deployed in the proposed architecture to produce control policies specialized to individual RRM functionalities.”
BackgroundFive disruptive technology directions for 5G
Boccardi, F., Heath, R. W., Lozano, A., Marzetta, T. L., & Popovski, P. (2014) · IEEE Communications Magazine · doi:10.1109/mcom.2014.6736746 · Cited by 3,709
IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures
Espeholt, L., Soyer, H., Munos, R., Simonyan, K., Mnih, V., Ward, T., Doron, Y., Firoiu, V., Harley, T., Dunning, I., et al. (2018) · arXiv · doi:10.48550/arxiv.1802.01561 · Cited by 1,708 · cited 2×
“, [10] or the A3C framework [11]), the intention of this work is to exemplify how one such framework would be deployed in the proposed architecture to produce control policies specialized to individual RRM functionalities.”
Background(1998) · Springer eBooks · doi:10.1007/978-1-4615-5529-2 · Cited by 1,235
User Association for Load Balancing in Heterogeneous Cellular Networks
Ye, Q., Rong, B., Chen, Y., Al-Shalash, M., Caramanis, C., & Andrews, J. G. (2013) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2013.040413.120676 · Cited by 1,228 · cited 1×
“Removing cell edges requires to address two problems: first, associating users to multiple TRPs for coordinate multipoint (CoMP) operation - a NP-hard task even for single TRP case [13]; second, dynamically forming joint transmission areas between TRPs by optimizing multiple SIR-thresholds per TRP to adjust to changes…”
MethodDesign considerations for a 5G network architecture
Agyapong, P., Iwamura, M., Staehle, D., Kiess, W., & Benjebbour, A. (2014) · IEEE Communications Magazine · doi:10.1109/mcom.2014.6957145 · Cited by 611 · cited 2×
“…which shall integrate new technology components (e.g. massive MIMO, mm-Wave communication, network slicing, vehicular networks, more and broader frequency bands, etc.) with larger optimization domains and tighter latency requirements, RRM is expected to reach unprecedented complexity [1]-[3].”
BackgroundA Q-learning based approach to interference avoidance in self-organized femtocell networks
Bennis, M., & Niyato, D. (2010) · 2010 IEEE Globecom Workshops · doi:10.1109/glocomw.2010.5700414 · Cited by 161 · cited 1×
“IEEE Communications Magazine • September 2018 145 [5] M.”
Background
Research works printed but not linked: 1
- goodfellow, 2016, Deep Learning
Cited by
Items 101–193 of 193
Signal Processing Aspects of Massive MIMO and IRS-Aided Communications
Özdoğan, Ö. (2022) · Linköping studies in science and technology. Dissertations · doi:10.3384/9789179291655 · Cited by 12
Intent-Based Radio Scheduler for RAN Slicing: Learning to Deal With Different Network Scenarios
Nahum, C., D’Oro, S., Batista, P., Both, C. B., Cardoso, K. V., Klautau, A., & Melodia, T. (2025) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2025.3614453 · Cited by 11
“Machine learning techniques, particularly reinforcement learning (RL), can learn from network data and create flexible policies to deal with the wide variety of RRS scenarios in 6G networks [9], [10].”
Bandit-Based Learning-Aided Full-Duplex/Half-Duplex Mode Selection in 6G Cooperative Relay Networks
Νομικός, Ν., Charalambous, T., Trakadas, P. T., & Wichman, R. (2024) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2024.3370476 · Cited by 11
“However, these overheads may severely affect network performance and as a remedy, ML integration in wireless networks has introduced promising gains towards low-complexity network operation (see, for example, [12], [28]).”
BackgroundArchitecting RAN Slicing for URLLC: Design Decisions and Open Issues
Martiradonna, S., Abrardo, A., Moretti, M., Piro, G., & Boggia, G. (2019) · International Symposium on Distributed Simulation and Real Time Applications (DS-RT) · doi:10.1109/ds-rt47707.2019.8958689 · Cited by 11
Applicability Domains of Machine Learning in Next Generation Radio Access Networks
Ferrús, R., Sallent, O., Pérez-Romero, J., & Agusti, R. (2019) · International Conference on Computational Science and Computational Intelligence (CSCI) · doi:10.1109/csci49370.2019.00203 · Cited by 11
“Besides, the combination of Q-learning with deep learning facilitates an efficient learning in large dimensional problems with large number of states and/or actions [15][16].”
BackgroundContext-based Latency Guarantees Considering Channel Degradation in 5G Network Slicing
Nota, A., Saidi, S., Overbeck, D., Kurtz, F., & Wietfeld, C. (2022) · IEEE Real-Time Systems Symposium (RTSS) · doi:10.1109/rtss55097.2022.00030 · Cited by 11
“The work of [7] provides an overview of different ML concepts focusing on handovers between base stations, while [8] studies the impact of newly introduced shortened Transmission Time Interval (TTI) with the 5G standard and its impact on latencies.”
BackgroundMohsenivatani, M., Darabi, M., Parsaeefard, S., Ardebilipour, M., & Maham, B. (2020) · IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC) · doi:10.1109/pimrc48278.2020.9217287 · Cited by 10
“The key point here is that due to the immense computational complexity of large networks, we apply a cen-0 tralized training and distributed execution learning framework to simplify the problem [14].”
MethodSpatio-Radio Resource Management and Hybrid Beamforming for Limited Feedback Massive MIMO Systems
Khammari, H., Ahmed, I., Bhatti, G. M., & Alajmi, M. (2019) · Electronics · doi:10.3390/electronics8101061 · Cited by 10
A Framework for Radio Resource Allocation and SDMA Grouping in Massive MIMO Systems
Maurício, W., Araújo, D. C., Maciel, T. F., & Lima, F. R. M. (2021) · IEEE Access · doi:10.1109/access.2021.3074360 · Cited by 10
“Therefore, the development of new RRA algorithms is particularly challenging into those scenarios [6].”
BackgroundRadio Resource Management Scheme for URLLC and eMBB Coexistence in a Cell-Less Radio Access Network
Kooshki, F., Armada, A. G., Mowla, M. M., & Flizikowski, A. (2023) · IEEE Access · doi:10.1109/access.2023.3256528 · Cited by 9
Optimizing Radio Resources for Radar Services in ISAC Systems by Deep Reinforcement Learning
Smeenk, C., Zhao, Z., Schneider, C., Robert, J., & Galdo, G. D. (2024) · IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC) · doi:10.1109/pimrc59610.2024.10817257 · Cited by 9
Offline Reinforcement Learning and Sequence Modeling for Downlink Link Adaptation
Peri, S., Russo, A., Fodor, G., & Soldati, P. (2025) · IEEE International Conference on Machine Learning for Communication and Networking (ICMLCN) · doi:10.1109/icmlcn64995.2025.11140155 · Cited by 9
“However, training RL agents in live networks requires exploring the state-action space to learn an optimal policy, at the cost of taking suboptimal actions that may adversely affect the network performance [12].”
Self-citationApproaching AI-native RANs through generalization and scalability of learning
Soldati, P., Ghadimi, E., Demirel, B., Wang, Y., Sintorn, M., & Gaigalas, R. (2023) · Ericsson Technology Review · doi:10.23919/etr.2023.10068317 · Cited by 9
Self-citationScheduling for Massive MIMO With Hybrid Precoding Using Contextual Multi-Armed Bandits
Maurício, W., Maciel, T. F., Klein, A., & Lima, F. R. M. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3166654 · Cited by 9
Genetically optimized TD3 algorithm for efficient access control in the internet of vehicles
Al‐Atawi, A. A. (2024) · Wireless Networks · doi:10.1007/s11276-024-03733-1 · Cited by 8
Artificial Intelligence in Future Evolution of Mobile Communication
Dahlman, E., Parkvall, S., Peisa, J., Tullberg, H., Murai, H., & 藤岡, 雅. (2019) · International Conference on Artificial Intelligence in Information and Communication (ICAIIC) · doi:10.1109/icaiic.2019.8669012 · Cited by 8
Bandit-Based Relay Selection in Cooperative Networks Over Unknown Stationary Channels
Νομικός, Ν., Talebi, M. S., Wichman, R., & Charalambous, T. (2020) · Machine learning for signal processing ... · doi:10.1109/mlsp49062.2020.9231604 · Cited by 8
On the Training of Reinforcement Learning-based Algorithms in 5G and Beyond Radio Access Networks
Vilà, I., Pérez-Romero, J., & Sallent, O. (2022) · IEEE International Conference on Network Softwarization (NetSoft) · doi:10.1109/netsoft54395.2022.9844032 · Cited by 7
Intelligent User-Centric Networks: Learning-Based Downlink CoMP Region Breathing
Wang, L., Peters, G., Liang, Y., & Hanzo, L. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.2982319 · Cited by 7
“Fortunately, the rapid advances in the field of machine learning (ML) combined with the abundance of data available in RANs and the recent advances in hardware specialized to handle large data sets, present not only an opportunity to deploy cuttingedge communication technology, but also a chance for creating a paradig…”
BackgroundSelf-citationEnhancing User Fairness in OFDMA Radio Access Networks Through Machine Learning
Comşa, I.-S., Zhang, S., Aydın, M. E., Kuonen, P., Trestian, R., & Ghinea, G. (2019) · IFIP Wireless Days · doi:10.1109/wd.2019.8734262 · Cited by 7
Power Allocation in Multi-user Cellular Networks With Deep Q Learning ApproachPreprint
Meng, F. Y., Chen, P., & Wu, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.02979 · Cited by 8
“of interacting with an unknown environment by exploration and exploitation. The Q learning method is the most well-studied RL algorithm, and it is exploited to cope with power allocation (PA) in [11]–[13], and some others [14]. The DNN trained with Q learning is called deep Q network (DQN), and it is proposed to addre…”
MethodTampubolon, E., Ceribasic, H., & Boche, H. (2020) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2010.10901 · Cited by 7
“, in wireless communication [14]–[18], wireless sensor networks [19], and edge computing [20].”
BackgroundReducing latency and jitter in 5G radio access networks
Ronteix--Jacquet, F. (2022) · theses.fr (ABES) · doi:10.70675/d8048253zf45fz4136z9c3fz3cf364403791 · Cited by 7
Cioffi, J. M., Hwang, C.-S., & Kerpez, K. J. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2958321 · Cited by 6
“ESM can be viewed as a specific example of the intriguing findings and summary in [2], where ESM simplifies determination of some decoupled cloud-based delay-insensitive spectra-assignment and modulation-coding choices through artificial intelligence and learning methods for RRM.”
BackgroundMethodInfluentialPower Allocation in Multi-Agent Networks via Dueling DQN Approach
Xuan, Z., Wei, G., & Ni, Z. (2021) · IEEE International Conference on Signal and Image Processing (ICSIP) · doi:10.1109/icsip52628.2021.9688607 · Cited by 6
Toward Enabling Performance-Guaranteed Networking in Next-Generation Cellular Networks
Kim, J., Shim, B., & Lee, K. (2022) · IEEE Communications Magazine · doi:10.1109/mcom.003.2200051 · Cited by 6
“Considering this network model, based on the actor-learner split architecture [11], a deep RL (DRL) framework with states, actions, and rewards is presented as follows: • State space: The environment state basically includes three-fold information — channel quality, object size, and latency demand — to describe which…”
MethodLi, Y., Yang, B., Li, Y., & Gao, W. (2020) · Future Generation Computer Systems · doi:10.1016/j.future.2019.12.047 · Cited by 6
RetractedLow-Cost, Long-Endurance Cooperative Navigation Based on “Light” Marine Equipment in Deep Sea
Zhang, T., Yan, L., Han, G., Guizani, N., & Liu, J. (2020) · IEEE Network · doi:10.1109/mnet.011.2000443 · Cited by 6
Power Allocation based on Deep Reinforcement Learning in HetNets with Varying user Activity
Chen, Y., & Zhang, H. (2020) · Globecom · doi:10.1109/globecom42002.2020.9322126 · Cited by 6
Lavdas, S., Gkonis, P. K., Zinonos, Z., Trakadas, P. T., & Sarakis, L. (2022) · IEEE Vehicular Technology Conference · doi:10.1109/vtc2022-spring54318.2022.9860566 · Cited by 6
“In the latter case, a mobile agent interacts with the environment and classifies the observed outputs according to the variations in a predefined objective function [9].”
BackgroundA Deep Reinforcement Learning based Scheduler for IoT Devices in Co-existence with 5G-NRPreprint
Jabeen, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.11574 · Cited by 6
Fair Beam Scheduling in LEO Satellite Networks With Reinforcement Learning
Eftetahi, P. S., Cai, L., & Sepahi, A. (2026) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2026.3657104 · Cited by 5
“Simple solutions, such as greedy or round-robin algorithms, can yield quicker solutions, they often come with decreased performance and may sacrifice performance quality [29], [41].”
Bandit-Based Power Control in Full-Duplex Cooperative Relay Networks
Νομικός, Ν., Charalambous, T., & Wichman, R. (2021) · International Conference on Communications · doi:10.1109/icc42927.2021.9501010 · Cited by 5
Continual Model-Based Reinforcement Learning for Data Efficient Wireless Network Optimisation
Hasan, C., Agapitos, A., Lynch, D., Castagna, A., Cruciata, G., Wang, H., & Milenovic, A. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43427-3_18 · Cited by 4
“Previous research has addressed the problem of wireless network parameter optimisation using rule-based methods [10,11], mathematical models [19], or RL [1,3,4,5,8,17,27,30].”
BackgroundOnline Learning Platform for Air Environment Detection and Career Planning Based on 5G Network
Ning, X. (2022) · Mobile Information Systems · doi:10.1155/2022/9981624 · Cited by 4
DAEMON Deliverable 3.1: Initial design of real-time control and VNF intelligence mechanisms
Gramaglia, M., Mhaisen, N., García‐Saavedra, A., Garcia, G., Chang, C., Vleeschauwer, D. D., Molina, M., Slamnik–Kriještorac, N., Soto, P., Camelo, M., et al. (2021) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.5745432 · Cited by 4
A complete survey on artificial intelligence based resource allocation for sixth generation mobile
Amarasooriya, R., Gregory, M. A., & Li, S. (2026) · Ad Hoc Networks · doi:10.1016/j.adhoc.2026.104264 · Cited by 3
Using Neural Networks for Channel Quality Prediction in Wireless 5G Networks
Bobrikova, E., Platonova, A., Medvedeva, E. G., Gaidamaka, Y. V., & Shorgin, S. Y. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-23207-7_11 · Cited by 3
Machine Learning-Enabled Radio Resource Management for Next-Generation Wireless Networks
Elsayed, M. (2021) · uO Research (University of Ottawa) · doi:10.20381/ruor-26696 · Cited by 3
Devipriya, S., & Martin Leo Manickam, J. (2021) · Research Square · doi:10.21203/rs.3.rs-698387/v1 · Cited by 3
Towards Enabling Performance-Guaranteed Slice Management and Orchestration in 6G
Kim, S., Jin, S., Kim, J., & Lee, K. (2023) · Joint European Conference on Networks and Communications & 6G Summit (EuCNC/6G Summit) · doi:10.1109/eucnc/6gsummit58263.2023.10188226 · Cited by 2
“To tackle this, reinforcement learning (RL) based radio resource management (RRM) [10], [11] has been recently proposed.”
BackgroundA Transitional QoE Model Framework for 5G and beyond Networks
Surya, V. (2025) · Journal of Computer and Communications · doi:10.4236/jcc.2025.139002 · Cited by 2
Multi-task meta-initialized DQN for fast adaptation to unseen slicing tasks in O-RAN
Zeng, B., & Niu, X. (2025) · PLoS ONE · doi:10.1371/journal.pone.0330226 · Cited by 2
Multiple Input Multiple Output Schemes in 3G, 4G, and 5G Networks
Pande, M., Kulkarni, A. J., & Shastri, A. (2025) · Springer eBooks · doi:10.1007/978-981-95-1810-4_3 · Cited by 2
Dynamic Predictive Feedback Mechanism for Intelligent Bandwidth Control in Future SDN Networks
Somsuk, K., Khummanee, S., & Songram, P. (2025) · Network · doi:10.3390/network5040054 · Cited by 2
“Calabrese et al. [37] introduced a general learning-driven RRM framework that enables RAN-side adaptation based on user mobility conditions and QoS requirements.”
Deep Transfer Learning in 6G Networks: A Greener Approach for Taming the Complexity
Wang, S., Zaidi, S. A. R., Hafeez, M., Zhang, L., & Tatipamula, M. (2025) · IEEE Communications Standards Magazine · doi:10.1109/mcomstd.2025.3633065 · Cited by 2
“Consequently, mobile network operators (MNOs) should manage and configure network functionalities which operate across different timescales and serve different objectives [1].”
New Bandwidth Upgradation and Degradation Algorithms for Next Generation of Wireless Network Systems
Chaari, H., Mnif, K., Zarai, F., & Kamoun, L. (2020) · Wireless Personal Communications · doi:10.1007/s11277-020-07179-4 · Cited by 2
“In [10], authors describe a new model that allocates guard channel for handovers and introduces the concept of channel borrowing.”
BackgroundTraining Effect on AI-based Resource Allocation in small-cell networks
Anzaldo, A., & Andrade, Á. G. (2021) · IEEE Latin-American Conference on Communications · doi:10.1109/latincom53176.2021.9647736 · Cited by 2
Repetition with Learning Approaches in Massive Machine Type Communications
Chen, L., Ho, C.-H., Chen, C., Liang, Y., & Kuo, S. (2022) · Electronics · doi:10.3390/electronics11223649 · Cited by 2
Cooperative intelligent transport systems for net-zero
Shawky, M. A., Sohaib, R. M., Usman, M., Abbasi, Q. H., Imran, M. A., Ansari, S., & Taha, A. (2023) · doi:10.1049/pbte108e_ch8 · Cited by 2
Transferable Multi-Fidelity Bayesian Optimization for Radio Resource Management
Zhang, Y., Park, S., & Simeone, O. (2024) · IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc60668.2024.10694025 · Cited by 2
“…, m n,i ) , ( x n,j , m n,j )) is defined as in (9), the MFGP posterior mean and variance at any input x with fidelity m given dataset D n,t can be expressed as [9] µ ))] T is the t × 1 cross-variance vector; and ˜ K θ ( X n,t , m n,t ) = K θ ( X n,t , m n,t )+ σ 2 I t is the t × t Gramian matrix.”
BackgroundGuo, P., Yao, F., Miao, Y., Li, C., Tang, Y., & Ning, Z. (2025) · Digital Communications and Networks · doi:10.1016/j.dcan.2025.04.008 · Cited by 2
Zhang, N. (2021) · Journal of Physics Conference Series · doi:10.1088/1742-6596/2066/1/012031 · Cited by 2
RetractedA novel blockchain-based architecture for mobile network operators : Beyond 5G
Ghaffari, F. (2023) · theses.fr (ABES) · doi:10.70675/d554057ez03f5z4477za156z719ac16600d4 · Cited by 2
On optimization formulations for radio resource allocation subject to common transmission rate
Zhao, Y., & Yuan, D. (2023) · Computers & Operations Research · doi:10.1016/j.cor.2023.106427 · Cited by 1
Alauthman, A., & Al-Hyari, A. Y. (2025) · International journal of Computer Networks & Communications · doi:10.5121/ijcnc.2025.17405 · Cited by 1
A Q-learning Based Approach to Spectral Efficiency Maximization in Multiservice Wireless Systems
Saraiva, J. V., Monteiro, V. F., Lima, F. R. M., Maciel, T. F., & Cavalcanti, F. R. P. (2019) · Anais de XXXV Simpósio Brasileiro de Telecomunicações e Processamento de Sinais · doi:10.14209/sbrt.2019.1570557029 · Cited by 1
“Due to its importance for mobile networks, RRA has attracted much interest from industry and academy over past years [1].”
BackgroundMABAMS: Multi-Armed Bandit-Aided Mode Selection in Cooperative Buffer-Aided Relay Networks
Νομικός, Ν., Charalambous, T., & Wichman, R. (2022) · IEEE Globecom Workshops (GC Wkshps) · doi:10.1109/gcwkshps56602.2022.10008754 · Cited by 1
D2D Communication Power Control Based on Deep Q Learning and Fractional Frequency Reuse
Li, W., Jin, J., & Zhao, Y. (2023) · IEEE International Conference on Communication Software and Networks · doi:10.1109/iccsn57992.2023.10297394 · Cited by 1
Artificial intelligence use in cellular communications up to the sixth generation; A review
Raheem, A. T., & Al-Shably, Z. H. (2023) · AIP conference proceedings · doi:10.1063/5.0164659 · Cited by 1
Mobility Prediction Based Resource Management
Imran, M. A., Öztürk, M., Abubakar, A. I., Klaine, P. V., Hussain, S., & Abbasi, Q. H. (2020) · Wiley eBooks · doi:10.1002/9781119471509.w5gref228 · Cited by 1
Sivasankaran, V., Sampathkumar, A., Goyal, S. B., Natarajan, Y., Jule, L. T., Krishnaraj, R., & Elngar, A. A. (2022) · Research Square · doi:10.21203/rs.3.rs-2053623/v1 · Cited by 1
Khan, N. (2022) · doi:10.36227/techrxiv.21685046.v1 · Cited by 1
Latency Reduction in Heterogeneous 5g Networks Integrated With Reinforcement AlgorithmPreprint
Kodavati, B., & Ramarakula, M. (2023) · Research Square · doi:10.21203/rs.3.rs-2906150/v1 · Cited by 1
Tamang, D. (2024) · Electronic Theses and Dissertations Repository (University of Pisa) · Cited by 1
Blockchain-based collaboration framework for B5G and 6G cellular networks
Aryal, N. (2025) · theses.fr (ABES) · doi:10.70675/f74e5464zde7ez44ecz82dbzd4b4e534d3a7 · Cited by 1
Castellá, H. D. (2019) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas)
A NURBS-optimized dRRM solution in a mono-channel condition for IEEE 802.11 entreprise Wlan networks
Guessous, M., & Zenkouar, L. (2020) · International Journal of Power Electronics and Drive Systems/International Journal of Electrical and Computer Engineering · doi:10.11591/ijece.v10i4.pp4189-4207
“In this work [15], the RRM policy is issued by a learner repeatedly to train the general RRM model.”
MethodRadio Resource Management for New Application Scenarios in 5G: Optimization and Deep Learning
Dong, R. (2020) · The Sydney eScholarship Repository (The University of Sydney)
Intelligent and Efficient Ultra-Dense Heterogeneous Networks for 5G and Beyond
Liu, Y. (2020) · Scholarship@Western (Western University)
Traffic control for energy harvesting virtual small cells via reinforcement learning
Temesgene, D. A. (2020) · UPCommons institutional repository (Universitat Politècnica de Catalunya) · doi:10.5821/dissertation-2117-328205
The Need for Cognitive Autonomy in Communication Networks
Mwanje, S. S., Mannweiler, C., & Sanneck, H. (2020) · Wiley eBooks · doi:10.1002/9781119586449.ch1
Modelling and Optimizing for Distributed Systems with limited Resource Migration Capacity
Zhang, H., Lu, N., Song, R., & Li, J. (2020) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1670/1/012026
On Information Asymmetry in Online Reinforcement Learning
Tampubolon, E., Ceribasi, H., & Boche, H. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413968
“Q-learning has been successfully adapted in several applications, reaching from single-device systems [11–13] to networked multi-device systems, found, e.g., in wireless communication [14–18], wireless sensor networks [19], and edge computing [20].”
Use of CAL-AI in Future Wireless Communication Systems
Mahalakshmi, M. (2022) · Advances in educational technologies and instructional design book series · doi:10.4018/978-1-6684-5058-1.ch002
A Self-Adaptive Wireless Network Service Embedding through SVM and MTA
Venkatapathy, S., Ra, I.-H., & Jo, H. (2022) · International Conference on Consumer Electronics · doi:10.1109/icce-berlin56473.2022.9937114
“The fast advancements in ML, which increased as a result of advances in hardware technology specifically designed to support AI, pave the way for the application of AI in NGWNs [7].”
BackgroundTime-Bounded Throughput Guarantees Considering Channel Variations in 5G
Nota, A., Saidi, S., & Palaios, A. (2024) · IEEE International Conference on Emerging Technologies and Factory Automation (ETFA) · doi:10.1109/etfa61755.2024.10710754
“In contrast to already existing works [3] [8] [4], our method is not based on Machine learning (ML) algorithms.”
BackgroundMethodRule-based Spectrum Allocation Algorithms for Heterogeneous Cognitive Radio Wireless Networks
Masonta, M. T. (2024) · IEEE Asia Pacific Conference on Wireless and Mobile (APWiMob) · doi:10.1109/apwimob64015.2024.10792969
“Research efforts are ongoing to find efficient spectrum sharing solutions to support the growing number of heterogeneous wireless network deployments [4], [5].”
SCAR: State-Space Compression for Scalable AI-Based Network Management of Vehicular ServicesPreprint
Comşa, I.-S., Shah, P., Vaidhyanathan, K., Gangadharan, D., Imhof, C., Bergamin, P. B., Kaushik, A., Muntean, G., & Trestian, R. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.06243
“However, RL-based management controllers in such settings face significant challenges due to high-dimensional, multi-agent state spaces, which require effective dimensionality reduction to remain scalable and efficient [25].”
Practical Policy Distillation for Reinforcement Learning in Radio Access Networks
Khosravi, S., Demirel, B., Zhou, L., Suarez, J. R., & Soldati, P. (2025) · IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC) · doi:10.1109/pimrc62392.2025.11274591
Self-citationMachine and deep learning algorithms for radio resource management in 5G and beyond networks
Bartsiokas, I. A. (2023) · DSpace - NTUA (National Technical University of Athens) · doi:10.26240/heal.ntua.25896
Systematic Data-Driven Continual Self-Learning
Corcoran, D. (2023) · DiVA (Digitala Vetenskapliga Arkivet)
Förstärkt inlärning offline för hantering av radioresurser i radioaccessnät
Peri, S. (2024) · DiVA (Digitala Vetenskapliga Arkivet)
Practical Policy Distillation for Reinforcement Learning in Radio Access NetworksPreprint
Khosravi, S., Demirel, B., Zhou, L., Rasines, J., & Soldati, P. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.06563
Self-citationOptimising Open Loop Power Control in Ultra-Dense Wireless Network Using Bayesian Learning Approach
Kolawole, T. V. O. B. O., Dahunsi, F. M., & Abode, D. (2026) · FUOYE Journal of Engineering and Technology · doi:10.4314/fuoyejet.v10i2.8
Diamanti, M., Charatsaris, P., Stai, E., Zafeiropoulos, A., & Papavassiliou, S. (2026) · Synthesis lectures on communications · doi:10.1007/978-3-032-06512-4_4
Systems, Networks, and Digital Communication Technologies: A Comprehensive Review
Mohamed, T. S. (2025) · GlobeIS International Journal of Global Information Systems · doi:10.66395/globeis.1
Al-Shawabka, A., Enhoş, K., Demirors, E., Uvaydov, D., Unal, D., & Melodia, T. (2026) · ITU Journal on Future and Evolving Technologies · doi:10.52953/drjj1766
Machine learning for beam alignment in mmWave networks
Chafaa, I. (2021) · theses.fr (ABES) · doi:10.70675/1b15145cz9cc8z4f82z90cfzb43c5137d2a0
ENERGY-EFFICIENT MOBILE OPERATING SYSTEMS THROUGH INTELLIGENT BACKGROUND PROCESS MANAGEMENT
Nadeem, A., & Zahra, E. (2026) · Computing and Applications reviews · doi:10.64035/car.01.2026.26
Digital-Twin-Assisted Safe DDPG for Joint RAN-MEC Resource Slicing of URLLC and Best-Effort Services
Odhah, N. A., Zargariasl, H., Herglotz, C., Jablonski, I., & Hübner, M. (2026) · International Conference on Smart and Sustainable Technologies (SpliTech) · doi:10.23919/splitech70133.2026.11685509
“Calabrese et al. discuss the general RAN learning framework and its implementation challenges [3], while Bartsiokas et al. survey machine-learning-based radio resource management for 5G and beyond [4].”
LLM-Driven Reward Design for Intelligent RAN Slice Scheduling in Open RAN
Sousa, P., Morte, F. B., de Oliveira, A., Nahum, C., Lins, S., Silva, A., & Klautau, A. (2026) · doi:10.5753/wiarc.2026.22975
Supporting information 5 of Applications and Techniques for Fast Machine Learning in Science
Deiana, A. M., Tran, N., Agar, J., Blott, M., Guglielmo, G. D., Duarte, J., Harris, P., Hauck, S., Liu, M., Neubauer, M. S., et al. (2022) · doi:10.3389/fdata.2022.787421.s005
Metadata
- Authors
- Calabrese, F. D., Wang, L., Ghadimi, E., Peters, G., Hanzo, L., & Soldati, P.
- Affiliations
- Huawei Technologies (Sweden) (SE)
- University of Southampton (GB)
- Venue
- IEEE Communications Magazine
- Published
- 2018-09
- Volume
- 56
- Issue
- 9
- Pages
- 138-145
- ISSN
- 0163-6804 (ISSN-L)
- 1558-1896
- OpenAlex
- W2891171329
- Cited by
- 154
- References
- 15
- Citations by year
- 2026: 6 · 2025: 13 · 2024: 10 · 2023: 17 · 2022: 29 · 2021: 23 · 2020: 39 · 2019: 16 · 2018: 1
- FWCI
- 7.56
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Communications Magazine (publishedVersion)
- ePrints Soton (University of Southampton) (submittedVersion)
- Funders
- Engineering and Physical Sciences Research Council (EP/N004558/1)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Wireless Network Optimization
- Physical Sciences › Computer Science › Computer Networks and Communications › Software-Defined Networks and 5G
- Physical Sciences › Computer Science › Computer Networks and Communications › Wireless Communication Networks Research
- Keywords
- radio resource management, 5G, machine learning, radio access network, distributed learning, network measurement data, mobile broadband, reinforcement learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.