Deep Reinforcement Learning based Resource Allocation in Low Latency Edge Computing Networks
The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
In this paper, we investigate strategies for the allocation of computational resources using deep reinforcement learning in mobile edge computing networks that operate with finite blocklength codes to support low latency communications. The end-to-end (E2E) reliability of the service is addressed, while both the delay violation probability and the decoding error probability are taken into account. By employing a deep reinforcement learning method, namely deep Q-learning, we design an intelligent agent at the edge computing node to develop a real-time adaptive policy for computational resource allocation for offloaded tasks of multiple users in order to improve the average E2E reliability. Via simulations, we show that under different task arrival rates, the realized policy serves to increase the task number that decreases the delay violation rate while guaranteeing an acceptable level of decoding error probability. Moreover, we show that the proposed deep reinforcement learning approach outperforms the random and equal scheduling benchmarks.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · cited 1×
“This value iteration algorithm is guaranteed to converge to the optimal point with Q → Q as k →∞ [12].”
MethodReinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Markov decision processes: Discrete stochastic dynamic programming
Hazeghi, K., & Puterman, M. L. (1995) · Journal of the American Statistical Association · doi:10.2307/2291177 · Cited by 8,037 · cited 1×
“ISWCS 2018 SS10 - Ultra-Reliable, Low-Latency and Low-Power Transmissions in the Era of Internet-of-Things as the solution of the Bellman equation [11]: By using the Bellman equation as an iterative update, the Q-function is estimated as: This value iteration algorithm is guaranteed to converge to…”
MethodFog computing and its role in the internet of things
Bonomi, F., Milito, R., Zhu, J., & Addepalli, S. (2012) · Proceedings of the first edition of the MCC workshop on Mobile cloud computing · doi:10.1145/2342509.2342513 · Cited by 6,244
Channel Coding Rate in the Finite Blocklength Regime
Polyanskiy, Y., Poor, H. V., & Verdu, S. (2010) · IEEE Transactions on Information Theory · doi:10.1109/tit.2010.2043769 · Cited by 3,885
Mobile Edge Computing: A Survey
Abbas, N., Zhang, Y., Taherkordi, A., & Skeie, T. (2018) · IEEE Internet of Things Journal · doi:10.1109/jiot.2017.2750180 · Cited by 2,474
A Survey on the Edge Computing for the Internet of Things
Yu, W., Liang, F., He, X., Hatcher, W. G., Lu, C., Lin, J., & Yang, X. (2018) · IEEE Access · doi:10.1109/access.2017.2778504 · Cited by 1,520
DREAM: Dynamic Resource and Task Allocation for Energy Minimization in Mobile Cloud Systems
Kwak, J., Kim, Y., Lee, J., & Chong, S. (2015) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2015.2478718 · Cited by 449
Cited by
Convergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498
“Hence, in [250], effects of the coding block-length are investigated”
BackgroundPham, Q.-V., Fang, F., Ha, V. N., Piran, M. J., Le, M., Le, L. B., Hwang, W.-J., & Ding, Z. (2020) · IEEE Access · doi:10.1109/access.2020.3001277 · Cited by 870
“The existing literature has studied a number of problems in MEC systems, including computation offloading [105], [106], [233], [239]–[243], caching [244]–[247], joint 4C optimization [247]–[252], security and privacy [253]–[259], big data analytics [234], [257], [260], and mobile crowd sensing [261].”
Shakarami, A., Ghobaei-Arani, M., & Shahidinejad, A. (2020) · Computer Networks · doi:10.1016/j.comnet.2020.107496 · Cited by 331
Deep Reinforcement Learning for Autonomous Internet of Things: Model, Applications and Challenges
Lei, L., Tan, Y., Zheng, K., Liu, S., Zhang, K., & Shen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2988367 · Cited by 298
“cles, reaching the target, a successful/failed grasp [48] [49] Network system performance Transmission delay [124] [125] [126] [132] Transmission reliability: e.g. error probability, packet loss rate [123] [127] [133] Computing system performance Processing delay [124] [128] [132] Utilization rate of computing resourc…”
BackgroundMethodInfluentialAI-based fog and edge computing: A systematic review, taxonomy and future directions
Iftikhar, S., Gill, S. S., Song, C., Xu, M., Aslanpour, M. S., Toosi, A. N., Du, J., Wu, H., Ghosh, S., Chowdhury, D., et al. (2023) · Internet of Things · doi:10.1016/j.iot.2022.100674 · Cited by 260
“[184] Resource allocation edge computing network for multiple user EC Deep Q-Learning Data packet size, Channel quality, and waiting time Deep Q-learning outperforms the random and equal scheduling”
BackgroundLi, X., Wan, J., Dai, H.-N., Imran, M., Xia, M., & Celesti, A. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2899679 · Cited by 243
“In [33], an intelligent agent at the edge computing was designed to develop a real-time adaptive policy for computational resource allocation for offloaded tasks of multiple”
Rodrigues, T. K., Suto, K., Nishiyama, H., Liu, J., & Kato, N. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2943405 · Cited by 245
“This allows for more complex functions and problems to be solved, such as the ones related to MEC [17], [151].”
BackgroundiRAF: A Deep Reinforcement Learning Approach for Collaborative Mobile Edge Computing IoT Networks
Chen, J., Chen, S., Wang, Q., Cao, B., Feng, G., & Hu, J. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2913162 · Cited by 225
“Compared with existing DRL-based MEC resource allocation methods [14]–[17], our iRAF exhibits higher performance over service latency and energy consumption.”
BackgroundMethodEdge QoE: Computation Offloading With Deep Reinforcement Learning for Internet of Things
Lu, H., He, X., Du, M., Ruan, X., Sun, Y., & Wang, K. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2981557 · Cited by 176
Shakarami, A., Ghobaei-Arani, M., Masdari, M., & Hosseinzadeh, M. (2020) · Journal of Grid Computing · doi:10.1007/s10723-020-09530-2 · Cited by 167
“[115] studied applying a DQL method for resource allocation.”
BackgroundMethodInfluentialEnabling AI in Future Wireless Networks: A Data Life Cycle Perspective
Nguyen, D. C., Cheng, P., Ding, M., Lopez-Perez, D., Pathirana, P. N., Li, J., Seneviratne, A., Li, Y., & Poor, H. V. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3024783 · Cited by 160
“mobile edge networks with multi-users, a deep Q-learning scheme is introduced in [104].”
BackgroundMethodA Review on Computational Intelligence Techniques in Cloud and Edge Computing
Asim, M., Wang, Y., Wang, K., & Huang, P.-Q. (2020) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2020.3007905 · Cited by 158
“resource allocation [138], task offloading [139]–[142], and joint issues [143]–[145].”
BackgroundLeveraging Deep Reinforcement Learning for Traffic Engineering: A Survey
Xiao, Y., Liu, J., Wu, J., & Ansari, N. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3102580 · Cited by 162
Guo, S., Dai, Y., Guo, S., Qiu, X., & Qi, F. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.2982000 · Cited by 142
“Yang et al. [31] designed a real-time adaptive schema for computational resource allocation to support task offloading of mobile users based on DRL. Tan et al. [32] invented a DRL-based multi-time-scale framework, which jointly optimizes communication, caching, and computational design issues to…”
BackgroundA Survey on Mobile Edge Computing for Video Streaming: Opportunities and Challenges
Khan, M. A., Baccour, E., Chkirbene, Z., Erbad, A., Hamila, R., Hamdi, M., & Gabbouj, M. (2022) · IEEE Access · doi:10.1109/access.2022.3220694 · Cited by 163
“Example works on stochastic offloading can be found in [105] and [106].”
Gazori, P., Rahbari, D., & Nickray, M. (2019) · Future Generation Computer Systems · doi:10.1016/j.future.2019.09.060 · Cited by 150
Asghari, A., & Sohrabi, M. K. (2024) · Computer Science Review · doi:10.1016/j.cosrev.2023.100616 · Cited by 140
The computing continuum: From IoT to the cloud
Al-Dulaimy, A., Jansen, M. F., Johansson, B., Trivedi, A., Iosup, A., Ashjaei, M., Galletta, A., Kimovski, D., Prodan, R., Tserpes, K., et al. (2024) · Internet of Things · doi:10.1016/j.iot.2024.101272 · Cited by 152
Distributed Edge Computing Offloading Algorithm Based on Deep Reinforcement Learning
Li, Y., Qi, F., Wang, Z., Yu, X., & Shao, S. (2020) · IEEE Access · doi:10.1109/access.2020.2991773 · Cited by 107
“In recent years, some studies related to resource allocation and computation offloading use DRL as a solution [34]–[38].”
BackgroundMethodJauro, F., Chiroma, H., Gital, A. Y., Almutairi, M. S., Abdulhamid, S. M., & Abawajy, J. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106582 · Cited by 115
Intelligent Resource Allocation for Edge-Cloud Collaborative Networks: A Hybrid DDPG-D3QN Approach
Hu, H., Wu, D., Zhou, F., Zhu, X., Hu, R. Q., & Zhu, H. (2023) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2023.3253905 · Cited by 93
“The frame length Tf = 600 symbols and one symbol duration τ0 is 5 μs [32].”
BackgroundMethodInfluentialReinforcement learning approach for resource allocation in humanitarian logistics
Yu, L., Zhang, C., Jiang, J., Yang, H., & Shang, H.-Y. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.114663 · Cited by 93
Guo, Y., Yu, F. R., An, J., Yang, K., Yu, C., & Leung, V. C. M. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.2968498 · Cited by 76
“With the ceiling function, the number of the transcoded video chunks during time stage t is an integer [33].”
BackgroundTang, J., Tang, H., Zhang, X. Y., Cumanan, K., Chen, G., Wong, K., & Chambers, J. A. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2954127 · Cited by 70
“In particular, the DQN algorithm is used for resource allocation in edge computing networks [20], the dynamic multichannel access problem in wireless networks [21], and mobile robot path planning problems [22].”
MethodFeng, L., Yang, Z., Yang, Y., Que, X., & Zhang, K. (2020) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2020.2977577 · Cited by 63
“In reference [28] and [29], deep reinforcement learning algorithm was designed to allocate computing resources reasonably and task migration in mobile edge computing network, ensuring the low latency of communication.”
MethodAlQerm, I., & Pan, J. (2021) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2021.3123959 · Cited by 73
“The work in [36] investigated strategies for the allocation of computational resources using DRL in edge computing networks.”
BackgroundLi, S., Hu, X., & Du, Y. (2021) · IEEE Access · doi:10.1109/access.2021.3109132 · Cited by 56
“At present, more and more literature [7]–[9] shows that researchers apply reinforcement learning (RL) to the offload-ing decision in the MEC environment, which is suitable for the dynamic and stochastic of mobile devices.”
BackgroundAcheampong, A., Zhang, Y., Xu, X., & Kumah, D. A. (2022) · Computer Modeling in Engineering & Sciences · doi:10.32604/cmes.2022.021394 · Cited by 71
Qu, C., Calyam, P. P., Yu, J., Vandanapu, A., Opeoluwa, O., Gao, K., Wang, S., Chastain, R. L., & Palaniappan, K. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2021.06.040 · Cited by 49
A Win–Win Mode: The Complementary and Coexistence of 5G Networks and Edge Computing
Fang, F., & Wu, X. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3009821 · Cited by 53
“Game theory, probability theory, and reinforcement learning are widely applied to computing offloading models such as [90]–[92].”
BackgroundParameterized Deep Reinforcement Learning With Hybrid Action Space for Edge Task Offloading
Wang, T., Deng, Y., Zhao, Y., Wang, Y., & Cai, H. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3327121 · Cited by 48
“The studies [26], [27], [28] employed a deep Q network (DQN)-based decision-making strategy for task offloading and resource allocation in MEC systems aiming to decrease task completion latency and energy cost.”
MethodMachine Learning for Predictive Diagnostics at the Edge: an IIoT Practical Example
Bellavista, P., Penna, R. D., Foschini, L., & Scotece, D. (2020) · International Conference on Communications · doi:10.1109/icc40277.2020.9148684 · Cited by 50
“Many systems support strategies for the allocation of computational resources using deep reinforcement learning in Edge Computing networks [10].”
Collaborative Edge Computing and Caching With Deep Reinforcement Learning Decision Agents
Ren, J., Wang, H., Hou, T., Zheng, S., & Tang, C. (2020) · IEEE Access · doi:10.1109/access.2020.3007002 · Cited by 45
“Yang et al. [17] proposed a computing resource allocation strategy based on deep reinforcement learning for URLLC edge computing networks with multiple users.”
BackgroundSandbox Computing: A Data Privacy Trusted Sharing Paradigm via Blockchain and Federated Learning
Guo, S., Zhang, K., Gong, B., Chen, L., Ren, Y., Qi, F., & Qiu, X. (2022) · IEEE Transactions on Computers · doi:10.1109/tc.2022.3180968 · Cited by 40
“DRL has good performance in dealing with complex environmental state information [11], [12].”
BackgroundKhan, I. A., Tao, X., Rahman, G., Rehman, W. U., & Salam, T. (2020) · IEEE Access · doi:10.1109/access.2020.2991057 · Cited by 39
“DRL also approximate Q ( s , a ; θ ) toQ ( s , a ) that results in performance improvement and avoids the unreasonable Q-learning situation in RL [32].”
BackgroundWhen machine learning meets Network Management and Orchestration in Edge-based networking paradigms
Shahraki, A., Ohlenforst, T., & Kreyß, F. (2022) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2022.103558 · Cited by 38
Delay Minimization Offloading for Interdependent Tasks in Energy-Aware Cooperative MEC Networks
Zhu, Y. L., Hu, Y., & Schmeink, A. (2019) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc.2019.8885560 · Cited by 35
Self-citationZhu, Y. L., Hu, Y., Yang, T., Yang, T., Vogt, J., & Schmeink, A. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3073791 · Cited by 34
“Our previous work [27] was the first to investigate the feasibility of model-based DRL solution for the reliability optimised offloading problem in the MEC network with a single server.”
BackgroundSelf-citationGreen Internet of Vehicles: Architecture, Enabling Technologies, and Applications
Chen, H., Zhao, T., Li, C., & Guo, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2958175 · Cited by 30
“A DRL-based multi-user MEC network computes resource allocation by the algorithm of Q-learning proposed in [8], which allocates computing resources in real time.”
BackgroundMethodSahu, D. K., Nidhi, N., Chaturvedi, R., Prakash, S., Yang, T., Rathore, R. S., & Alsolbi, I. N. (2025) · Scientific Reports · doi:10.1038/s41598-025-16317-6 · Cited by 34
Self-citationMulti-agent deep reinforcement learning for online request scheduling in edge cooperation networks
Zhang, Y., Li, R., Zhao, Y., Li, R., Wang, Y., & Zhou, Z. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.11.017 · Cited by 31
A prescriptive Dirichlet power allocation policy with deep reinforcement learning
Tian, Y., Han, M., Kulkarni, C. S., & Fink, O. (2022) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2022.108529 · Cited by 34
Resource Management using Machine Learning in Mobile Edge Computing: A Survey
Zamzam, M., Elshabrawy, T., & Ashour, M. (2019) · International Conference on Intelligent Computing and Information Systems (ICICIS) · doi:10.1109/icicis46948.2019.9014733 · Cited by 28
“Minimizing the latency is studied in [1] using combination of both deep neural network and deep reinforcement learning, [7] using Q-learning, [9] using deep reinforcement learning.”
BackgroundMethodAn Approach for adapting a Cobot Workstation to Human Operator within a Deep Learning Camera
Lazaro, O. D. M., Mohammed, W. M., Ferrer, B. R., Bejarano, R., & Lastra, J. L. M. (2019) · IEEE International Conference on Industrial Informatics (INDIN) · doi:10.1109/indin41052.2019.8972238 · Cited by 29
“, production, resource allocation, logistics, in order to maximize the outcome of these systems with respect to the available resources [29] [30] [31].”
BackgroundYin, R., Guo, A., Song, C., & Xing, Y. Y. (2021) · IEEE Access · doi:10.1109/access.2021.3088450 · Cited by 25
“Initialize the random process N t for action exploration 9.”
MethodKumaran, K., & Sasikala, E. (2021) · International Conference on System, Computation, Automation and Networking (ICSCAN) · doi:10.1109/icscan53069.2021.9526410 · Cited by 28
Resource allocation for Vehicle‐to‐Everything communications: A survey
Brahmi, I., Koubaa, H., & Zarai, F. (2022) · IET Networks · doi:10.1049/ntw2.12078 · Cited by 28
Deep Reinforcement Learning for Resource Allocation in 5G Communications
Tham, M., Iqbal, A., & Chang, Y. C. (2019) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc47483.2019.9023112 · Cited by 25
“Similar work can be found in [22], where the authors considered both the error probability of decoding and violation probability of delay in order to support low latency communications.”
BackgroundA Frontier: Dependable, Reliable and Secure Machine Learning for Network/System Management
Le, D. C., & Zincir-Heywood, N. (2020) · Journal of Network and Systems Management · doi:10.1007/s10922-020-09512-5 · Cited by 25
“In addition to traffic prediction, many other tasks in performance management have seen several proposed ML based solutions: Traffic management in cloud and mobile edge com‐ puting [45, 95], network resource management and allocation [8, 46, 47, 96], QoS assurance [97, 98], and congestion control [48, 49].”
BackgroundResearch allocation in mobile volunteer computing system: Taxonomy, challenges and future work
Ma, P., Garg, S., & Barika, M. (2024) · Future Generation Computer Systems · doi:10.1016/j.future.2024.01.015 · Cited by 24
On the Opportunities and Challenges of NOMA-Based Fog Radio Access Networks: An Overview
Kaneko, M., Randrianantenaina, I., Dahrouj, H., ElSawy, H., & Alouini, M. (2020) · IEEE Access · doi:10.1109/access.2020.3037183 · Cited by 22
A delay-sensitive resource allocation algorithm for container cluster in edge computing environment
Guo, S., Zhang, K., Gong, B., He, W., & Qiu, X. (2021) · Computer Communications · doi:10.1016/j.comcom.2021.01.020 · Cited by 22
Online Offloading Scheduling for NOMA-Aided MEC Under Partial Device Knowledge
Hua, M., Tian, H., Lyu, X., Ni, W., & Nie, G. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3091849 · Cited by 22
“In [26], a real-time adaptive policy based on DL for computational resource allocation is conducted to improve the average end-to-end reliability.”
MethodResource Allocation in MEC-enabled Vehicular Networks: A Deep Reinforcement Learning Approach
Tan, G., Zhang, H., & Zhou, S. (2020) · IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) · doi:10.1109/infocomwkshps50562.2020.9162980 · Cited by 21
“Different from the schemes that consider resource allocation at the terminal side, the authors in [9] proposed a deep reinforcement learning (DRL) based algorithm for resource allocation in MEC sever, and take into account the impact of FBL coding.”
BackgroundMethodInfluentialA Survey of Techniques for Fulfilling the Time-Bound Requirements of Time-Sensitive IoT Applications
Korala, H., Georgakopoulos, D., Jayaraman, P. P., & Yavari, A. (2022) · ACM Computing Surveys · doi:10.1145/3510411 · Cited by 20
“In [83], proposes a novel method that is based on deep reinforcement learning to make intelligent decisions on task distribution based on the current state of the system and learning the best strategy to allocate resources for the tasks.”
MethodResource Competition in Blockchain Networks Under Cloud and Device Enabled Participation
Liang, Y., Li, Y., Guo, J., & Li, Y. (2022) · IEEE Access · doi:10.1109/access.2022.3143815 · Cited by 19
A Review of Deep Learning Applications for the Next Generation of Cognitive Networks
Buenrostro‐Mariscal, R., Santana-Mancilla, P. C., Montesinos-López, O. A., Hipólito, J. I. N., & Anido, L. (2022) · Applied Sciences · doi:10.3390/app12126262 · Cited by 18
Li, Q., Zhu, Y., Ding, J., Li, W., Sun, W., & Ding, L. (2024) · CSEE Journal of Power and Energy Systems · doi:10.17775/cseejpes.2021.02390 · Cited by 17
“Using the deep reinforcement learning method, a real-time adaptive computing resource allocation approach was created in [17], which improved end-to-end reliability.”
BEHAVE: Behavior-Aware, Intelligent, and Fair Resource Management for Heterogeneous Edge-IoT Systems
AlQerm, I., Wang, J., Pan, J., & Liu, Y. (2021) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2021.3068632 · Cited by 19
“In [17], the authors designed an intelligent agent at the edge computing node to create a real-time adaptive policy for computational resource allocation of multiple users in order to improve the average end to end reliability.”
BackgroundChen, L., & Xu, J. (2020) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3036953 · Cited by 16
“These properties are desirable for solving our edge service provisioning problem, as well as many other decision problems in edge computing systems, e.g., computation offloading [6], [22], resource allocation [15], and caching [23].”
BackgroundCicco, N. D., Pittalà, G. F., Davoli, G., Borsatti, D., Cerroni, W., Raffaelli, C., & Tornatore, M. (2025) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2025.3574131 · Cited by 16
“This results in DRL orchestration policies that are fixed to one specific deployment scenario (i.e., the training scenario) and one specific trade-off between the objectives [6].”
Online-learning task scheduling with GNN-RL scheduler in collaborative edge computing
Jian, C., Pan, Z., Bao, L., & Zhang, M. (2023) · Cluster Computing · doi:10.1007/s10586-022-03957-w · Cited by 15
“Yang et al. [17] proposed a resource allocation strategy for multi-user URLLC edge computing network based on deep reinforcement learning.”
Task Allocation Mechanism for Cable Real-Time Online Monitoring Business Based on Edge Computing
Shao, S., Zhang, Q., Guo, S., & Qi, F. (2020) · IEEE Systems Journal · doi:10.1109/jsyst.2020.2988266 · Cited by 15
“Yang et al. [29] proposed an edge computing resource allocation algorithm based on reinforcement learning.”
MethodFeng, L., Zhou, Y., Liu, T., Que, X., Yu, P., Hong, T., & Qiu, X. (2021) · IEEE Transactions on Green Communications and Networking · doi:10.1109/tgcn.2021.3072140 · Cited by 15
Graph Mapping Offloading Model Based On Deep Reinforcement Learning With Dependent Task
Mao, N., Chen, Y., Guizani, M., & Lee, G. M. (2021) · International Wireless Communications and Mobile Computing Conference (IWCMC) · doi:10.1109/iwcmc51323.2021.9498674 · Cited by 17
Co-Optimization of Cell Selection and Data Offloading in Sparse Mobile Crowdsensing
Han, L., Yu, Z., Zhang, X., Yu, Z., Shan, W., Wang, L., & Guo, B. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3315232 · Cited by 14
“Itisworthnotingthatduetoedgeserverscanonlycover a part of the target area, data processing efficiency is greatly affected by data offloading decisions [18], [19], [20], [21].”
BackgroundMobility-Aware Resource Allocation in Multi-Access Edge Computing Using Deep Reinforcement Learning
Din, N., Chen, H., & Khan, D. (2019) · IEEE International Symposium on Parallel and Distributed Processing with Applications (ISPA) · doi:10.1109/ispa-bdcloud-sustaincom-socialcom48970.2019.00038 · Cited by 13
“Authors in [16] proposed a deep reinforcement learning method and blocklength codes to support low latency communications.”
Load Optimization Based on Edge Collaboration in Software Defined Ultra-Dense Networks
Yang, P., Zhang, Y., & Lv, J. (2020) · IEEE Access · doi:10.1109/access.2020.2973041 · Cited by 14
“In [27], the strategy of using deep reinforcement learning to allocate computing resources in mobile edge computing networks was studied.”
BackgroundManagement of resource sharing in emergency response using data-driven analytics
Zhang, J., Tutun, S., Anvaryazdi, S. F., Amini, M., Sundaramoorthi, D., & Sundaramoorthi, H. (2023) · Annals of Operations Research · doi:10.1007/s10479-023-05702-x · Cited by 12
“…such as cellular networks(ElHalawanyetal.,2020),radionetworks(Kwasinskietal.,2020),communications (Yeetal.,2019;Alelaiwi,2020),computingnetworks(Yangetal.,2018),businessprocess management(Huangetal.,2011),computerresourcemanagement(Maoetal.,2016),and…”
Tasks Offloading for Connected Autonomous Vehicles in Edge Computing
Wu, Q., Xu, X., Zhao, Q., & Dai, F. (2021) · Mobile Networks and Applications · doi:10.1007/s11036-021-01794-6 · Cited by 11
“In order to enhance the reliability of edge-to-edge transmission, Yang et al. [28] designed a real-time adaptive transmission method across edges, and applied deep learning methods to optimize data transmission across edge devices.”
MethodSanti, N., & Mitton, N. (2021) · ITU Journal on Future and Evolving Technologies · doi:10.52953/bqvo3992 · Cited by 13
Content-centric data and computation offloading in AI-supported fog networks for next generation IoT
Kök, İ., & Özdemir, S. (2022) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2022.101654 · Cited by 14
Yang, M., Yu, P., Wang, Y., Huang, X., Miu, W., Yu, P., Li, W., Yang, R., Tao, M., & Shi, L. (2020) · International Wireless Communications and Mobile Computing Conference (IWCMC) · doi:10.1109/iwcmc48107.2020.9148169 · Cited by 9
“How to link basic elements with optimization goals is very important [4-5].”
BackgroundLu, T., Zeng, F., Shen, J., Chen, G., Shu, W., & Zhang, W. (2021) · International Conference on Mobility, Sensing and Networking (MSN) · doi:10.1109/msn53354.2021.00024 · Cited by 9
Resource Allocation on Blockchain Enabled Mobile Edge Computing System
Zheng, X., Zhang, Y., Yang, F., & Xu, F. (2022) · Electronics · doi:10.3390/electronics11121869 · Cited by 9
Deep Q-learning based Resource Scheduling in IoT Edge Computing
Vijayasekaran, G., & Duraipandian, M. (2024) · International Conference on Inventive Computation Technologies (ICICT) · doi:10.1109/icict60155.2024.10544834 · Cited by 8
A Comprehensive Survey of Trending Tools and Techniques in Deep Learning
Prakash, A., & Chauhan, S. (2023) · International Conference on Disruptive Technologies (ICDT) · doi:10.1109/icdt57929.2023.10151083 · Cited by 9
“Backpropagation is often used to modify the edge weights and simplify the model [25].”
MethodDeadline-aware heuristics for reliability optimization in ubiquitous mobile edge computing
Zaman, S. K. U., Maqsood, T., Ramzan, A., Rehman, F. U., Mustafa, S., & Shuja, J. (2023) · International Journal of Data Science and Analytics · doi:10.1007/s41060-023-00473-x · Cited by 8
“In [21], author addresses the problem of how to select code for transmission reliability.”
Actor-critic learning-based energy optimization for UAV access and backhaul networks
Yuan, Y., Lei, L., Vu, T. X., Chatzinotas, S., Sun, S., & Ottersten, B. (2021) · EURASIP Journal on Wireless Communications and Networking · doi:10.1186/s13638-021-01960-0 · Cited by 8
“First, if the after-learned policy is infeasible at the end of each episode, the agent will get a penalty −ζ which is negative [33].”
BackgroundGreen hybrid energy harvesting for intelligent mobile edge computing in internet of things
Ge, P., Zhao, J., Zhang, H., Zou, D., & Wang, M. (2023) · Physical Communication · doi:10.1016/j.phycom.2023.102171 · Cited by 7
Resource Allocation and Placement in Multi-access Edge Computing
Xu, Y., He, Z., & Li, K. (2024) · Studies in big data · doi:10.1007/978-981-97-2644-8_3 · Cited by 7
Yıldız, Ö., & SOKULLU, R. İ. (2023) · Journal of Electrical Engineering · doi:10.2478/jee-2023-0006 · Cited by 7
On Meeting a Maximum Delay Constraint Using Reinforcement Learning
Shafieirad, H., & Adve, R. (2022) · IEEE Access · doi:10.1109/access.2022.3206035 · Cited by 7
“The most common RL framework considered in the literature has been deep Q-learning (DQN), e.g., increasing the number of served users by considering the delay violation rate as in [40].”
BackgroundDECCo-A Dynamic Task Scheduling Framework for Heterogeneous Drone Edge Cluster
Zhang, Z., Wu, D., Zhang, F., & Wang, R. (2023) · Drones · doi:10.3390/drones7080513 · Cited by 6
A Survey of Edge Computing Resource Allocation Strategies Based on Federated Learning
Ni, S., He, Y., Chen, L., Wang, Y., & Yu, F. R. (2023) · International Conference on Networking and Network Applications (NaNA) · doi:10.1109/nana60121.2023.00027 · Cited by 6
“Yang et al. designed a real-time adaptive algorithm strategy through Deep reinforcement learning (DRL), and reduced the system delay through computing resource allocation management of multi-user devices [1].”
MethodPower system low delay resource scheduling model based on edge computing node
Zhao, Y., & Ye, H. (2023) · Scientific Reports · doi:10.1038/s41598-023-41108-2 · Cited by 6
“Since the target partition is the point with the highest degree of electrical coupling with each partition, the result of SVV ( i )( i = 1, 2, . . . 7 ) for each vertex is judged to select the vertex of max i { SVV ( v i ) } as the best placement position 21 .”
BackgroundRadio Access Scheduling using CMA-ES for Optimized QoS in Wireless Networks
Ana, P. M. D. S., & Marchenko, N. (2020) · IEEE Globecom Workshops (GC Wkshps) · doi:10.1109/gcwkshps50303.2020.9367458 · Cited by 6
“Many authors are proposing RL based scheduling approaches for different applications, such as device-to-device (D2D) communication [5], edge computing [6], massive MIMO [7] and LTE/Wi-Fi coexistence [8], [9].”
BackgroundLearning to Wait: Wi-Fi Contention Control using Load-based PredictionsPreprint
Sandholm, T. E., Huberman, B. A., Hamzeh, B. Y., & Clearwater, S. H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.06747 · Cited by 6
“Machine-Learning based network management: In [1, 16, 17, 19, 33, 34] various DNN and Q-Learning approaches are proposed to optimize network configuration.”
MethodSi2ER Protocol for Optimization of RF Powered Communication using Deep Learning
Kumari, M., Prasad, G., & Mishra, D. (2022) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc51071.2022.9771958 · Cited by 5
“Value-based DRL approaches, such as deep Q -network (DQN) [15], [16], operate on discrete action space, whereas policy-based DRL approaches, such as deep deterministic policy gradient (DDPG), run smoothly on continuous action space.”
BackgroundVijayasekaran, G., & Duraipandian, M. (2024) · International Journal of Communication Systems · doi:10.1002/dac.5724 · Cited by 5
Multi-access Edge Computing Based User Experience Driven Multicast Video Conference Algorithm
Xu, S., & Liu, G. (2020) · IEEE International Conference on Edge Computing and Communications (EDGE) · doi:10.1109/edge50951.2020.00022 · Cited by 5
“We assume that each virtual machine is assigned a vCPU core and the frequency is a fixed value [16].”
BackgroundAttention-based model and deep reinforcement learning for distribution of event processing tasks
Mazayev, A., AL-Tam, F., & Correia, N. (2022) · Internet of Things · doi:10.1016/j.iot.2022.100563 · Cited by 7
Li, Q., Cheng, H. B., Yang, Y., Tang, H., Wang, J., Luo, G., & Sun, W. (2022) · Mobile Networks and Applications · doi:10.1007/s11036-022-02006-5 · Cited by 4
“For example, the deep reinforcement learning method in [23] designs a real-time, adaptive computing resource allocation strategy to improve end-to-end reliability.”
MethodReinforcement of QoE based Feedback System to Allocate Resources in IIoT
Udayakumar, K., & Ramamoorthy, S. (2022) · International Conference for Emerging Technology (INCET) · doi:10.1109/incet54531.2022.9825345 · Cited by 4
Intelligence and Cognitive Computing at the Edge for IoT: Architecture, Challenges, and Applications
Kusuma, S., Veena, K. N., Kavya, K. S., & Kumar, B. P. V. (2022) · EAI/Springer Innovations in Communication and Computing · doi:10.1007/978-3-031-04524-0_19 · Cited by 4
ML-Assisted Resource Allocation Outage Probability: Simple, Closed-Form Approximations
Raina, R. K., Simmons, N., Simmons, D. E., & Yacoub, M. D. (2023) · IEEE International Conference on Advanced Networks and Telecommunications Systems · doi:10.1109/ants59832.2023.10469572 · Cited by 6
“For example, [9], [10] employed deep reinforcement learning (DRL) for resource allocation in ultra-reliable low-latency communication edge networks and vehicle-to-vehicle communications, respectively, with the latter addressing both unicast and broadcast scenarios.”
BackgroundJiang, Z., Yang, J., & Gao, X. (2024) · Sensors · doi:10.3390/s24092812 · Cited by 4
“In [21], the authors allocate blocklength to improve the average end-to-end reliability through a deep reinforcement learning approach.”
BackgroundDrone Swarm Coordination Using Machine Learning in IoT Networks
Divakar, D., Kanmani, & Supriya, A. (2025) · Advances in Science, Technology & Innovation/Advances in science, technology & innovation · doi:10.1007/978-3-031-80961-3_3 · Cited by 4
Multi-Agent Reinforcement Learning Approaches to RF Fingerprint Enhancement
Carmack, J. M., Schmidt, S., & Kuzdeba, S. (2021) · ACM Workshop on Wireless Security and Machine Learning (WiseML) · doi:10.1145/3468218.3469037 · Cited by 4
“Applications in the RF domain included dynamic channel access [30] and resource allocation [25, 28], to name a few.”
BackgroundJoint resource allocation for emotional 5G IoT systems using deep reinforcement learning
Yang, Z., Mei, H., Wang, W., Zhou, D., & Yang, K. (2021) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-021-01398-2 · Cited by 5
Metadata
- Authors
- Yang, T., Hu, Y., Gursoy, M. C., Schmeink, A., & Mathar, R.
- Affiliations
- RWTH Aachen University (DE)
- Syracuse University (US)
- Venue
- 2018 15th International Symposium on Wireless Communication Systems (ISWCS)
- Publisher
- IEEE
- Published
- 2018-08
- Pages
- 1-5
- OpenAlex
- W2896079731
- Cited by
- 156
- References
- 15
- Citations by year
- 2026: 1 · 2025: 6 · 2024: 15 · 2023: 26 · 2022: 33 · 2021: 25 · 2020: 34 · 2019: 16
- FWCI
- 15.50
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Symposium on Wireless Communication Systems (publishedVersion)
- RWTH Publications (RWTH Aachen) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Wireless Network Optimization
- Physical Sciences › Engineering › Aerospace Engineering › Satellite Communication Systems
- Keywords
- resource allocation, mobile edge computing, deep Q-learning, finite blocklength codes, low-latency communication, task offloading, end-to-end reliability, delay violation probability, decoding error probability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.