Deep Reinforcement Learning based Resource Allocation in Low Latency Edge Computing Networks
The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
In this paper, we investigate strategies for the allocation of computational resources using deep reinforcement learning in mobile edge computing networks that operate with finite blocklength codes to support low latency communications. The end-to-end (E2E) reliability of the service is addressed, while both the delay violation probability and the decoding error probability are taken into account. By employing a deep reinforcement learning method, namely deep Q-learning, we design an intelligent agent at the edge computing node to develop a real-time adaptive policy for computational resource allocation for offloaded tasks of multiple users in order to improve the average E2E reliability. Via simulations, we show that under different task arrival rates, the realized policy serves to increase the task number that decreases the delay violation rate while guaranteeing an acceptable level of decoding error probability. Moreover, we show that the proposed deep reinforcement learning approach outperforms the random and equal scheduling benchmarks.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · cited 1×
“This value iteration algorithm is guaranteed to converge to the optimal point with Q → Q as k →∞ [12].”
MethodReinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Markov decision processes: Discrete stochastic dynamic programming
Hazeghi, K., & Puterman, M. L. (1995) · Journal of the American Statistical Association · doi:10.2307/2291177 · Cited by 8,037 · cited 1×
“ISWCS 2018 SS10 - Ultra-Reliable, Low-Latency and Low-Power Transmissions in the Era of Internet-of-Things as the solution of the Bellman equation [11]: By using the Bellman equation as an iterative update, the Q-function is estimated as: This value iteration algorithm is guaranteed to converge to…”
MethodFog computing and its role in the internet of things
Bonomi, F., Milito, R., Zhu, J., & Addepalli, S. (2012) · Proceedings of the first edition of the MCC workshop on Mobile cloud computing · doi:10.1145/2342509.2342513 · Cited by 6,244
Channel Coding Rate in the Finite Blocklength Regime
Polyanskiy, Y., Poor, H. V., & Verdu, S. (2010) · IEEE Transactions on Information Theory · doi:10.1109/tit.2010.2043769 · Cited by 3,885
Mobile Edge Computing: A Survey
Abbas, N., Zhang, Y., Taherkordi, A., & Skeie, T. (2018) · IEEE Internet of Things Journal · doi:10.1109/jiot.2017.2750180 · Cited by 2,474
A Survey on the Edge Computing for the Internet of Things
Yu, W., Liang, F., He, X., Hatcher, W. G., Lu, C., Lin, J., & Yang, X. (2018) · IEEE Access · doi:10.1109/access.2017.2778504 · Cited by 1,520
DREAM: Dynamic Resource and Task Allocation for Energy Minimization in Mobile Cloud Systems
Kwak, J., Kim, Y., Lee, J., & Chong, S. (2015) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2015.2478718 · Cited by 449
Power-Delay Tradeoff in Multi-User Mobile-Edge Computing Systems
Mao, Y., Zhang, J., Song, S. H., & Letaief, K. B. (2016) · 2016 IEEE Global Communications Conference (GLOBECOM) · doi:10.1109/glocom.2016.7842160 · Cited by 304
Latency and Reliability-Aware Task Offloading and Resource Allocation for Mobile Edge Computing
Liu, C.-F., Bennis, M., & Poor, H. V. (2017) · 2017 IEEE Globecom Workshops (GC Wkshps) · doi:10.1109/glocomw.2017.8269175 · Cited by 201
Relaying-Enabled Ultra-Reliable Low-Latency Communications in 5G
Hu, Y., Gursoy, M. C., & Schmeink, A. (2018) · IEEE Network · doi:10.1109/mnet.2018.1700252 · Cited by 78
Self-citationWireless Throughput and Energy Efficiency With Random Arrivals and Statistical Queuing Constraints
Ozmen, M., & Gursoy, M. C. (2015) · IEEE Transactions on Information Theory · doi:10.1109/tit.2015.2510027 · Cited by 47 · cited 1×
“The probability P (k) n following the principle of the discretetime On/Off Markov arrival model [8] represents the data arrival level of the user Un in time slot k.”
BackgroundSelf-citationHu, Y., Schmeink, A., & Gross, J. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2811943 · Cited by 36
Self-citation
Cited by
Convergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498
“Hence, in [250], effects of the coding block-length are investigated”
BackgroundPham, Q.-V., Fang, F., Ha, V. N., Piran, M. J., Le, M., Le, L. B., Hwang, W.-J., & Ding, Z. (2020) · IEEE Access · doi:10.1109/access.2020.3001277 · Cited by 870
“The existing literature has studied a number of problems in MEC systems, including computation offloading [105], [106], [233], [239]–[243], caching [244]–[247], joint 4C optimization [247]–[252], security and privacy [253]–[259], big data analytics [234], [257], [260], and mobile crowd sensing [261].”
Shakarami, A., Ghobaei-Arani, M., & Shahidinejad, A. (2020) · Computer Networks · doi:10.1016/j.comnet.2020.107496 · Cited by 331
Deep Reinforcement Learning for Autonomous Internet of Things: Model, Applications and Challenges
Lei, L., Tan, Y., Zheng, K., Liu, S., Zhang, K., & Shen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2988367 · Cited by 298
“cles, reaching the target, a successful/failed grasp [48] [49] Network system performance Transmission delay [124] [125] [126] [132] Transmission reliability: e.g. error probability, packet loss rate [123] [127] [133] Computing system performance Processing delay [124] [128] [132] Utilization rate of computing resourc…”
BackgroundMethodInfluentialAI-based fog and edge computing: A systematic review, taxonomy and future directions
Iftikhar, S., Gill, S. S., Song, C., Xu, M., Aslanpour, M. S., Toosi, A. N., Du, J., Wu, H., Ghosh, S., Chowdhury, D., et al. (2023) · Internet of Things · doi:10.1016/j.iot.2022.100674 · Cited by 260
“[184] Resource allocation edge computing network for multiple user EC Deep Q-Learning Data packet size, Channel quality, and waiting time Deep Q-learning outperforms the random and equal scheduling”
Background
Metadata
- Authors
- Yang, T., Hu, Y., Gursoy, M. C., Schmeink, A., & Mathar, R.
- Affiliations
- RWTH Aachen University (DE)
- Syracuse University (US)
- Venue
- 2018 15th International Symposium on Wireless Communication Systems (ISWCS)
- Publisher
- IEEE
- Published
- 2018-08
- Pages
- 1-5
- OpenAlex
- W2896079731
- Cited by
- 156
- References
- 15
- Citations by year
- 2026: 1 · 2025: 6 · 2024: 15 · 2023: 26 · 2022: 33 · 2021: 25 · 2020: 34 · 2019: 16
- FWCI
- 15.50
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Symposium on Wireless Communication Systems (publishedVersion)
- RWTH Publications (RWTH Aachen) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Wireless Network Optimization
- Physical Sciences › Engineering › Aerospace Engineering › Satellite Communication Systems
- Keywords
- resource allocation, mobile edge computing, deep Q-learning, finite blocklength codes, low-latency communication, task offloading, end-to-end reliability, delay violation probability, decoding error probability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.