Deep reinforcement learning based computation offloading and resource allocation for MEC
The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Mobile edge computing (MEC) has the potential to enable computation-intensive applications in 5G networks. MEC can extend the computational capacity at the edge of wireless networks by migrating the computation-intensive tasks to the MEC server. In this paper, we consider a multi-user MEC system, where multiple user equipments (UEs) can perform computation offloading via wireless channels to an MEC server. We formulate the sum cost of delay and energy consumptions for all UEs as our optimization objective. In order to minimize the sum cost of the considered MEC system, we jointly optimize the offloading decision and computational resource allocation. However, it is challenging to obtain an optimal policy in such a dynamic system. Besides immediate reward, Reinforcement Learning (RL) also takes a long-term goal into consideration, which is very important to a time-variant dynamic systems, such as our considered multi-user wireless MEC system. To this end, we propose RL-based optimization framework to tackle the resource allocation in wireless MEC. Specifically, the Q-learning based and Deep Reinforcement Learning (DRL) based schemes are proposed, respectively. Simulation results show that the proposed scheme achieves significant reduction on the sum cost compared to other baselines.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Mobile Edge Computing: A Survey on Architecture and Computation Offloading
Mach, P., & Becvar, Z. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2682318 · Cited by 3,258 · cited 1×
“Therefore, the computation offloading and computational resource allocation themes have attracted great interests as a key point in the MEC system [3].”
BackgroundEfficient multi-user computation offloading for mobile-edge cloud computing
Chen, X., Jiao, L., Li, W., & Fu, X. (2016) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2015.2487344 · Cited by 2,675 · cited 1×
“But according to [14], [15], the download data rate is very high in general, and the data size of the result is much smaller than that of input data, so the delay and energy consumptions of this step are neglected in the rest of this paper.”
BackgroundCloud computing for mobile users: can offloading computation save energy?
Kumar, K., & Lu, Y.-H. (2010) · Computer · doi:10.1109/mc.2010.98 · Cited by 1,493 · cited 1×
“The work in [5] proposed general guidelines to make offloading decision for energy consumption minimization, where the communication links were easily assumed to have a fixed rate.”
BackgroundSelf-citationEnergy-Efficient Offloading for Mobile Edge Computing in 5G Heterogeneous Networks
Zhang, K., Mao, Y., Leng, S., Zhao, Q., Li, L., Peng, X., Pan, L., Maharjan, S., & Zhang, Y. (2016) · IEEE Access · doi:10.1109/access.2016.2597169 · Cited by 855 · cited 1×
“But according to [14], [15], the download data rate is very high in general, and the data size of the result is much smaller than that of input data, so the delay and energy consumptions of this step are neglected in the rest of this paper.”
BackgroundDelay-optimal computation task scheduling for mobile-edge computing systems
Liu, J., Mao, Y., Zhang, J., & Letaief, K. B. (2016) · 2016 IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.2016.7541539 · Cited by 759 · cited 1×
“The work in [8] designed the single-user delay-optimal task scheduling policies based on the theory of MDP, which controlled the states of the local processing and transmission units and the task buffer queue length based on the channel state.”
MethodJaszkiewicz, A. (2002) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2002.802873 · Cited by 474
Communicating While Computing: Distributed mobile cloud computing over 5G heterogeneous networks
Barbarossa, S., Sardellitti, S., & Di Lorenzo, P. (2014) · IEEE Signal Processing Magazine · doi:10.1109/msp.2014.2334709 · Cited by 468 · cited 2×
“Since the data rates for wireless communications are not constant, the optimal binary computation offloading decision using convex optimization was proposed in [6], where the the famous Shannon-Hartley formula gave the power-rate function.”
BackgroundMobile-edge computing architecture: the role of mec in the internet of things
Sabella, D., Vaillant, A., Kuure, P., Rauschenbach, U., & Giust, F. (2016) · IEEE Consumer Electronics Magazine · doi:10.1109/mce.2016.2590118 · Cited by 413 · cited 1×
“MEC is a new paradigm in C-RAN, which can enhance the computation capacity at the edge of mobile networks by deploying high-performance servers [2].”
BackgroundEnergy-optimal mobile application execution: Taming resource-poor mobile devices with cloud clones
Wen, Y., Zhang, W., & Luo, H. (2012) · 2012 Proceedings IEEE INFOCOM · doi:10.1109/infcom.2012.6195685 · Cited by 394 · cited 1×
“We set zn = 10−27 ( f l n )2 according to the practical measurement in [13].”
MethodPeng, M., Sun, Y., Li, X., Mao, Z., & Wang, C. (2016) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2016.2548658 · Cited by 386
Cited by
Applications of Deep Reinforcement Learning in Communications and Networking: A Survey
Luong, N. C., Hoang, D. T., Gong, S., Niyato, D., Wang, P., Liang, Y.-C., & Kim, D. I. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2916583 · Cited by 2,060
“used for each mobile user to learn the optimal offloading policy from past experiences such as the approaches proposed in [101] and [102].”
BackgroundDeep Learning in Mobile and Wireless Networking: A Survey
Zhang, C., Patras, P., & Haddadi, H. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2904897 · Cited by 1,768
Convergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498
“Under the circumstances, a preclassification step can be performed before learning [253] to”
BackgroundPham, Q.-V., Fang, F., Ha, V. N., Piran, M. J., Le, M., Le, L. B., Hwang, W.-J., & Ding, Z. (2020) · IEEE Access · doi:10.1109/access.2020.3001277 · Cited by 870
Learning-Based Computation Offloading for IoT Devices With Energy Harvesting
Min, M., Xiao, L., Chen, Y., Cheng, P., Wu, D., & Zhuang, W. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2890685 · Cited by 560
Metadata
- Authors
- Li, J., Gao, H., Lv, T., & Lu, Y.
- Affiliations
- Beijing University of Posts and Telecommunications (CN)
- Venue
- 2018 IEEE Wireless Communications and Networking Conference (WCNC)
- Publisher
- IEEE
- Published
- 2018-04
- Pages
- 1-6
- ISSN
- 1525-3511 (ISSN-L)
- OpenAlex
- W2808381205
- Cited by
- 548
- References
- 17
- Citations by year
- 2026: 16 · 2025: 45 · 2024: 73 · 2023: 83 · 2022: 92 · 2021: 96 · 2020: 94 · 2019: 45 · 2018: 4
- FWCI
- 49.38
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Wireless Communications and Networking Conference (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Wireless Network Optimization
- Physical Sciences › Engineering › Aerospace Engineering › UAV Applications and Optimization
- Keywords
- mobile edge computing, computation offloading, resource allocation, deep reinforcement learning, Q-learning, multi-user systems, energy consumption, delay cost, 5G
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.