Edge QoE: Computation Offloading With Deep Reinforcement Learning for Internet of Things
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
In edge-enabled Internet of Things (IoT), computation offloading service is expected to offer users with better Quality of Experience (QoE) than traditional IoT. Unfortunately, the growing multiple tasks from users are occuring with the emergence of the IoT environment. Meanwhile, the current computation offloading with QoE is solved by deep reinforcement learning (DRL) with the issue of instability and slow convergence. Therefore, improving the QoE in edge-enabled IoT is still the ultimate challenge. In this article, to enhance the QoE, we propose a new QoE model to study the computation offloading. Specifically, the emerged QoE model can capture three influential elements: 1) service latency determined by local computing latency and transmission latency; 2) energy consumption according to local calculation and transmission consumption; and 3) task success rate based on the coding error probability. Moreover, we improve the deep deterministic policy gradients (DDPG) algorithm and propose a algorithm named the double-dueling-deterministic policy gradients (D3PG) based on the proposed model. Specifically, the actor network highly relies on the critic network, which makes the performance of the DDPG sensitive to the critic and thus leads to poor stability and slow convergence in the computation offloading process. To solve this, we redesign the critic network by using Double Q -learning and Dueling networks. Extensive experiments verify the better stability and faster convergence of our proposed algorithm than existing methods. In addition, experiments also indicate that our proposed algorithm can improve the QoE performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dueling Network Architectures for Deep Reinforcement Learning
Wang, Z., Schaul, T., Hessel, M., van Hasselt, H., Lanctot, M., & de Freitas, N. (2015) · arXiv · doi:10.48550/arxiv.1511.06581 · Cited by 3,300
Efficient multi-user computation offloading for mobile-edge cloud computing
Chen, X., Jiao, L., Li, W., & Fu, X. (2016) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2015.2487344 · Cited by 2,675
Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing
Zhou, Z., Chen, X., Li, E., Zeng, L., Luo, K., & Zhang, J. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2918951 · Cited by 2,455 · cited 1×
“ity of coding error probability [13].”
Chen, X., Zhang, H., Wu, C., Mao, S., Ji, Y., & Bennis, M. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2876279 · Cited by 680
Learning-Based Computation Offloading for IoT Devices With Energy Harvesting
Min, M., Xiao, L., Chen, Y., Cheng, P., Wu, D., & Zhuang, W. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2890685 · Cited by 560
Deep Reinforcement Learning based Resource Allocation in Low Latency Edge Computing Networks
Yang, T., Hu, Y., Gursoy, M. C., Schmeink, A., & Mathar, R. (2018) · 2018 15th International Symposium on Wireless Communication Systems (ISWCS) · doi:10.1109/iswcs.2018.8491089 · Cited by 156
Collaborative Distributed Q-Learning for RACH Congestion Minimization in Cellular IoT Networks
Sharma, S. K., & Wang, X. (2019) · IEEE Communications Letters · doi:10.1109/lcomm.2019.2896929 · Cited by 88
Cited by
Channel prior convolutional attention for medical image segmentation
Huang, H., Chen, Z., Zou, Y., Lu, M., Chen, C., Song, Y., Zhang, H., & Yan, F. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108784 · Cited by 342
Shakarami, A., Ghobaei-Arani, M., & Shahidinejad, A. (2020) · Computer Networks · doi:10.1016/j.comnet.2020.107496 · Cited by 331
A DRL Agent for Jointly Optimizing Computation Offloading and Resource Allocation in MEC
Chen, J., Xing, H., Xiao, Z., Xu, L., & Tao, T. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3081694 · Cited by 273
Goudarzi, M., Palaniswami, M., & Buyya, R. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2021.3123165 · Cited by 155
“[21] proposed a Deep Deterministic Policy Gradients (DDPG)-based algorithm for computation offloading of multiple IoT users to a single edge server to improve the quality of experience of users.”
Background
Metadata
- Authors
- Lu, H., He, X., Du, M., Ruan, X., Sun, Y., & Wang, K.
- Venue
- IEEE Internet of Things Journal
- Published
- 2020-10
- Volume
- 7
- Issue
- 10
- Pages
- 9255-9265
- ISSN
- 2327-4662 (ISSN-L)
- 2372-2541
- OpenAlex
- W3012434840
- Cited by
- 176
- References
- 7
- FWCI
- 14.97
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.