The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Fast Adaptive Task Offloading in Edge Computing Based on Meta Reinforcement Learning
Open accessAbstract
Multi-access edge computing (MEC) aims to extend cloud service to the network edge to reduce network traffic and service latency. A fundamental problem in MEC is how to efficiently offload heterogeneous tasks of mobile applications from user equipment (UE) to MEC hosts. Recently, many deep reinforcement learning (DRL)-based methods have been proposed to learn offloading policies through interacting with the MEC environment that consists of UE, wireless channels, and MEC hosts. However, these methods have weak adaptability to new environments because they have low sample efficiency and need full retraining to learn updated policies for new environments. To overcome this weakness, we propose a task offloading method based on meta reinforcement learning, which can adapt fast to new environments with a small number of gradient updates and samples. We model mobile applications as Directed Acyclic Graphs (DAGs) and the offloading policy by a custom sequence-to-sequence (seq2seq) neural network. To efficiently train the seq2seq network, we propose a method that synergizes the first order approximation and clipped surrogate objective. The experimental results demonstrate that this new offloading method can reduce the latency by up to 25 percent compared to three baselines while being able to adapt fast to new environments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512
A Survey on Mobile Edge Computing: The Communication Perspective
Mao, Y., You, C., Zhang, J., Huang, K., & Letaief, K. B. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2745201 · Cited by 5,607 · cited 2×
“binary offloading and that for partial offloading [29].”
BackgroundHigh-Dimensional Continuous Control Using Generalized Advantage Estimation
Schulman, J., Moritz, P., Levine, S., Jordan, M., & Abbeel, P. (2015) · arXiv · doi:10.48550/arxiv.1506.02438 · Cited by 2,103
Vinyals, O., Fortunato, M., & Jaitly, N. (2015) · neural information processing systems · Cited by 2,043
On First-Order Meta-Learning Algorithms
Nichol, A., Achiam, J., & Schulman, J. (2018) · arXiv · doi:10.48550/arxiv.1803.02999 · Cited by 1,438
Task Offloading for Mobile Edge Computing in Software Defined Ultra-Dense Network
Chen, M., & Hao, Y. (2018) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2018.2815360 · Cited by 1,068
Huang, L., Bi, S., & Zhang, Y.-J. A. (2020) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2019.2928811 · Cited by 1,040
Offloading in Mobile Edge Computing: Task Allocation and Computational Frequency Scaling
Thinh, T. Q., Tang, J., La, Q. D., & Quek, T. Q. S. (2017) · IEEE Transactions on Communications · doi:10.1109/tcomm.2017.2699660 · Cited by 866
Chen, X., Zhang, H., Wu, C., Mao, S., Ji, Y., & Bennis, M. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2876279 · Cited by 680
Reinforcement learning, fast and slow
Botvinick, M., Ritter, S., Wang, J. X., Kurth-Nelson, Z., Blundell, C., & Hassabis, D. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.02.006 · Cited by 667
Self-citationList Scheduling Algorithm for Heterogeneous Systems by an Optimistic Cost Table
Arabnejad, H., & Barbosa, J. G. (2014) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2013.57 · Cited by 653
Odessa: enabling interactive perception applications on mobile devices
Ra, M.-R., Sheth, A., Mummert, L., Pillai, P., Wetherall, D., & Govindan, R. (2011) · Proceedings of the 9th international conference on Mobile systems, applications, and services · doi:10.1145/1999995.2000000 · Cited by 361
Mobility-Aware Edge Caching and Computing in Vehicle Networks: A Deep Reinforcement Learning
Tan, L. T., & Hu, R. Q. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2867191 · Cited by 356
Energy-Efficient Resource Allocation for Mobile Edge Computing-Based Augmented Reality Applications
Al-Shuwaili, A., & Simeone, O. (2017) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2017.2696539 · Cited by 350
Deep-Reinforcement-Learning-Based Offloading Scheduling for Vehicular Edge Computing
Zhan, W., Luo, C., Wang, J., Wang, C., Min, G., Duan, H., & Zhu, Q. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2978830 · Cited by 319
Self-citationDeep Reinforcement Learning for Vehicular Edge Computing: An Intelligent Offloading System
Ning, Z., Dong, P., Wang, X., Rodrigues, J. J. P. C., & Xia, F. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3317572 · Cited by 292
Huang, L., Feng, X., Zhang, C., Qian, L., & Wu, Y. (2019) · Digital Communications and Networks · doi:10.1016/j.dcan.2018.10.003 · Cited by 261
Lin, X., Wang, Y., Xie, Q., & Pedram, M. (2015) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2014.2381227 · Cited by 257
Wang, J., Hu, J., Min, G., Zhan, W., Ni, Q., & Georgalas, N. (2019) · IEEE Communications Magazine · doi:10.1109/mcom.2019.1800971 · Cited by 254
Self-citationOptimal Joint Scheduling and Cloud Offloading for Mobile Applications
Mahmoodi, S. E., Uma, R. N., & Subbalakshmi, K. P. (2019) · IEEE Transactions on Cloud Computing · doi:10.1109/tcc.2016.2560808 · Cited by 238
Cellular Network Traffic Scheduling With Deep Reinforcement Learning
Chinchali, S., Hu, P., Chu, T., Sharma, M., Bansal, M., Misra, R., Pavone, M., & Katti, S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11339 · Cited by 218 · cited 1×
“Deep reinforcement learning, which combines reinforcement learning (RL) with Deep Neural Network (DNN), provides a promising solution to the above challenge, because DRL can learn to solve complex problems such as games [7], robotics [8], and traffic scheduling [9] by trial and error with-”
BackgroundLearning for Computation Offloading in Mobile Edge Computing
Dinh, T. Q., La, Q. D., Quek, T. Q. S., & Shin, H. (2018) · IEEE Transactions on Communications · doi:10.1109/tcomm.2018.2866572 · Cited by 214
Efficient Off-Policy Meta-Reinforcement Learning via Probabilistic Context Variables
Rakelly, K., Zhou, A., Quillen, D., Finn, C., & Levine, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.08254 · Cited by 203
Mobility-Aware Multi-User Offloading Optimization for Mobile Edge Computing
Zhan, W., Luo, C., Min, G., Wang, C., Zhu, Q., & Duan, H. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.2966500 · Cited by 203
Self-citationOnline Placement of Multi-Component Applications in Edge Computing Environments
Wang, S., Zafer, M., & Leung, K. K. (2017) · IEEE Access · doi:10.1109/access.2017.2665971 · Cited by 191
Vanschoren, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.03548 · Cited by 169
ULOOF: A User Level Online Offloading Framework for Mobile Edge Computing
Neto, J. L. D., Yu, S.-Y., Macedo, D. F., Nogueira, J. M. S., Langar, R., & Secci, S. (2018) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2018.2815015 · Cited by 162
An Efficient Application Partitioning Algorithm in Mobile Environments
Wu, H., Knottenbelt, W. J., & Wolter, K. (2019) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2019.2891695 · Cited by 125
Avatar: Mobile Distributed Computing in the Cloud
Borcea, C., Ding, X., Gehani, N., Curtmola, R., Khan, M. A. R., & Debnath, H. (2015) · IEEE International Conference on Mobile Cloud Computing, Services, and Engineering (MobileCloud) · doi:10.1109/mobilecloud.2015.22 · Cited by 41
Adaptive Avatar Handoff in the Cloudlet Network
Sun, X., & Ansari, N. (2017) · IEEE Transactions on Cloud Computing · doi:10.1109/tcc.2017.2701794 · Cited by 40
QoE-Aware Computation Offloading to Capture Energy-Latency-Pricing Tradeoff in Mobile Clouds
Hong, S.-T., & Kim, H. (2018) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2018.2871460 · Cited by 38
Automated selection of offloadable tasks for mobile computation offloading in edge computing
Zanni, A., Yu, S.-Y., Bellavista, P., Langar, R., & Secci, S. (2017) · International Conference on Network and Service Management (CNSM) · doi:10.23919/cnsm.2017.8256026 · Cited by 12
Cited by
Xu, M., Ng, W. C., Lim, W. Y. B., Kang, J., Xiong, Z., Niyato, D., Yang, Q., Shen, X., & Miao, C. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3221119 · Cited by 564
Deep-Learning-Enhanced Multitarget Detection for End–Edge–Cloud Surveillance in Smart IoT
Zhou, X., Xu, X., Liang, W., Zeng, Z., & Yan, Z. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3077449 · Cited by 332
Chai, F., Zhang, Q., Yao, H., Xin, X., Gao, R., & Guizani, M. (2023) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2023.3238771 · Cited by 331
DMRO: A Deep Meta Reinforcement Learning-Based Task Offloading Framework for Edge-Cloud Computing
Qu, G., Wu, H., Li, R., & Jiao, P. (2021) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2021.3087258 · Cited by 300
A Survey on Task Offloading in Multi-access Edge Computing
Islam, A., Debnath, A., Ghose, M., & Chakraborty, S. (2021) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2021.102225 · Cited by 271
Metadata
- Authors
- Wang, J., Hu, J., Min, G., Zomaya, A. Y., & Georgalas, N.
- Venue
- IEEE Transactions on Parallel and Distributed Systems
- Published
- 2021-01-01
- Volume
- 32
- Issue
- 1
- Pages
- 242-253
- ISSN
- 1045-9219 (ISSN-L)
- 1558-2183
- 2161-9883
- OpenAlex
- W3047538493
- Cited by
- 414
- References
- 37
- FWCI
- 22.51
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.