The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Task Offloading and Resource Allocation for Mobile Edge Computing by Deep Reinforcement Learning Based on SARSA
Open accessAbstract
In recent years, computation offloading has become an effective way to overcome the constraints of mobile devices (MDs) by offloading delay-sensitive and computation-intensive mobile application tasks to remote cloud-based data centers. Smart cities can benefit from offloading to edge points in the framework of the so-called cyber-physical-social systems (CPSS), as for example in traffic violation tracking cameras. We assume that there are mobile edge computing networks (MECNs) in more than one region, and they consist of multiple access points, multi-edge servers, and N MDs, where each MD has M independent real-time massive tasks. The MDs can connect to a MECN through the access points or the mobile network. Each task be can processed locally by the MD itself or remotely. There are three offloading options: nearest edge server, adjacent edge server, and remote cloud. We propose a reinforcement-learning-based state-action-reward-state-action (RL-SARSA) algorithm to resolve the resource management problem in the edge server, and make the optimal offloading decision for minimizing system cost, including energy consumption and computing time delay. We call this method OD-SARSA (offloading decision-based SARSA). We compared our proposed method with reinforcement learning based Q learning (RL-QL), and it is concluded that the performance of the former is superior to that of the latter.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fog computing and its role in the internet of things
Bonomi, F., Milito, R., Zhu, J., & Addepalli, S. (2012) · Proceedings of the first edition of the MCC workshop on Mobile cloud computing · doi:10.1145/2342509.2342513 · Cited by 6,244
Efficient multi-user computation offloading for mobile-edge cloud computing
Chen, X., Jiao, L., Li, W., & Fu, X. (2016) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2015.2487344 · Cited by 2,675
Dynamic computation offloading for mobile-edge computing with energy harvesting devices
Mao, Y., Zhang, J., & Letaief, K. B. (2016) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2016.2611964 · Cited by 1,705
On-line Q-learning Using Connectionist Systems
Rummery, G. A. (1994) · Cited by 1,477
The challenges of mobile computing
Forman, G. H., & Zahorjan, J. (1994) · Computer · doi:10.1109/2.274999 · Cited by 880
Energy-Efficient Offloading for Mobile Edge Computing in 5G Heterogeneous Networks
Zhang, K., Mao, Y., Leng, S., Zhao, Q., Li, L., Peng, X., Pan, L., Maharjan, S., & Zhang, Y. (2016) · IEEE Access · doi:10.1109/access.2016.2597169 · Cited by 855
Delay-optimal computation task scheduling for mobile-edge computing systems
Liu, J., Mao, Y., Zhang, J., & Letaief, K. B. (2016) · 2016 IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.2016.7541539 · Cited by 759
Dynamic Task Offloading and Resource Allocation for Ultra-Reliable Low-Latency Edge Computing
Liu, C.-F., Bennis, M., Debbah, M., & Poor, H. V. (2019) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2898573 · Cited by 435
Femto clouds: leveraging mobile devices to provide cloud service at the edge
Habak, K., Ammar, M., Harras, K. A., & Zegura, E. (2015) · 2015 IEEE 8th International Conference on Cloud Computing · doi:10.1109/cloud.2015.12 · Cited by 291
Mobile computing: the next decade
Satyanarayanan, M. (2010) · Proceedings of the 1st ACM Workshop on Mobile Cloud Computing & Services: Social Networks and Beyond · doi:10.1145/1810931.1810936 · Cited by 193
Deep reinforcement learning with experience replay based on SARSA
Zhao, D., Wang, H., Shao, K., & Zhu, Y. (2016) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci.2016.7849837 · Cited by 153
Zhao, T., Zhou, S., Guo, X., Yun, Z., & Niu, Z. (2015) · IEEE Globecom Workshops (GC Wkshps) · doi:10.1109/glocomw.2015.7414063 · Cited by 149
Eshratifar, A. E., & Pedram, M. (2018) · ACM Great Lakes Symposium on VLSI (GLSVLSI) · doi:10.1145/3194554.3194565 · Cited by 115
Joint resource allocation and offloading strategies in cloud enabled cellular networks
Kamoun, M., Labidi, W., & Sarkiss, M. (2015) · International Conference on Communications · doi:10.1109/icc.2015.7249203 · Cited by 103
Computation Offloading and Activation of Mobile Edge Computing Servers: A Minority Game
Ranadheera, S., Maghsudi, S., & Hossain, E. (2018) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2018.2810292 · Cited by 93
MVR: An Architecture for Computation Offloading in Mobile Edge Computing
Wei, X., Wang, S., Zhou, A., Xu, J., Su, S., Kumar, S., & Yang, F. (2017) · IEEE International Conference on Edge Computing and Communications (EDGE) · doi:10.1109/ieee.edge.2017.42 · Cited by 89
Guo, X., Singh, R., Zhao, T., & Niu, Z. (2016) · International Conference on Communications · doi:10.1109/icc.2016.7511147 · Cited by 76
Efficient Computation Offloading Decision in Mobile Cloud Computing over 5G Network
Khoda, M. E., Razzaque, M. A., Almogren, A., Hassan, M. M., Alamri, A. M., & Alelaiwi, A. A. (2016) · Mobile Networks and Applications · doi:10.1007/s11036-016-0688-6 · Cited by 60
Self-citationDeep Reinforcement Learning-Based Task Offloading and Resource Allocation for Mobile Edge Computing
Huang, L. P., Xu, F., Qian, L., & Wu, Y. (2018) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-030-00557-3_4 · Cited by 44
On Using Edge Computing for Computation Offloading in Mobile Network
Messaoudi, F., Ksentini, A., & Bertin, P. (2017) · Globecom · doi:10.1109/glocom.2017.8254635 · Cited by 37
Performance evaluation of computation offloading from mobile device to the edge of mobile network
Doležal, J., Bečvář, Z., & Zeman, T. (2016) · IEEE Conference on Standards for Communications and Networking · doi:10.1109/cscn.2016.7785153 · Cited by 34
Optimal Virtual Machines allocation in mobile femto-cloud computing: An MDP approach
Valerio, V. D., & Presti, F. L. (2014) · IEEE Wireless Communications and Networking Conference Workshops (WCNCW) · doi:10.1109/wcncw.2014.6934852 · Cited by 30
A Comparison of learning algorithms on the Arcade Learning EnvironmentPreprint
Defazio, A., & Graepel, T. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1410.8620 · Cited by 22
Optimal Offloading Decision Strategies and Their Influence Analysis of Mobile Edge Computing
Xu, J., Hao, Z., & Sun, X. (2019) · Sensors · doi:10.3390/s19143231 · Cited by 19
A cluster based computation offloading technique for mobile cloud computing in smart cities
Mazza, D., Tarchi, D., & Corazza, G. E. (2016) · International Conference on Communications · doi:10.1109/icc.2016.7511054 · Cited by 17
Energy-Efficient Autonomic Offloading in Mobile Edge Computing
Luo, C., Salinas, S., Li, M., & Li, P. (2017) · IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech) · doi:10.1109/dasc-picom-datacom-cyberscitec.2017.104 · Cited by 14
Cited by
Deep Reinforcement Learning for Energy-Efficient Computation Offloading in Mobile-Edge Computing
Zhou, H., Jiang, K., Liu, X., Li, X., & Leung, V. C. M. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3091142 · Cited by 350
A Survey on Task Offloading in Multi-access Edge Computing
Islam, A., Debnath, A., Ghose, M., & Chakraborty, S. (2021) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2021.102225 · Cited by 271
Deep Reinforcement Adversarial Learning Against Botnet Evasion Attacks
Apruzzese, G., Andreolini, M., Marchetti, M., Venturi, A., & Colajanni, M. (2020) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2020.3031843 · Cited by 117
Metadata
- Authors
- Alfakih, T., Hassan, M. M., Gumaei, A., Savaglio, C., & Fortino, G.
- Venue
- IEEE Access
- Published
- 2020
- Volume
- 8
- Pages
- 54074-54084
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W3010723141
- Cited by
- 317
- References
- 26
- FWCI
- 22.98
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.