The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Resource Allocation Based on Deep Reinforcement Learning in IoT Edge Computing
Abstract
By leveraging mobile edge computing (MEC), a huge amount of data generated by Internet of Things (IoT) devices can be processed and analyzed at the network edge. However, the MEC system usually only has the limited virtual resources, which are shared and competed by IoT edge applications. Thus, we propose a resource allocation policy for the IoT edge computing system to improve the efficiency of resource utilization. The objective of the proposed policy is to minimize the long-term weighted sum of average completion time of jobs and average number of requested resources. The resource allocation problem in the MEC system is formulated as a Markov decision process (MDP). A deep reinforcement learning approach is applied to solve the problem. We also propose an improved deep Q-network (DQN) algorithm to learn the policy, where multiple replay memories are applied to separately store the experiences with small mutual influence. Simulation results show that the proposed algorithm has a better convergence performance than the original DQN algorithm, and the corresponding policy outperforms the other reference policies by lower completion time with fewer requested resources.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Edge computing: Vision and challenges
Shi, W., Cao, J., Zhang, Q., Li, Y., & Xu, L. (2016) · IEEE Internet of Things Journal · doi:10.1109/jiot.2016.2579198 · Cited by 8,733
Trust region policy optimization
Schulman, J., Levine, S., Moritz, P., Jordan, M. I., & Abbeel, P. (2015) · arXiv · doi:10.48550/arxiv.1502.05477 · Cited by 4,578
Mobile Edge Computing: A Survey on Architecture and Computation Offloading
Mach, P., & Becvar, Z. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2682318 · Cited by 3,258
Mobile Edge Computing: A Survey
Abbas, N., Zhang, Y., Taherkordi, A., & Skeie, T. (2018) · IEEE Internet of Things Journal · doi:10.1109/jiot.2017.2750180 · Cited by 2,474
A Survey on the Edge Computing for the Internet of Things
Yu, W., Liang, F., He, X., Hatcher, W. G., Lu, C., Lin, J., & Yang, X. (2018) · IEEE Access · doi:10.1109/access.2017.2778504 · Cited by 1,520 · cited 1×
“With the aid of MEC system, the sensor data can be processed and analyzed immediately at the edge of the mobile network instead of forwarded directly to the remote IoT cloud, which not only facilitates low latency, but also eases security and backhaul impacts [7]–[11].”
MethodResource Management with Deep Reinforcement Learning
Mao, H., Alizadeh, M., Menache, I., & Kandula, S. (2016) · Proceedings of the 15th ACM Workshop on Hot Topics in Networks · doi:10.1145/3005745.3005750 · Cited by 1,353 · cited 1×
“time [35].”
Future Edge Cloud and Edge Computing for Internet of Things Applications
Pan, J., & McElhannon, J. (2018) · IEEE Internet of Things Journal · doi:10.1109/jiot.2017.2767608 · Cited by 868
Survey on Multi-Access Edge Computing for Internet of Things Realization
Porambage, P., Okwuibe, J., Liyanage, M., Ylianttila, M., & Taleb, T. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2849509 · Cited by 795
Edge Computing for the Internet of Things: A Case Study
Premsankar, G., Di Francesco, M., & Taleb, T. (2018) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2805263 · Cited by 697
Reinforcement Learning: State-of-the-Art
(2012) · Adaptation, Learning, and Optimization · doi:10.1007/978-3-642-27645-3 · Cited by 691
He, Y., Zhao, N., & Yin, H. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2017.2760281 · Cited by 569
Deep reinforcement learning based computation offloading and resource allocation for MEC
Li, J., Gao, H., Lv, T., & Lu, Y. (2018) · 2018 IEEE Wireless Communications and Networking Conference (WCNC) · doi:10.1109/wcnc.2018.8377343 · Cited by 548
Mobile-edge computing architecture: the role of mec in the internet of things
Sabella, D., Vaillant, A., Kuure, P., Rauschenbach, U., & Giust, F. (2016) · IEEE Consumer Electronics Magazine · doi:10.1109/mce.2016.2590118 · Cited by 413
Wei, Y., Yu, F. R., Song, M., & Han, Z. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2878435 · Cited by 321
Deep Reinforcement Learning for Autonomous Internet of Things: Model, Applications and Challenges
Lei, L., Tan, Y., Zheng, K., Liu, S., Zhang, K., & Shen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2988367 · Cited by 298
Self-citationHuang, L., Feng, X., Zhang, C., Qian, L., & Wu, Y. (2019) · Digital Communications and Networks · doi:10.1016/j.dcan.2018.10.003 · Cited by 261
An SMDP-Based Resource Allocation in Vehicular Cloud Computing Systems
Zheng, K., Meng, H., Chatzimisios, P., Lei, L., & Shen, X. (2015) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2015.2482119 · Cited by 239
Self-citationDynamic Radio Resource Slicing for a Two-Tier Heterogeneous Wireless Network
Ye, Q., Zhuang, W., Zhang, S., Jin, A.-L., Shen, X., & Li, X. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2859740 · Cited by 164
Ye, Q. J., Li, J., Qu, K., Zhuang, W., Shen, X., & Li, X. (2018) · IEEE Vehicular Technology Magazine · doi:10.1109/mvt.2018.2809473 · Cited by 158
Performance Optimization in Mobile-Edge Computing via Deep Reinforcement Learning
Chen, X., Zhang, H., Wu, C., Mao, S., Ji, Y., & Bennis, M. (2018) · 2018 IEEE 88th Vehicular Technology Conference (VTC-Fall) · doi:10.1109/vtcfall.2018.8690980 · Cited by 158
Evaluating Performance of Containerized IoT Services for Clustered Devices at the Network Edge
Morabito, R., Farris, I., Iera, A., & Taleb, T. (2017) · IEEE Internet of Things Journal · doi:10.1109/jiot.2017.2714638 · Cited by 133
Zheng, Q., Zheng, K., Zhang, H., & Leung, V. C. M. (2016) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2016.2538461 · Cited by 132
Self-citationPeng, H., Ye, Q. J., & Shen, X. (2019) · IEEE Wireless Communications · doi:10.1109/mwc.2019.1800371 · Cited by 132
Energy and Delay Aware Task Assignment Mechanism for UAV-Based IoT Platform
Motlagh, N. H., Bagaa, M., & Taleb, T. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2907873 · Cited by 127
Resource Allocation for Edge Computing in IoT Networks via Reinforcement Learning
Liu, X., Qin, Z., & Gao, Y. (2019) · International Conference on Communications · doi:10.1109/icc.2019.8761385 · Cited by 127
M2M Communications in 5G: State-of-the-Art Architecture, Recent Advances, and Research Challenges
Mehmood, Y., Haider, N., Imran, M., Timm-Giel, A., & Guizani, M. (2017) · IEEE Communications Magazine · doi:10.1109/mcom.2017.1600559 · Cited by 115
Nassar, A. T., & Yılmaz, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2939735 · Cited by 96
Multiuser Resource Control With Deep Reinforcement Learning in IoT Edge Computing
Lei, L., Xu, H., Xiong, X., Zheng, K., Xiang, W., & Wang, X. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2935543 · Cited by 77
Self-citationEiF: Toward an Elastic IoT Fog Framework for AI Services
An, J., Li, W., Gall, F. L., Kovac, E., Kim, J., Taleb, T., & Song, J. (2019) · IEEE Communications Magazine · doi:10.1109/mcom.2019.1800215 · Cited by 43
Cited by
Resource Scheduling in Edge Computing: A Survey
Luo, Q., Hu, S., Li, C., Li, G., & Shi, W. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3106401 · Cited by 588
Peng, H., & Shen, X. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3036962 · Cited by 521
Joint Task Offloading and Resource Allocation for Energy-Constrained Mobile Edge Computing
Jiang, H., Dai, X., Xiao, Z., & Iyengar, A. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3150432 · Cited by 411
Federated Learning in Edge Computing: A Systematic Survey
Abreha, H. G., Hayajneh, M., & Serhani, M. A. (2022) · Sensors · doi:10.3390/s22020450 · Cited by 342
A DRL Agent for Jointly Optimizing Computation Offloading and Resource Allocation in MEC
Chen, J., Xing, H., Xiao, Z., Xu, L., & Tao, T. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3081694 · Cited by 273
Metadata
- Authors
- Xiong, X., Zheng, K., Lei, L., & Hou, L.
- Venue
- IEEE Journal on Selected Areas in Communications
- Published
- 2020-06
- Volume
- 38
- Issue
- 6
- Pages
- 1133-1146
- ISSN
- 0733-8716 (ISSN-L)
- 1558-0008
- OpenAlex
- W3015366655
- Cited by
- 302
- References
- 31
- FWCI
- 18.86
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.