The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Deep Reinforcement Learning Based Dynamic Trajectory Control for UAV-Assisted Mobile Edge Computing
Open accessAbstract
In this paper, we consider a platform of flying mobile edge computing (F-MEC), where unmanned aerial vehicles (UAVs) serve as equipment providing computation resource, and they enable task offloading from user equipment (UE). We aim to minimize energy consumption of all UEs via optimizing user association, resource allocation and the trajectory of UAVs. To this end, we first propose a Convex optimizAtion based Trajectory control algorithm (CAT), which solves the problem in an iterative way by using block coordinate descent (BCD) method. Then, to make the real-time decision while taking into account the dynamics of the environment (i.e., UAV may take off from different locations), we propose a deep Reinforcement leArning based trajectory control algorithm (RAT). In RAT, we apply the Prioritized Experience Replay (PER) to improve the convergence of the training procedure. Different from the convex optimization based algorithm which may be susceptible to the initial points and requires iterations, RAT can be adapted to any taking off points of the UAVs and can obtain the solution more rapidly than CAT once training process has been completed. Simulation results show that the proposed CAT and RAT achieve the considerable performance and both outperform traditional algorithms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
A Survey on Mobile Edge Computing: The Communication Perspective
Mao, Y., You, C., Zhang, J., Huang, K., & Letaief, K. B. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2745201 · Cited by 5,607 · cited 1×
“In addition, some recent literature made efforts to mobile edge computing, which is considered to be a promising technology for bringing computing resource to the edge of wireless networks [20], where UEs can benefit from offloading their tasks to MEC servers.”
BackgroundDoes Gamification Work? -- A Literature Review of Empirical Studies on Gamification
Hamari, J., Koivisto, J., & Sarsa, H. (2014) · 2014 47th Hawaii International Conference on System Sciences · doi:10.1109/hicss.2014.377 · Cited by 5,201
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1023/a:1022676722315 · Cited by 3,907
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Optimal LAP Altitude for Maximum Coverage
Al-Hourani, A., Kandeepan, S., & Lardner, S. (2014) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2014.2342736 · Cited by 3,161
Schaul, T., Quan, J., Antonoglou, I., & Silver, D. (2015) · arXiv · doi:10.48550/arxiv.1511.05952 · Cited by 3,120
Energy Minimization for Wireless Communication With Rotary-Wing UAV
Zeng, Y., Xu, J., & Zhang, R. (2019) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2902559 · Cited by 2,172
Energy-Efficient UAV Communication With Trajectory Optimization
Zeng, Y., & Zhang, R. (2017) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2017.2688328 · Cited by 2,164
Joint Trajectory and Communication Design for Multi-UAV Enabled Wireless Networks
Wu, Q., Zeng, Y., & Zhang, R. (2018) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2017.2789293 · Cited by 1,978
Unmanned Aerial Vehicle With Underlaid Device-to-Device Communications: Performance and Tradeoffs
Mozaffari, M., Saad, W., Bennis, M., & Debbah, M. (2016) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2016.2531652 · Cited by 1,126
Mobile Unmanned Aerial Vehicles (UAVs) for Energy-Efficient Internet of Things Communications
Mozaffari, M., Saad, W., Bennis, M., & Debbah, M. (2017) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2017.2751045 · Cited by 1,093
Continuous control for robot based on deep reinforcement learning
Zhang, S. (2020) · doi:10.32657/10356/90191 · Cited by 951
Energy-Optimal Mobile Cloud Computing under Stochastic Wireless Channel
Zhang, W., Wen, Y., Guan, K., Kilper, D., Luo, H., & Wu, D. O. (2013) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2013.072513.121842 · Cited by 863
Computation Rate Maximization in UAV-Enabled Wireless-Powered Mobile-Edge Computing Systems
Zhou, F., Wu, Y., Hu, R. Q., & Qian, Y. (2018) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2018.2864426 · Cited by 851
Energy-Efficient Data Collection in UAV Enabled Wireless Sensor Network
Zhan, C., Zeng, Y., & Zhang, R. (2018) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2017.2776922 · Cited by 784
Wang, C., Liang, C., Yu, F. R., Chen, Q., & Tang, L. (2017) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2017.2703901 · Cited by 710
Liu, C. H., Chen, Z., Tang, J., Xu, J., & Piao, C. (2018) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2018.2864373 · Cited by 633
UAV-Enabled Wireless Power Transfer: Trajectory Design and Energy Optimization
Xu, J., Zeng, Y., & Zhang, R. (2018) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2018.2838134 · Cited by 600
Common Throughput Maximization in UAV-Enabled OFDMA Systems With Delay Consideration
Wu, Q., & Zhang, R. (2018) · IEEE Transactions on Communications · doi:10.1109/tcomm.2018.2865922 · Cited by 457
Energy Efficient Resource Allocation in UAV-Enabled Mobile Edge Computing Networks
Yang, Z., Pan, C., Wang, K., & Shikh-Bahaei, M. (2019) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2927313 · Cited by 451
Self-citationDing, R., Gao, F., & Shen, X. S. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3016024 · Cited by 331
UAV-Aided Offloading for Cellular Hotspot
Lyu, J., Zeng, Y., & Zhang, R. (2018) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2018.2818734 · Cited by 324
Caching UAV Assisted Secure Transmission in Hyper-Dense Networks Based on Interference Alignment
Zhao, N., Cheng, F., Yu, F. R., Tang, J., Chen, Y., Gui, G., & Sari, H. (2018) · IEEE Transactions on Communications · doi:10.1109/tcomm.2018.2792014 · Cited by 304
Joint Altitude and Beamwidth Optimization for UAV-Enabled Multiuser Communications
He, H., Zhang, S., Zeng, Y., & Zhang, R. (2018) · IEEE Communications Letters · doi:10.1109/lcomm.2017.2772254 · Cited by 265
Machine Learning for Wireless Connectivity and Security of Cellular-Connected UAVs
Challita, U., Ferdowsi, A., Chen, M., & Saad, W. (2019) · IEEE Wireless Communications · doi:10.1109/mwc.2018.1800155 · Cited by 238
Joint Resources and Workflow Scheduling in UAV-Enabled Wirelessly-Powered MEC for IoT Systems
Du, Y., Yang, K., Wang, K., Zhang, G., Zhao, Y., & Chen, D. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2935877 · Cited by 237
Self-citationEnergy-Efficient Admission of Delay-Sensitive Tasks for Mobile Edge Computing
Lyu, X., Tian, H., Ni, W., Zhang, Y., Zhang, P., & Liu, R. P. (2018) · IEEE Transactions on Communications · doi:10.1109/tcomm.2018.2799937 · Cited by 213
Deep-Learning-Based Joint Resource Scheduling Algorithms for Hybrid MEC Networks
Jiang, F., Wang, K., Dong, L., Pan, C., Xu, W., & Yang, K. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2954503 · Cited by 211
Self-citationJoint Precoding and RRH Selection for User-Centric Green MIMO C-RAN
Pan, C., Zhu, H., Gomes, N. J., & Wang, J. (2017) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2017.2671358 · Cited by 171
Self-citationAsheralieva, A., & Niyato, D. T. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2923702 · Cited by 167
Energy-Efficient Resource Allocation in UAV Based MEC System for IoT Devices
Du, Y., Wang, K., Yang, K., & Zhang, G. (2018) · Globecom · doi:10.1109/glocom.2018.8647789 · Cited by 121
Self-citationDynamic Resource Scheduling in Mobile Edge Cloud with Cloud Radio Access Network
Wang, X., Wang, K., Wu, S., Di, S., Jin, H., Yang, K., & Ou, S. (2018) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2018.2832124 · Cited by 109
Self-citationJiang, F., Wang, K., Dong, L., Pan, C., Xu, W., & Yang, K. (2020) · IEEE Network · doi:10.1109/mnet.011.2000440 · Cited by 108
Self-citationResponse Delay Optimization in Mobile Edge Computing Enabled UAV Swarm
Zhang, Q., Chen, J., Ji, L., Feng, Z., Han, Z., & Chen, Z. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.2964821 · Cited by 103
Joint Trajectory and Communication Design for Secure UAV Networks
Li, Z., Chen, M., Pan, C., Huang, N., Yang, Z., & Nallanathan, A. (2019) · IEEE Communications Letters · doi:10.1109/lcomm.2019.2898404 · Cited by 92
Self-citationAutonomous Relay for Millimeter-Wave Wireless Communications
Kong, L., Ye, L., Wu, F., Tao, M., Chen, G., & Vasilakos, A. V. (2017) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2017.2720518 · Cited by 83
Cited by
AI for UAV-Assisted IoT Applications: A Comprehensive Review
Cheng, N., Wu, S., Wang, X., Yin, Z., Li, C., Chen, W., & Chen, F. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3268316 · Cited by 307
Yang, H., Zhao, J., Xiong, Z., Lam, K.-Y., Sun, S., & Xiao, L. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3088655 · Cited by 306
Toward Autonomous Multi-UAV Wireless Network: A Survey of Reinforcement Learning-Based Approaches
Bai, Y., Zhao, H., Zhang, X., Chang, Z., Jäntti, R., & Yang, K. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3323344 · Cited by 295
Metadata
- Authors
- Wang, L., Wang, K., Pan, C., Xu, W., Aslam, N., & Nallanathan, A.
- Venue
- IEEE Transactions on Mobile Computing
- Published
- 2022-10-01
- Volume
- 21
- Issue
- 10
- Pages
- 3536-3550
- ISSN
- 1536-1233 (ISSN-L)
- 1558-0660
- 2161-9875
- OpenAlex
- W3131765381
- Cited by
- 324
- References
- 39
- FWCI
- 25.47
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.