The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Energy-Efficient UAV Control for Effective and Fair Communication Coverage: A Deep Reinforcement Learning Approach
Abstract
Unmanned aerial vehicles (UAVs) can be used to serve as aerial base stations to enhance both the coverage and performance of communication networks in various scenarios, such as emergency communications and network access for remote areas. Mobile UAVs can establish communication links for ground users to deliver packets. However, UAVs have limited communication ranges and energy resources. Particularly, for a large region, they cannot cover the entire area all the time or keep flying for a long time. It is thus challenging to control a group of UAVs to achieve certain communication coverage in a long run, while preserving their connectivity and minimizing their energy consumption. Toward this end, we propose to leverage emerging deep reinforcement learning (DRL) for UAV control and present a novel and highly energy-efficient DRL-based method, which we call DRL-based energy-efficient control for coverage and connectivity (DRL-EC3). The proposed method 1) maximizes a novel energy efficiency function with joint consideration for communications coverage, fairness, energy consumption and connectivity; 2) learns the environment and its dynamics; and 3) makes decisions under the guidance of two powerful deep neural networks. We conduct extensive simulations for performance evaluation. Simulation results have shown that DRL-EC3significantly and consistently outperform two commonly used baseline methods in terms of coverage, fairness, and energy consumption.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
(2016) · Cited by 11,679
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Jain, R., Chiu, D. M., & Hawe, W. (1998) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/9809099 · Cited by 3,523
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Unmanned Aerial Vehicle With Underlaid Device-to-Device Communications: Performance and Tradeoffs
Mozaffari, M., Saad, W., Bennis, M., & Debbah, M. (2016) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2016.2531652 · Cited by 1,126
Efficient Deployment of Multiple Unmanned Aerial Vehicles for Optimal Wireless Coverage
Mozaffari, M., Saad, W., Bennis, M., & Debbah, M. (2016) · IEEE Communications Letters · doi:10.1109/lcomm.2016.2578312 · Cited by 1,095
Cited by
Deep Learning in Mobile and Wireless Networking: A Survey
Zhang, C., Patras, P., & Haddadi, H. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2904897 · Cited by 1,768
UAV Communications for 5G and Beyond: Recent Advances and Future Trends
Li, B., Fei, Z., & Zhang, Y. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2887086 · Cited by 1,377
Artificial Neural Networks-Based Machine Learning for Wireless Networks: A Tutorial
Chen, M., Challita, U., Saad, W., Yin, C., & Debbah, M. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2926625 · Cited by 1,117
Artificial-Intelligence-Enabled Intelligent 6G Networks
Yang, H., Alphones, A., Xiong, Z., Niyato, D., Zhao, J., & Wu, K. (2020) · IEEE Network · doi:10.1109/mnet.011.2000195 · Cited by 589
Applications of artificial intelligence for disaster management
Sun, W., Bocchini, P., & Davison, B. D. (2020) · Natural Hazards · doi:10.1007/s11069-020-04124-3 · Cited by 491
UAV assistance paradigm: State-of-the-art in applications and challenges
Alzahrani, B., Oubbati, O. S., Barnawi, A., Atiquzzaman, M., & Alghazzawi, D. (2020) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2020.102706 · Cited by 437
3D Trajectory Optimization in Rician Fading for UAV-Enabled Data Harvesting
You, C., & Zhang, R. (2019) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2911939 · Cited by 414
A Survey on Machine-Learning Techniques for UAV-Based Communications
Bithas, P. S., Michailidis, E. T., Nomikos, N., Vouyioukas, D., & Kanatas, A. G. (2019) · Sensors · doi:10.3390/s19235170 · Cited by 353
Communication and Control in Collaborative UAVs: Recent Advances and Future Trends
Javaid, S., Saeed, N., Qadir, Z., Fahim, H., He, B., Song, H., & Bilal, M. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3248841 · Cited by 345
Reinforcement Learning in Multiple-UAV Networks: Deployment and Movement Design
Liu, X., Liu, Y., & Chen, Y. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2922849 · Cited by 342
Blockchain-Enabled Data Collection and Sharing for Industrial IoT With Deep Reinforcement Learning
Liu, C. H., Lin, Q., & Wen, S. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2890203 · Cited by 341
Self-citationDing, R., Gao, F., & Shen, X. S. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3016024 · Cited by 331
Deep Reinforcement Learning Based Dynamic Trajectory Control for UAV-Assisted Mobile Edge Computing
Wang, L., Wang, K., Pan, C., Xu, W., Aslam, N., & Nallanathan, A. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2021.3059691 · Cited by 324
Drone Deep Reinforcement Learning: A Review
Azar, A. T., Koubaa, A., Ali Mohamed, N., Ibrahim, H. A., Ibrahim, Z. F., Kazim, M., Ammar, A., Benjdira, B., Khamis, A. M., Hameed, I. A., et al. (2021) · Electronics · doi:10.3390/electronics10090999 · Cited by 314
“[67], DCNNP algorithm was used as a means for control, while in the [68], a new algorithm called DRL− EC3 was used in the control process for energy efficiency.”
MethodDeep Reinforcement Learning for Internet of Things: A Comprehensive Survey
Chen, W., Qiu, X., Cai, T., Dai, H.-N., Zheng, Z., & Zhang, Y. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3073036 · Cited by 311
AI for UAV-Assisted IoT Applications: A Comprehensive Review
Cheng, N., Wu, S., Wang, X., Yin, Z., Li, C., Chen, W., & Chen, F. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3268316 · Cited by 307
Liu, C. H., Ma, X., Gao, X., & Tang, J. (2020) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2019.2908171 · Cited by 301
Self-citationAI Models for Green Communications Towards 6G
Mao, B., Tang, F., Kawamoto, Y., & Kato, N. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3130901 · Cited by 300
Machine Learning Empowered Trajectory and Passive Beamforming Design in UAV-RIS Wireless Networks
Liu, X., Liu, Y., & Chen, Y. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3041401 · Cited by 298
Emerging UAV technology for disaster detection, mitigation, response, and preparedness
Khan, A., Gupta, S., & Gupta, S. K. (2022) · Journal of Field Robotics · doi:10.1002/rob.22075 · Cited by 297
Multi-Agent DRL for Task Offloading and Resource Allocation in Multi-UAV Enabled IoT Edge Network
Seid, A. M., Boateng, G. O., Mareri, B., Sun, G., & Jiang, W. (2021) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2021.3096673 · Cited by 285
Yang, T., Jiang, Z., Sun, R., Cheng, N., & Feng, H. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.2974047 · Cited by 261
Distributed Multi-Agent Meta Learning for Trajectory Design in Wireless Drone Networks
Hu, Y., Chen, M., Saad, W., Poor, H. V., & Cui, S. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3088689 · Cited by 152
Air-Ground Integrated Mobile Edge Networks: A Survey
Zhang, W., Li, L., Zhang, N., Han, T., & Wang, S. (2020) · IEEE Access · doi:10.1109/access.2020.3008168 · Cited by 75
Wang, Y., Yang, Y., & Luo, T. (2020) · 2020 IEEE International Conference on Communications Workshops (ICC Workshops) · doi:10.1109/iccworkshops49005.2020.9145090 · Cited by 13
Metadata
- Authors
- Liu, C. H., Chen, Z., Tang, J., Xu, J., & Piao, C.
- Venue
- IEEE Journal on Selected Areas in Communications
- Published
- 2018-09
- Volume
- 36
- Issue
- 9
- Pages
- 2059-2070
- ISSN
- 0733-8716 (ISSN-L)
- 1558-0008
- OpenAlex
- W2886509985
- Cited by
- 633
- References
- 33
- FWCI
- 48.36
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.