The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Energy-Efficient UAV Control for Effective and Fair Communication Coverage: A Deep Reinforcement Learning Approach
Abstract
Unmanned aerial vehicles (UAVs) can be used to serve as aerial base stations to enhance both the coverage and performance of communication networks in various scenarios, such as emergency communications and network access for remote areas. Mobile UAVs can establish communication links for ground users to deliver packets. However, UAVs have limited communication ranges and energy resources. Particularly, for a large region, they cannot cover the entire area all the time or keep flying for a long time. It is thus challenging to control a group of UAVs to achieve certain communication coverage in a long run, while preserving their connectivity and minimizing their energy consumption. Toward this end, we propose to leverage emerging deep reinforcement learning (DRL) for UAV control and present a novel and highly energy-efficient DRL-based method, which we call DRL-based energy-efficient control for coverage and connectivity (DRL-EC3). The proposed method 1) maximizes a novel energy efficiency function with joint consideration for communications coverage, fairness, energy consumption and connectivity; 2) learns the environment and its dynamics; and 3) makes decisions under the guidance of two powerful deep neural networks. We conduct extensive simulations for performance evaluation. Simulation results have shown that DRL-EC3significantly and consistently outperform two commonly used baseline methods in terms of coverage, fairness, and energy consumption.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
(2016) · Cited by 11,679
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Jain, R., Chiu, D. M., & Hawe, W. (1998) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/9809099 · Cited by 3,523
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Unmanned Aerial Vehicle With Underlaid Device-to-Device Communications: Performance and Tradeoffs
Mozaffari, M., Saad, W., Bennis, M., & Debbah, M. (2016) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2016.2531652 · Cited by 1,126
Efficient Deployment of Multiple Unmanned Aerial Vehicles for Optimal Wireless Coverage
Mozaffari, M., Saad, W., Bennis, M., & Debbah, M. (2016) · IEEE Communications Letters · doi:10.1109/lcomm.2016.2578312 · Cited by 1,095
Mobile Unmanned Aerial Vehicles (UAVs) for Energy-Efficient Internet of Things Communications
Mozaffari, M., Saad, W., Bennis, M., & Debbah, M. (2017) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2017.2751045 · Cited by 1,093
1Unmanned Aerial Vehicle with Underlaid Device-to-Device Communications: Performance and Tradeoffs
Mozaffari, M., Member, S., Saad, W., Member, S., Member, S., & Debbah, M. A. (2016) · Cited by 760
Chen, M., Mozaffari, M., Saad, W., Yin, C., Debbah, M., & Hong, C. S. (2017) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2017.2680898 · Cited by 742
Drone Small Cells in the Clouds: Design, Deployment and Performance Analysis
Mozaffari, M., Saad, W., Bennis, M., & Debbah, M. (2015) · 2015 IEEE Global Communications Conference (GLOBECOM) · doi:10.1109/glocom.2015.7417609 · Cited by 632
The Emerging Internet of Things Marketplace From an Industrial Perspective: A Survey
Perera, C., Liu, C. H., & Jayawardena, S. (2015) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2015.2390034 · Cited by 556
Self-citationAlzenad, M., El-Keyi, A., & Yanikomeroglu, H. (2018) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2017.2752161 · Cited by 514
Ultra Reliable UAV Communication Using Altitude and Cooperation Diversity
Azari, M. M., Rosas, F., Chen, K.-C., & Pollin, S. (2018) · IEEE Transactions on Communications · doi:10.1109/tcomm.2017.2746105 · Cited by 448
Mozaffari, M., Saad, W., Bennis, M., & Debbah, M. A. (2017) · HAL · Cited by 362
Energy-Aware Coverage Path Planning of UAVs
Di Franco, C., & Buttazzo, G. (2015) · 2015 IEEE International Conference on Autonomous Robot Systems and Competitions · doi:10.1109/icarsc.2015.17 · Cited by 360
Decentralized model predictive control of cooperating UAVs
Richards, A., & How, J. (2004) · 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601) · doi:10.1109/cdc.2004.1429425 · Cited by 227
Q-PrOP: Sample-efficient policy gradient with an off-policy critic
Gu, S., Lillicrap, T., Ghahramani, Z., Turner, R. E., & Levine, S. (2016) · arXiv (Cornell University) · doi:10.17863/cam.21294 · Cited by 174
Learning-Based Energy-Efficient Data Collection by Unmanned Vehicles in Smart Cities
Zhang, B., Liu, C. H., Tang, J., Xu, Z., Ma, J., & Wang, W. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2783439 · Cited by 166
Self-citationEfficient 3D placement of a UAV using particle swarm optimization
Shakhatreh, H., Khreishah, A. A., Alsarhan, A., Khalil, I., Sawalmeh, A., & Othman, N. S. (2017) · International Conference on Information and Communication Systems (ICICS) · doi:10.1109/iacs.2017.7921981 · Cited by 140
Communication architectures and protocols for networking unmanned aerial vehicles
Li, J., Zhou, Y., & Lamont, L. (2013) · IEEE Globecom Workshops (GC Wkshps) · doi:10.1109/glocomw.2013.6825193 · Cited by 129
Zhang⋆, Y. (2016) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2016.2592520 · Cited by 111
SOVCAN: Safety-Oriented Vehicular Controller Area Network
Zhang⋆, Y., Chen, M., Guizani, N., Wu, D., & Leung, V. C. M. (2017) · IEEE Communications Magazine · doi:10.1109/mcom.2017.1601185 · Cited by 105
Privacy-preserving QoI-aware participant coordination for mobile crowdsourcing
Zhang, B., Liu, C. H., Lu, J., Song, Z., Ren, Z., Ma, J., & Wang, W. (2016) · Computer Networks · doi:10.1016/j.comnet.2015.12.022 · Cited by 67
Self-citationDistributed Decision and Control for Cooperative UAVs Using Ad Hoc Communication
Ben-Asher, Y., Feldman, S., Gurfil, P., & Feldman, M. (2008) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2007.906314 · Cited by 65
Bilateral teleoperation of a group of UAVs with communication delays and switching topology
Secchi, C., Franchi, A., Bülthoff, H., & Giordano, P. R. (2012) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2012.6225304 · Cited by 56
A fault-tolerant self-organizing flocking approach for UAV aerial survey
Benedetti, M. D., D’Urso, F., Fortino, G., Messina, F., Pappalardo, G., & Santoro, C. (2017) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2017.08.004 · Cited by 44
A Mission-Oriented Coordination Framework for Teams of Mobile Aerial and Terrestrial Smart Objects
Pace, P., Aloi, G., Caliciuri, G., & Fortino, G. (2016) · Mobile Networks and Applications · doi:10.1007/s11036-016-0726-4 · Cited by 33
Energy-Efficient Event Detection by Participatory Sensing Under Budget Constraints
Liu, C. H., Zhao, J., Zhang, H., et al. (2016) · IEEE Systems Journal · doi:10.1109/jsyst.2016.2533538 · Cited by 27
Self-citationMission planning for UAV-based opportunistic disaster recovery networks
Zhong, L., Garlichs, K., Yamada, S., et al. (2018) · IEEE Consumer Communications & Networking Conference (CCNC) · doi:10.1109/ccnc.2018.8319233 · Cited by 22
Cited by
Deep Learning in Mobile and Wireless Networking: A Survey
Zhang, C., Patras, P., & Haddadi, H. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2904897 · Cited by 1,768
UAV Communications for 5G and Beyond: Recent Advances and Future Trends
Li, B., Fei, Z., & Zhang, Y. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2887086 · Cited by 1,377
Artificial Neural Networks-Based Machine Learning for Wireless Networks: A Tutorial
Chen, M., Challita, U., Saad, W., Yin, C., & Debbah, M. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2926625 · Cited by 1,117
Artificial-Intelligence-Enabled Intelligent 6G Networks
Yang, H., Alphones, A., Xiong, Z., Niyato, D., Zhao, J., & Wu, K. (2020) · IEEE Network · doi:10.1109/mnet.011.2000195 · Cited by 589
Applications of artificial intelligence for disaster management
Sun, W., Bocchini, P., & Davison, B. D. (2020) · Natural Hazards · doi:10.1007/s11069-020-04124-3 · Cited by 491
Metadata
- Authors
- Liu, C. H., Chen, Z., Tang, J., Xu, J., & Piao, C.
- Venue
- IEEE Journal on Selected Areas in Communications
- Published
- 2018-09
- Volume
- 36
- Issue
- 9
- Pages
- 2059-2070
- ISSN
- 0733-8716 (ISSN-L)
- 1558-0008
- OpenAlex
- W2886509985
- Cited by
- 633
- References
- 33
- FWCI
- 48.36
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.