The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Interference Management for Cellular-Connected UAVs: A Deep Reinforcement Learning Approach
Open accessAbstract
In this paper, an interference-aware path planning scheme for a network of cellular-connected unmanned aerial vehicles (UAVs) is proposed. In particular, each UAV aims at achieving a tradeoff between maximizing energy efficiency and minimizing both wireless latency and the interference caused on the ground network along its path. The problem is cast as a dynamic game among UAVs. To solve this game, a deep reinforcement learning algorithm, based on echo state network (ESN) cells, is proposed. The introduced deep ESN architecture is trained to allow each UAV to map each observation of the network state to an action, with the goal of minimizing a sequence of time-dependent utility functions. Each UAV uses the ESN to learn its optimal path, transmission power, and cell association vector at different locations along its path. The proposed algorithm is shown to reach a subgame perfect Nash equilibrium upon convergence. Moreover, an upper bound and a lower bound for the altitude of the UAVs are derived thus reducing the computational complexity of the proposed algorithm. The simulation results show that the proposed scheme achieves better wireless latency per UAV and rate per ground user (UE) while requiring a number of steps that are comparable to a heuristic baseline that considers moving via the shortest distance toward the corresponding destinations. The results also show that the optimal altitude of the UAVs varies based on the ground network density and the UE data rate requirements and plays a vital role in minimizing the interference level on the ground UEs as well as the wireless transmission delay of the UAV.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Introduction to Reinforcement Learning
Sutton, R. S., & Barto, A. G. (1998) · The MIT Press eBooks · Cited by 6,855
Bertsekas, D. P., & Gallager, R. G. (1987) · Cited by 5,561
Energy-Efficient UAV Communication With Trajectory Optimization
Zeng, Y., & Zhang, R. (2017) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2017.2688328 · Cited by 2,164
An Introduction to Game Theory
(2014) · Applying the Strategic Perspective: Problems and Models · doi:10.4135/9781452275567.n5 · Cited by 1,493
Throughput Maximization for UAV-Enabled Mobile Relaying Systems
Zeng, Y., Zhang, R., & Lim, T. J. (2016) · IEEE Transactions on Communications · doi:10.1109/tcomm.2016.2611512 · Cited by 1,315
Synchronization Techniques for Digital Receivers
Mengali, U., & D’Andrea, A. N. (1997) · Springer eBooks · doi:10.1007/978-1-4899-1807-9 · Cited by 1,276
Modeling air-to-ground path loss for low altitude platforms in urban environments
Al-Hourani, A., Kandeepan, S., & Jamalipour, A. (2014) · 2014 IEEE Global Communications Conference · doi:10.1109/glocom.2014.7037248 · Cited by 1,182
Unmanned Aerial Vehicle With Underlaid Device-to-Device Communications: Performance and Tradeoffs
Mozaffari, M., Saad, W., Bennis, M., & Debbah, M. (2016) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2016.2531652 · Cited by 1,126
Self-citationOptimization and applications of echo state networks with leaky- integrator neurons
Jaeger, H., Lukoševičius, M., Popovici, D., & Siewert, U. (2007) · Neural Networks · doi:10.1016/j.neunet.2007.04.016 · Cited by 948 · cited 1×
“In particular, we consider leaky integrator reservoir units [29] for updating the state transition functions x where ω ( n ) j ∈ [0 , 1] is the leaking parameter at layer n for UAV j which relates to the speed of the reservoir dynamics in response to the input, with larger values of ω resulting in…”
BackgroundGame theory in wireless and communication networks: theory, models, and applications
(2012) · Choice Reviews Online · doi:10.5860/choice.49-6929 · Cited by 876
Ramasubramanian, S. (2004) · Resonance · doi:10.1007/bf02834992 · Cited by 813
1Unmanned Aerial Vehicle with Underlaid Device-to-Device Communications: Performance and Tradeoffs
Mozaffari, M., Member, S., Saad, W., Member, S., Member, S., & Debbah, M. A. (2016) · Cited by 760
Self-citationChen, M., Mozaffari, M., Saad, W., Yin, C., Debbah, M., & Hong, C. S. (2017) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2017.2680898 · Cited by 742 · cited 1×
“While some literature has recently studied the use of UAVs as mobile BSs [8]–[14], the performance analysis of cellular-connected UAV-UEs (short-handed hereinafter as UAVs) remains relatively scarce [4]–[6], [15].”
BackgroundSelf-citationThe Sky Is Not the Limit: LTE for Unmanned Aerial Vehicles
Lin, X., Yajnanarayana, V., Muruganathan, S. D., Gao, S., Asplund, H., Maattanen, H.-L., Bergstrom, M., Euler, S., & Wang, Y.-P. E. (2018) · IEEE Communications Magazine · doi:10.1109/mcom.2018.1700643 · Cited by 655
Cellular-Enabled UAV Communication: A Connectivity-Constrained Trajectory Optimization Perspective
Zhang, S., Zeng, Y., & Zhang, R. (2019) · IEEE Transactions on Communications · doi:10.1109/tcomm.2018.2880468 · Cited by 426
LTE in the sky: trading off propagation benefits with interference costs for aerial nodes
Van Der Bergh, B., Chiumento, A., & Pollin, S. (2016) · IEEE Communications Magazine · doi:10.1109/mcom.2016.7470934 · Cited by 326
Machine Learning for Wireless Connectivity and Security of Cellular-Connected UAVs
Challita, U., Ferdowsi, A., Chen, M., & Saad, W. (2019) · IEEE Wireless Communications · doi:10.1109/mwc.2018.1800155 · Cited by 238
Self-citationCapacity Characterization of UAV-Enabled Two-User Broadcast Channel
Wu, Q., Xu, J., & Zhang, R. (2018) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2018.2864421 · Cited by 209
Machine Learning for Wireless Networks with Artificial Intelligence: A Tutorial on Neural NetworksPreprint
Chen, M., Challita, U., Saad, W., Yin, C., & Debbah, M. A. (2017) · arXiv (Cornell University) · Cited by 184
Self-citationProactive Resource Management for LTE in Unlicensed Spectrum: A Deep Learning Perspective
Challita, U., Dong, L., & Saad, W. (2018) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2018.2829773 · Cited by 183
Self-citationCoexistence of Terrestrial and Aerial Users in Cellular Networks
Azari, M. M., Rosas, F., Chiumento, A., & Pollin, S. (2017) · 2017 IEEE Globecom Workshops (GC Wkshps) · doi:10.1109/glocomw.2017.8269068 · Cited by 182
Echo State Property of Deep Reservoir Computing Networks
Gallicchio, C., & Micheli, A. (2017) · Cognitive Computation · doi:10.1007/s12559-017-9461-9 · Cited by 164
Deep Reinforcement Learning for Interference-Aware Path Planning of Cellular-Connected UAVs
Challita, U., Saad, W., & Bettstetter, C. (2018) · International Conference on Communications · doi:10.1109/icc.2018.8422706 · Cited by 145
Self-citationNetwork Formation in the Sky: Unmanned Aerial Vehicles for Multi-Hop Wireless Backhauling
Challita, U., & Saad, W. (2017) · Globecom · doi:10.1109/glocom.2017.8254715 · Cited by 112
Self-citationNetwork connectivity and area coverage for UAV fleet mobility model with energy constraint
Messous, M.-A., Senouci, S., & Sedjelmaci, H. (2016) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc.2016.7565125 · Cited by 94
Reshaping Cellular Networks for the Sky: Major Factors and Feasibility
Azari, M. M., Rosas, F. E., & Pollin, S. (2018) · International Conference on Communications · doi:10.1109/icc.2018.8422685 · Cited by 82
Cellular-Enabled UAV Communication: Trajectory Optimization under Connectivity Constraint
Zhang, S., Zeng, Y., & Zhang, R. (2018) · International Conference on Communications · doi:10.1109/icc.2018.8422584 · Cited by 74
Hierarchical Resource Allocation Framework for Hyper-Dense Small Cell Networks
Qiu, J., Ding, G., Wu, Q., Qian, Z., Tsiftsis, T. A., Du, Z., & Sun, Y. (2016) · IEEE Access · doi:10.1109/access.2016.2633434 · Cited by 66
Networked Drone Cameras for Sports Streaming
Wang, X., Chowdhery, A., & Chiang, M. (2017) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2017.200 · Cited by 57
Reinforcement Learning with Echo State Networks
Szita, I., Gyenes, V., & Lörincz, A. (2006) · Lecture notes in computer science · doi:10.1007/11840817_86 · Cited by 54
Path planning of unmanned aerial vehicles with terrestrial wireless network tracking
Bekhti, M., Abdennebi, M., Achir, N., & Boussetta, K. (2016) · IFIP Wireless Days · doi:10.1109/wd.2016.7461521 · Cited by 36
Cited by
Applications of Deep Reinforcement Learning in Communications and Networking: A Survey
Luong, N. C., Hoang, D. T., Gong, S., Niyato, D., Wang, P., Liang, Y.-C., & Kim, D. I. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2916583 · Cited by 2,060
Accessing From the Sky: A Tutorial on UAV Communications for 5G and Beyond
Zeng, Y., Wu, Q., & Zhang, R. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2952892 · Cited by 1,589
Applications of artificial intelligence and machine learning in smart cities
Ullah, Z., Al-Turjman, F., Mostarda, L., & Gagliardi, R. (2020) · Computer Communications · doi:10.1016/j.comcom.2020.02.069 · Cited by 756
Application of Machine Learning in Wireless Networks: Key Techniques and Open Issues
Sun, Y., Peng, M., Zhou, Y., Huang, Y., & Mao, S. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2924243 · Cited by 678
Evolution of Non-Terrestrial Networks From 5G to 6G: A Survey
Azari, M. M., Solanki, S., Chatzinotas, S., Kodheli, O., Sallouha, H., Colpaert, A., Mendoza Montoya, J. F., Pollin, S., Haqiqatnejad, A., Mostaani, A., et al. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3199901 · Cited by 668
Metadata
- Authors
- Challita, U., Saad, W., & Bettstetter, C.
- Venue
- IEEE Transactions on Wireless Communications
- Published
- 2019-04
- Volume
- 18
- Issue
- 4
- Pages
- 2125-2140
- ISSN
- 1536-1276 (ISSN-L)
- 1558-2248
- OpenAlex
- W3106530718
- Cited by
- 440
- References
- 32
- FWCI
- 47.59
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.