The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Reinforcement Learning in Multiple-UAV Networks: Deployment and Movement Design
Open accessAbstract
A novel framework is proposed for quality of experience driven deployment and dynamic movement of multiple unmanned aerial vehicles (UAVs). The problem of joint non-convex three-dimensional (3-D) deployment and dynamic movement of the UAVs is formulated for maximizing the sum mean opinion score of ground users, which is proved to be NP-hard. In the aim of solving this pertinent problem, a three-step approach is proposed for attaining 3-D deployment and dynamic movement of multiple UAVs. First, a genetic algorithm based K-means (GAK-means) algorithm is utilized for obtaining the cell partition of the users. Second, Q-learning based deployment algorithm is proposed, in which each UAV acts as an agent, making their own decision for attaining 3-D position by learning from trial and mistake. In contrast to the conventional genetic algorithm based learning algorithms, the proposed algorithm is capable of training the direction selection strategy offline. Third, Q-learning based movement algorithm is proposed in the scenario that the users are roaming. The proposed algorithm is capable of converging to an optimal state. Numerical results reveal that the proposed algorithms show a fast convergence rate after a small number of iterations. Additionally, the proposed Q-learning based deployment algorithm outperforms K-means algorithms and Iterative-GAKmean algorithms with low complexity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An efficient k-means clustering algorithm: analysis and implementation
Kanungo, T., Mount, D. M., Netanyahu, N. S., Piatko, C. D., Silverman, R., & Wu, A. Y. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017616 · Cited by 5,660
Wireless communications with unmanned aerial vehicles: opportunities and challenges
Zeng, Y., Zhang, R., & Lim, T. J. (2016) · IEEE Communications Magazine · doi:10.1109/mcom.2016.7470933 · Cited by 4,048
Optimal LAP Altitude for Maximum Coverage
Al-Hourani, A., Kandeepan, S., & Lardner, S. (2014) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2014.2342736 · Cited by 3,161
Energy-Efficient UAV Communication With Trajectory Optimization
Zeng, Y., & Zhang, R. (2017) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2017.2688328 · Cited by 2,164
Scenarios for 5G mobile and wireless communications: the vision of the METIS project
Osseiran, A., Boccardi, F., Braun, V., Kusume, K., Marsch, P., Maternia, M., Queseth, O., Schellmann, M., Schotten, H., Taoka, H., et al. (2014) · IEEE Communications Magazine · doi:10.1109/mcom.2014.6815890 · Cited by 2,006
Nonorthogonal Multiple Access for 5G and Beyond
Liu, Y., Qin, Z., Elkashlan, M., Ding, Z., Nallanathan, A., & Hanzo, L. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2768666 · Cited by 1,369
Self-citationUnmanned Aerial Vehicle With Underlaid Device-to-Device Communications: Performance and Tradeoffs
Mozaffari, M., Saad, W., Bennis, M., & Debbah, M. (2016) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2016.2531652 · Cited by 1,126
Efficient Deployment of Multiple Unmanned Aerial Vehicles for Optimal Wireless Coverage
Mozaffari, M., Saad, W., Bennis, M., & Debbah, M. (2016) · IEEE Communications Letters · doi:10.1109/lcomm.2016.2578312 · Cited by 1,095
Mobile Unmanned Aerial Vehicles (UAVs) for Energy-Efficient Internet of Things Communications
Mozaffari, M., Saad, W., Bennis, M., & Debbah, M. (2017) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2017.2751045 · Cited by 1,093
Alzenad, M., El-Keyi, A., Lagum, F., & Yanikomeroglu, H. (2017) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2017.2700840 · Cited by 949
Cited by
Reconfigurable Intelligent Surfaces: Principles and Opportunities
Liu, Y., Liu, X., Mu, X., Hou, T., Xu, J., Di Renzo, M., & Al-Dhahir, N. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3077737 · Cited by 1,847
Self-citationEvolution of Non-Terrestrial Networks From 5G to 6G: A Survey
Azari, M. M., Solanki, S., Chatzinotas, S., Kodheli, O., Sallouha, H., Colpaert, A., Mendoza Montoya, J. F., Pollin, S., Haqiqatnejad, A., Mostaani, A., et al. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3199901 · Cited by 668
Applications of artificial intelligence for disaster management
Sun, W., Bocchini, P., & Davison, B. D. (2020) · Natural Hazards · doi:10.1007/s11069-020-04124-3 · Cited by 491
A Survey on Machine-Learning Techniques for UAV-Based Communications
Bithas, P. S., Michailidis, E. T., Nomikos, N., Vouyioukas, D., & Kanatas, A. G. (2019) · Sensors · doi:10.3390/s19235170 · Cited by 353
Ding, R., Gao, F., & Shen, X. S. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3016024 · Cited by 331
Metadata
- Authors
- Liu, X., Liu, Y., & Chen, Y.
- Venue
- IEEE Transactions on Vehicular Technology
- Published
- 2019-08
- Volume
- 68
- Issue
- 8
- Pages
- 8036-8049
- ISSN
- 0018-9545 (ISSN-L)
- 1939-9359
- OpenAlex
- W2963569053
- Cited by
- 342
- References
- 48
- FWCI
- 29.65
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Reinforcement Learning in Multiple-UAV Networks: Deployment and Movement Design. https://app.cochat.ai/papers/10.1109/tvt.2019.2922849
- The paper
- Liu, X., Liu, Y., & Chen, Y. (2019). Reinforcement Learning in Multiple-UAV Networks: Deployment and Movement Design. IEEE Transactions on Vehicular Technology. https://doi.org/10.1109/tvt.2019.2922849
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.