Distributed Multi-Agent Meta Learning for Trajectory Design in Wireless Drone Networks
The DOI matches its Crossref record; 32 of the 34 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
In this paper, the problem of the trajectory design for a group of energy-constrained drones operating in dynamic wireless network environments is studied. In the considered model, a team of drone base stations (DBSs) is dispatched to cooperatively serve clusters of ground users that have dynamic and unpredictable uplink access demands. In this scenario, the DBSs must cooperatively navigate in the considered area to maximize coverage of the dynamic requests of the ground users. This trajectory design problem is posed as an optimization framework whose goal is to find optimal trajectories that maximize the fraction of users served by all DBSs. To find an optimal solution for this non-convex optimization problem under unpredictable environments, a value decomposition based reinforcement learning (VD-RL) solution coupled with a meta-training mechanism is proposed. This algorithm allows the DBSs to dynamically learn their trajectories while generalizing their learning to unseen environments. Analytical results show that, the proposed VD-RL algorithm is guaranteed to converge to a locally optimal solution of the non-convex optimization problem. Simulation results show that, even without meta-training, the proposed VD-RL algorithm can achieve a 53.2% improvement of the service coverage and a 30.6% improvement in terms of the convergence speed, compared to baseline multi-agent algorithms. Meanwhile, the use of the meta-training mechanism improves the convergence speed of the VD-RL a…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In particular, edge AI techniques, including distributed RL [55], [301], decentralized GNN [23], as well as distributed DNN with binarized output layer [61], are able to learn and execute the distributed resource allocation polices in an automatic and real-time manner.”
From Edge artificial intelligence for 6g: vision, enabling technologies, and applications (2022) · cites this paper as [301]
Citations
Cites
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512
(1999) · Cited by 5,147
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011
Energy-Efficient UAV Communication With Trajectory Optimization
Zeng, Y., & Zhang, R. (2017) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2017.2688328 · Cited by 2,164
Joint Trajectory and Communication Design for Multi-UAV Enabled Wireless Networks
Wu, Q., Zeng, Y., & Zhang, R. (2018) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2017.2789293 · Cited by 1,978
Counterfactual Multi-Agent Policy Gradients
Foerster, J., Farquhar, G., Afouras, T., Nardelli, N., & Whiteson, S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11794 · Cited by 1,873
A Joint Learning and Communications Framework for Federated Learning over Wireless Networks
Chen, M., Yang, Z., Saad, W., Yin, C., Poor, H. V., & Cui, S. (2019) · arXiv · doi:10.48550/arxiv.1909.07972 · Cited by 1,547
Self-citationA Joint Learning and Communications Framework for Federated Learning Over Wireless Networks
Chen, M., Yang, Z., Saad, W., Yin, C., Poor, H. V., & Cui, S. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3024629 · Cited by 1,547
Self-citationModeling air-to-ground path loss for low altitude platforms in urban environments
Al-Hourani, A., Kandeepan, S., & Jamalipour, A. (2014) · 2014 IEEE Global Communications Conference · doi:10.1109/glocom.2014.7037248 · Cited by 1,182
Artificial Neural Networks-Based Machine Learning for Wireless Networks: A Tutorial
Chen, M., Challita, U., Saad, W., Yin, C., & Debbah, M. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2926625 · Cited by 1,117
Self-citationLiu, C. H., Chen, Z., Tang, J., Xu, J., & Piao, C. (2018) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2018.2864373 · Cited by 633
Multi-Agent Reinforcement Learning-Based Resource Allocation for UAV Networks
Cui, J., Liu, Y., & Nallanathan, A. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2935201 · Cited by 593
Energy-Efficient Resource Allocation in OFDMA Systems with Large Numbers of Base Station Antennas
Ng, D. W. K., Lo, E. S., & Schober, R. (2012) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2012.072512.111850 · Cited by 544
Learning a Generic Value-Selection Heuristic Inside a Constraint Programming Solver
Sunehag, P., Lever, G., Gruslys, A., Czarnecki, W. M., Zambaldi, V., Jaderberg, M., Lanctot, M., Sonnerat, N., Leibo, J. Z., Tuyls, K., et al. (2017) · arXiv (Cornell University) · doi:10.4230/lipics.cp.2023.25 · Cited by 491
Optimal 3D-Trajectory Design and Resource Allocation for Solar-Powered UAV Communication Systems
Sun, Y., Xu, D., Ng, D. W. K., Dai, L., & Schober, R. (2019) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2900630 · Cited by 452
Beyond 5G With UAVs: Foundations of a 3D Wireless Cellular Network
Mozaffari, M., Kasgari, A. T. Z., Saad, W., Bennis, M., & Debbah, M. A. (2018) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2018.2879940 · Cited by 446
Self-citationInterference Management for Cellular-Connected UAVs: A Deep Reinforcement Learning Approach
Challita, U., Saad, W., & Bettstetter, C. (2019) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2900035 · Cited by 440
Self-citationCounterfactual Multi-Agent Policy Gradients
Foerster, J., Farquhar, G., Afouras, T., Nardelli, N., & Whiteson, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.08926 · Cited by 401
Liu, X., Liu, Y., Chen, Y., & Hanzo, L. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2920284 · Cited by 358
QMIX: Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learning
Rashid, T., Samvelyan, M., de Witt, C. S., Farquhar, G., Foerster, J., & Whiteson, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.11485 · Cited by 326
Optimization of UAV Heading for the Ground-to-Air Uplink
Jiang, F., & Swindlehurst, A. L. (2012) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2012.120614 · Cited by 271
Fadlullah, Z. M., Takaishi, D., Nishiyama, H., Kato, N., & Miura, R. (2016) · IEEE Network · doi:10.1109/mnet.2016.7389838 · Cited by 212
Hu, J., Zhang, H., Song, L., Schober, R., & Poor, H. V. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2020.3013599 · Cited by 201
Self-citationMeta-Gradient Reinforcement Learning
Xu, Z., van Hasselt, H. P., & Silver, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.09801 · Cited by 164
Houthooft, R., Chen, R. Y., Isola, P., Stadie, B. C., Wolski, F., Ho, J., & Abbeel, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.04821 · Cited by 122
Ferdowsi, A., Abd-Elmagid, M. A., Saad, W., & Dhillon, H. S. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3065049 · Cited by 96
Self-citationBaird, I., & Leemon, C. (1993) · Defense Technical Information Center (DTIC) · doi:10.21236/ada280862 · Cited by 61
Meta-Reinforcement Learning for Trajectory Design in Wireless UAV Networks
Hu, Y., Chen, M., Saad, W., Poor, H. V., & Cui, S. R. (2020) · Globecom · doi:10.1109/globecom42002.2020.9322414 · Cited by 41
Self-citationBeen There, Done That: Meta-Learning with Episodic Recall
Ritter, S., Wang, J. X., Kurth-Nelson, Z. L., Jayakumar, S. M., Blundell, C., Pascanu, R., & Botvinick, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.09692 · Cited by 31
UAV-Aided Backscatter Networks: Joint UAV Trajectory and Protocol Design
Hua, M., Swindlehurst, A. L., Li, C., & Yang, L. (2019) · Globecom · doi:10.1109/globecom38437.2019.9013759 · Cited by 10
Reinforcement Learning for Maneuver Design in UAV-Enabled NOMA System with Segmented Channel.Preprint
Huang, Y., Mo, X., Xu, J., & Qiu, L. (2019) · arXiv (Cornell University) · Cited by 5
Research works printed but not linked: 1
- sunehag, 2017, Value-decomposition networks for cooperative multi-agent learning, arXiv 1706 05296
Cited by
Edge artificial intelligence for 6g: vision, enabling technologies, and applications
Letaief, K. B., Shi, Y., Lu, J., & Lu, J. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126076 · Cited by 829
Evolution of Non-Terrestrial Networks From 5G to 6G: A Survey
Azari, M. M., Solanki, S., Chatzinotas, S., Kodheli, O., Sallouha, H., Colpaert, A., Mendoza Montoya, J. F., Pollin, S., Haqiqatnejad, A., Mostaani, A., et al. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3199901 · Cited by 668
Xu, W., Yang, Z., Ng, D. W. K., Levorato, M., Eldar, Y. C., & Debbah, M. (2023) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2023.3239189 · Cited by 660
Distributed Learning in Wireless Networks: Recent Progress and Future Challenges
Chen, M., Gunduz, D., Huang, K., Saad, W., Bennis, M., Feljan, A. V., & Poor, H. V. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118346 · Cited by 548
Self-citationPath-Planning for Unmanned Aerial Vehicles with Environment Complexity Considerations: A Survey
Jones, M., Djahel, S., & Welsh, K. (2023) · ACM Computing Surveys · doi:10.1145/3570723 · Cited by 258
Metadata
- Authors
- Hu, Y., Chen, M., Saad, W., Poor, H. V., & Cui, S.
- Affiliations
- Virginia Tech (US)
- Princeton University (US)
- Kyung Hee University (KR)
- Shenzhen Research Institute of Big Data (CN)
- Venue
- IEEE Journal on Selected Areas in Communications
- Published
- 2021-10
- Volume
- 39
- Issue
- 10
- Pages
- 3177-3192
- ISSN
- 0733-8716 (ISSN-L)
- 1558-0008
- OpenAlex
- W3172394904
- Cited by
- 152
- References
- 34
- Citations by year
- 2026: 16 · 2025: 29 · 2024: 27 · 2023: 33 · 2022: 32 · 2021: 15
- FWCI
- 13.78
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Journal on Selected Areas in Communications (publishedVersion)
- Funders
- National Key Research and Development Program of China (2018YFB1800800l)
- U.S. National Science Foundation (CNS-1909372, CNS-1836802, CCF-1908308)
- Special Project for Research and Development in Key areas of Guangdong Province (2018B030338001)
- Shenzhen Outstanding Talents Training Fund; and the Guangdong Research Project (2017ZT07 × 152)
- Topics
- Physical Sciences › Engineering › Aerospace Engineering › UAV Applications and Optimization
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Engineering › Aerospace Engineering › Satellite Communication Systems
- Keywords
- drone base stations, trajectory design, multi-agent reinforcement learning, value decomposition networks, meta-learning, uplink coverage, non-convex optimization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.