Multi-UAV Path Planning for Wireless Data Harvesting With Deep Reinforcement Learning
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Harvesting data from distributed Internet of Things (IoT) devices with multiple autonomous unmanned aerial vehicles (UAVs) is a challenging problem requiring flexible path planning methods. We propose a multi-agent reinforcement learning (MARL) approach that, in contrast to previous work, can adapt to profound changes in the scenario parameters defining the data harvesting mission, such as the number of deployed UAVs, number, position and data amount of IoT devices, or the maximum flying time, without the need to perform expensive recomputations or relearn control policies. We formulate the path planning problem for a cooperative, non-communicating, and homogeneous team of UAVs tasked with maximizing collected data from distributed IoT sensor nodes subject to flying time and collision avoidance constraints. The path planning problem is translated into a decentralized partially observable Markov decision process (Dec-POMDP), which we solve through a deep reinforcement learning (DRL) approach, approximating the optimal UAV control policy without prior knowledge of the challenging wireless channel characteristics in dense urban environments. By exploiting a combination of centered global and local map representations of the environment that are fed into convolutional layers of the agents, we show that our proposed network architecture enables the agents to cooperate effectively by carefully dividing the data collection task among themselves, adapt to large complex environments and state spaces, and make movement decisions that balance data collection goals, flight-time efficiency, and navigation constraints. Finally, learning a control policy that generalizes over the scenario parameter space enables us to analyze the influence of individual parameters on collection performance and provide some intuition about system-level benefits.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Multiagent systems: A survey from a machine learning perspective
Stone, P., & Veloso, M. (2000) · Autonomous Robots · doi:10.1023/a:1008942012299 · Cited by 1,218 · cited 1×
“With the taxonomy from [35], our agents can be classified as homogeneous and non-communicating.”
BackgroundA Concise Introduction to Decentralized POMDPs
Oliehoek, F. A., & Amato, C. (2016) · SpringerBriefs in Intelligent Systems · doi:10.1007/978-3-319-28929-8 · Cited by 968 · cited 1×
“To address the aforementioned optimization problem, we translate it to a decentralized partially observable Markov decision process (Dec-POMDP) [29], which is defined through the tuple (S,A×,P,R, ×,O, γ ).”
MethodComprehensive survey of UAVs communication networks
Hentati, A. I., & Fourati, L. C. (2020) · Computer Standards & Interfaces · doi:10.1016/j.csi.2020.103451 · Cited by 184 · cited 1×
“Designing multiple access protocols for UAV networks is in itself a challenging research problem [28] due to high mobility of the nodes and fast changing link performance and is out of scope for this work.”
BackgroundDistributed Multi-Agent Meta Learning for Trajectory Design in Wireless Drone Networks
Hu, Y., Chen, M., Saad, W., Poor, H. V., & Cui, S. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3088689 · Cited by 152
Cited by
Guo, J., Zhou, Y., Burlion, L., Savkin, A. V., & Huang, C. (2025) · Control Engineering Practice · doi:10.1016/j.conengprac.2025.106491 · Cited by 13
Metadata
- Authors
- Bayerlein, H., Theile, M., Caccamo, M., & Gesbert, D.
- Venue
- IEEE Open Journal of the Communications Society
- Published
- 2021
- Volume
- 2
- Pages
- 1171-1187
- ISSN
- 2644-125X (ISSN-L)
- OpenAlex
- W3093571944
- Cited by
- 226
- References
- 6
- FWCI
- 16.55
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Multi-UAV Path Planning for Wireless Data Harvesting With Deep Reinforcement Learning. https://app.cochat.ai/papers/10.1109/ojcoms.2021.3081996
- The paper
- Bayerlein, H., Theile, M., Caccamo, M., & Gesbert, D. (2021). Multi-UAV Path Planning for Wireless Data Harvesting With Deep Reinforcement Learning. IEEE Open Journal of the Communications Society. https://doi.org/10.1109/ojcoms.2021.3081996
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.