DRL-Based Dynamic Destroy Approaches for Agile-Satellite Mission Planning
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
Agile-satellite mission planning is a crucial issue in the construction of satellite constellations. The large scale of remote sensing missions and the high complexity of constraints in agile-satellite mission planning pose challenges in the search for an optimal solution. To tackle the issue, a dynamic destroy deep-reinforcement learning (D3RL) model is designed to facilitate subsequent optimization operations via adaptive destruction to the existing solutions. Specifically, we first perform a clustering and embedding operation to reconstruct tasks into a clustering graph, thereby improving data utilization. Secondly, the D3RL model is established based on graph attention networks (GATs) to enhance the search efficiency for optimal solutions. Moreover, we present two applications of the D3RL model for intensive scenes: the deep-reinforcement learning (DRL) method and the D3RL-based large-neighborhood search method (DRL-LNS). Experimental simulation results illustrate that the D3RL-based approaches outperform the competition in terms of solutions’ quality and computational efficiency, particularly in more challenging large-scale scenarios. DRL-LNS outperforms ALNS with an average scheduling rate improvement of approximately 11% in Area instances. In contrast, the DRL approach performs better in World scenarios, with an average scheduling rate that is around 8% higher than that of ALNS.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures









Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Ropke, S., & Pisinger, D. (2006) · Transportation Science · doi:10.1287/trsc.1050.0135 · Cited by 2,580
A general heuristic for vehicle routing problems
Pisinger, D., & Ropke, S. (2007) · Computers & Operations Research · doi:10.1016/j.cor.2005.09.012 · Cited by 1,443
Using Constraint Programming and Local Search Methods to Solve Vehicle Routing Problems
Shaw, P. (1998) · Lecture Notes in Computer Science · doi:10.1007/3-540-49481-2_30 · Cited by 1,366
Zheng, Z., Zhong, Y., Wang, J., Ma, A., & Zhang, L. (2021) · Remote Sensing of Environment · doi:10.1016/j.rse.2021.112636 · Cited by 521
Selecting and scheduling observations of agile satellites
Lemaı̂tre, M., Verfaillie, G., Jouhaud, F., Lachiver, J.-M., & Bataille, N. (2002) · Aerospace Science and Technology · doi:10.1016/s1270-9638(02)01173-2 · Cited by 472
Pisinger, D., & Ropke, S. (2019) · International Series in Operations Research & Management Science · doi:10.1007/978-3-319-91086-4_4 · Cited by 395
de Bem, P., de Carvalho Junior, O., Fontes Guimarães, R., & Trancoso Gomes, R. (2020) · Remote Sensing · doi:10.3390/rs12060901 · Cited by 295
Wang, X., Wu, G., Xing, L., & Pedrycz, W. (2021) · IEEE Systems Journal · doi:10.1109/jsyst.2020.2997050 · Cited by 260
Neural Combinatorial Optimization with Reinforcement Learning
Bello, I., Pham, H., Le, Q. V., Norouzi, M., & Bengio, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.09940 · Cited by 257
Liu, X., Laporte, G., Chen, Y., & He, R. (2017) · Computers & Operations Research · doi:10.1016/j.cor.2017.04.006 · Cited by 250
A Study on Overfitting in Deep Reinforcement Learning
Zhang, C., Vinyals, O., Munos, R., & Bengio, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.06893 · Cited by 225
A survey of adaptive large neighborhood search algorithms and applications
Windras Mara, S. T., Norcahyo, R., Jodiawan, P., Lusiantoro, L., & Rifai, A. P. (2022) · Computers & Operations Research · doi:10.1016/j.cor.2022.105903 · Cited by 192
He, Y., Xing, L., Chen, Y., Pedrycz, W., Wang, L., & Wu, G. (2022) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2020.3020732 · Cited by 159
Wu, G., Jin, L., Ma, M., & Qiu, D. (2013) · Computers & Operations Research · doi:10.1016/j.cor.2013.02.009 · Cited by 155
Multi-satellite control resource scheduling based on ant colony optimization
Zhang, Z., Zhang, N., & Feng, Z. (2013) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.10.014 · Cited by 129
Wei, L., Chen, Y., Chen, M., & Chen, Y. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107607 · Cited by 116
Peng, G., Dewil, R., Verbeeck, C., Gunawan, A., Xing, L., & Vansteenwegen, P. (2019) · Computers & Operations Research · doi:10.1016/j.cor.2019.05.030 · Cited by 113
The Temporal Dynamics of Slums Employing a CNN-Based Change Detection Approach
Liu, R., Kuffer, M., & Persello, C. (2019) · Remote Sensing · doi:10.3390/rs11232844 · Cited by 113
Online scheduling of image satellites based on neural networks and deep reinforcement learning
WANG, H., YANG, Z., ZHOU, W., & LI, D. (2019) · Chinese Journal of Aeronautics · doi:10.1016/j.cja.2018.12.018 · Cited by 112
Learning 2-Opt Heuristics for Routing Problems via Deep Reinforcement Learning
da Costa, P., Rhuggenaath, J., Zhang, Y., Akçay, A., & Kaymak, U. (2021) · SN Computer Science · doi:10.1007/s42979-021-00779-2 · Cited by 107
Peng, G., Song, G., He, Y., Yu, J., Xiang, S., Xing, L., & Vansteenwegen, P. (2020) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2020.3031738 · Cited by 86
He, L., de Weerdt, M., & Yorke-Smith, N. (2020) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-019-01518-4 · Cited by 77
Learning a Large Neighborhood Search Algorithm for Mixed Integer ProgramsPreprint
Sonnerat, N., Wang, P., Ktena, S. I., Bartunov, S., & Nair, V. B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.10201 · Cited by 75
Revising the Observation Satellite Scheduling Problem Based on Deep Reinforcement Learning
Huang, Y., Mu, Z., Wu, S., Cui, B., & Duan, Y. (2021) · Remote Sensing · doi:10.3390/rs13122377 · Cited by 73
FEASIBILITY OF AUTONOMOUS DECISION MAKING ON BOARD AN AGILE EARTH‐OBSERVING SATELLITE
Beaumet, G., Verfaillie, G., & Charmeau, M. (2011) · Computational Intelligence · doi:10.1111/j.1467-8640.2010.00375.x · Cited by 72
A Branch and Bound Algorithm for Agile Earth Observation Satellite Scheduling
Chu, X., Chen, Y., & Xing, L. (2017) · Discrete Dynamics in Nature and Society · doi:10.1155/2017/7345941 · Cited by 59
Tangpattanakul, P., Jozefowiez, N., & Lòpez, P. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-32964-7_12 · Cited by 53
Deep Reinforcement Learning for Agile Satellite Scheduling Problem
Chen, M., Chen, Y., Chen, Y., & Qi, W. (2019) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci44817.2019.9002957 · Cited by 52
New tabu search heuristic in scheduling earth observation satellites
Sarkheyli, A., Ghorbani Vaghei, B., & Bagheri, A. (2010) · 2010 2nd International Conference on Software Technology and Engineering · doi:10.1109/icste.2010.5608821 · Cited by 35
Agile Satellite Mission Planning Via Task Clustering and Double-Layer Tabu Algorithm
Zhao, Y., Du, B., & Li, S. (2020) · Computer Modeling in Engineering & Sciences · doi:10.32604/cmes.2020.08070 · Cited by 34
Dynamic Partial Removal: A Neural Network Heuristic for Large Neighborhood SearchPreprint
Chen, M., Gao, L., Chen, Q., & Liu, Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.09330 · Cited by 25
Chen, J., Liu, H., Hou, J., Yang, M., & Deng, M. (2018) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi7060213 · Cited by 23
ALNS: a Python implementation of the adaptive large neighbourhood search metaheuristic
Wouda, N. A., & Lan, L. (2023) · The Journal of Open Source Software · doi:10.21105/joss.05028 · Cited by 23
Wu, G., Wang, H., Li, H., Pedrycz, W., Qiu, D., Ma, M., & Liu, J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1401.6098 · Cited by 23
Agile satellite scheduling based on hybrid coding genetic algorithm
Geng, X., Li, J., Yang, W., & Gong, H. (2016) · World Congress on Intelligent Control and Automation · doi:10.1109/wcica.2016.7578683 · Cited by 15
Research works printed but not linked: 4
- 1. Singh, P.; Pandey, P.C.; Petropoulos, G.P.; Pavlides, A.; Srivastava, P.K.; Koutsias, N.; Deng, K.A.K.; Bao, Y. Hyperspectral remote sensing in precision agriculture: Present status, challenges, and future trends. In Hyperspectral Remote Sensing; Elsevier: Amsterdam, The Netherlands, 2020; pp. 121-146.
- 25. Hottung, A.; Tierney, K. Neural large neighborhood search for the capacitated vehicle routing problem. arXiv 2019, arXiv:1911.09539. · arXiv
- 35. Iacopino, C.; Harrison, S.; Brewer, A. Mission planning systems for commercial small-sat earth observation constellations. In Proceedings of the 9th International Workshop on Planning and Scheduling for Space (IWPSS), VenueBuenos Aires, Argentina, 25-27 June 2015; pp. 45-52.
- 39. Veličković, P.; Cucurull, G.; Casanova, A.; Romero, A.; Lio, P.; Bengio, Y. Graph attention networks. arXiv 2017, arXiv:1710.10903. · arXiv
Cited by
Zhou, G., Jin, Z., & Liu, D. (2025) · Remote Sensing · doi:10.3390/rs17121972 · Cited by 17
Liu, D., & Zhou, G. (2024) · Remote Sensing · doi:10.3390/rs16234436 · Cited by 14
Li, C., Tan, X., & Chen, C. (2025) · International Journal of Digital Earth · doi:10.1080/17538947.2025.2554310 · Cited by 6
“In the context of satellite resources, DRL addresses challenges such as satellite service task allocation (Huang et al. 2023), satellite observation task planning (Wang et al. 2019), and multi-satellite online scheduling (Dalin et al. 2021).”
Two-stage deep reinforcement learning method for agile optical satellite scheduling problem
Liu, Z., Xiong, W. H., Jia, Z., & Han, C. (2024) · Complex & Intelligent Systems · doi:10.1007/s40747-024-01667-x · Cited by 9
“Huang et al. [41] designed a dynamical destroy deep-reinforcement learning model to tackle the agile satellite mission planning problem, which facilitated subsequent optimization operations through adaptive destruction to the existing solutions to search for better solutions.”
An Innovative Priority-Aware Mission Planning Framework for an Agile Earth Observation Satellite
Zhu, G., Zheng, Z., Ouyang, C., Guo, Y., & Sun, P. (2025) · Aerospace · doi:10.3390/aerospace12040309 · Cited by 4
Metadata
- Authors
- Huang, W., Li, Z., He, X., Xiang, J., Du, X., & Liang, X.
- Affiliations
- ShanghaiTech University (CN)
- University of Chinese Academy of Sciences (CN)
- Henan Academy of Sciences (CN)
- Corresponding author
- Liang, Xuwen
- Venue
- Remote Sensing
- Publisher
- MDPI AG
- Published
- 2023-09-13
- Volume
- 15
- Issue
- 18
- Pages
- 4503
- ISSN
- 2072-4292 (ISSN-L)
- OpenAlex
- W4386748751
- Semantic Scholar
- 78d86a62716f421473dc21a83b3c466f26bef232
- Cited by
- 11
- References
- 30
- Citations by year
- 2026: 4 · 2025: 3 · 2024: 4
- FWCI
- 1.34
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Remote Sensing (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Key R&D Program of China (2022YFB3902800)
- Topics
- Physical Sciences › Engineering › Aerospace Engineering › Satellite Communication Systems
- Physical Sciences › Engineering › Industrial and Manufacturing Engineering › Scheduling and Optimization Algorithms
- Physical Sciences › Engineering › Industrial and Manufacturing Engineering › Vehicle Routing Optimization Methods
- Keywords
- deep reinforcement learning, graph attention networks, large neighborhood search
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.