Generalized Model and Deep Reinforcement Learning-Based Evolutionary Method for Multitype Satellite Observation Scheduling
The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
Multitype satellite observation, including optical observation satellites, synthetic aperture radar (SAR) satellites, and electromagnetic satellites, has become an important direction in integrated satellite applications due to its ability to cope with various complex situations. In the multitype satellite observation scheduling problem (MTSOSP), the constraints involved in different types of satellites make the problem challenging. This article proposes a mixed-integer programming model and a generalized profit representation method in the model to effectively cope with the situation of multiple types of satellite observations. To obtain a suitable observation plan, a deep reinforcement learning-based genetic algorithm (DRL-GA) is proposed by combining the learning method and genetic algorithm. The DRL-GA adopts a solution generation method to obtain the initial population and assist with local search. In this method, a set of statistical indicators that consider resource utilization and task arrangement performance are regarded as states. By using deep neural networks to estimate the$Q$value of each action, this method can determine the preferred order of task scheduling. An individual update strategy and an elite strategy are used to enhance the search performance of DRL-GA. Simulation results verify that DRL-GA can effectively solve the MTSOSP and outperforms the state-of-the-art algorithms in several aspects. This work reveals the advantages of the proposed generalized model and scheduling method, which exhibit good scalability for various types of observation satellite scheduling problems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In contrast, agile EOSs (AEOSs) can maneuver along both the roll and pitch axes, providing additional flexibility to look ahead or look back within the VTW (Lemaˆ ıtre et al., 2002; Wang et al., 2020; Song et al., 2024).”
From Scheduling multiple agile Earth observation satellites with multiple observations (2026) · cites this paper as Song et al., 2024
Citations
Cites
Dueling Network Architectures for Deep Reinforcement Learning
Wang, Z., Schaul, T., Hessel, M., van Hasselt, H., Lanctot, M., & de Freitas, N. (2015) · arXiv · doi:10.48550/arxiv.1511.06581 · Cited by 3,300
Vinyals, O., Fortunato, M., & Jaitly, N. (2015) · neural information processing systems · Cited by 2,043
Chuvieco, E., Mouillot, F., van der Werf, G. R., San Miguel, J., Tanase, M., Koutsias, N., García, M., Yebra, M., Padilla, M., Gitas, I., et al. (2019) · Remote Sensing of Environment · doi:10.1016/j.rse.2019.02.013 · Cited by 619
Pisinger, D., & Ropke, S. (2019) · International Series in Operations Research & Management Science · doi:10.1007/978-3-319-91086-4_4 · Cited by 395
Half a century of satellite remote sensing of sea-surface temperature
Minnett, P. J., Alvera-Azcárate, A., Chin, T. M., Corlett, G. K., Gentemann, C. L., Karagali, I., Li, X., Marsouin, A., Marullo, S., Maturi, E., et al. (2019) · Remote Sensing of Environment · doi:10.1016/j.rse.2019.111366 · Cited by 342
Three Scheduling Algorithms Applied to the Earth Observing Systems Domain
Wolfe, W. J., & Sorensen, S. E. (2000) · Management Science · doi:10.1287/mnsc.46.1.148.15134 · Cited by 313
Wang, X., Wu, G., Xing, L., & Pedrycz, W. (2021) · IEEE Systems Journal · doi:10.1109/jsyst.2020.2997050 · Cited by 260 · cited 1×
“EAs, including metaheuristics, are commonly used in practical engineering applications [22].”
BackgroundSelf-citationTian, Y., Li, X., Ma, H., Zhang, X., Tan, K. C., & Jin, Y. (2023) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2022.3146882 · Cited by 232
Du, Y., Li, J.-Q., Chen, X.-L., Duan, P.-Y., & Pan, Q.-K. (2023) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2022.3145706 · Cited by 202
Machine Learning into Metaheuristics: A Survey and Taxonomy
Talbi, E.-G. (2022) · ACM Computing Surveys · doi:10.1145/3459664 · Cited by 168
A mixed integer linear programming model for multi-satellite scheduling
Chen, X., Reinelt, G., Dai, G., & Spitz, A. (2019) · European Journal of Operational Research · doi:10.1016/j.ejor.2018.11.058 · Cited by 162
He, Y., Xing, L., Chen, Y., Pedrycz, W., Wang, L., & Wu, G. (2022) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2020.3020732 · Cited by 159
Self-citationMulti-satellite control resource scheduling based on ant colony optimization
Zhang, Z., Zhang, N., & Feng, Z. (2013) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.10.014 · Cited by 126
Zhang, J., & Xing, L. (2021) · Computers & Operations Research · doi:10.1016/j.cor.2021.105626 · Cited by 125
Self-citationKang, Y., Jang, E., Im, J., & Kwon, C. (2022) · GIScience & Remote Sensing · doi:10.1080/15481603.2022.2143872 · Cited by 125
Genetic Algorithms for Satellite Scheduling Problems
Xhafa, F., Sun, J., Barolli, A., Biberaj, A., & Barolli, L. (2012) · Mobile Information Systems · doi:10.1155/2012/717658 · Cited by 108
Wang, J., Demeulemeester, E. L., & Qiu, D. (2016) · Computers & Operations Research · doi:10.1016/j.cor.2016.04.014 · Cited by 104
Han, C. S., Gu, Y., Wu, G., & Wang, X. (2022) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2022.3220534 · Cited by 101
Self-citationTask scheduling and attitude planning for agile earth observation satellite with intensive tasks
Wang, S., Zhao, L., Cheng, J., Zhou, J., & Wang, Y. (2019) · Aerospace Science and Technology · doi:10.1016/j.ast.2019.04.007 · Cited by 95
Mixed-integer programming models for optimal constellation scheduling given cloud cover uncertainty
Valicka, C. G., Garcia, D., Staid, A., Watson, J., Hackebeil, G. A., Rathinam, S., & Ntaimo, L. (2018) · European Journal of Operational Research · doi:10.1016/j.ejor.2018.11.043 · Cited by 89
Wu, G., Luo, Q., Du, X., Chen, Y., Suganthan, P. N., & Wang, X. (2022) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2022.3160993 · Cited by 82
Self-citationMission scheduling optimization of SAR satellite constellation for minimizing system response time
Kim, H., & Chang, Y.-K. (2014) · Aerospace Science and Technology · doi:10.1016/j.ast.2014.10.006 · Cited by 80
He, L., de Weerdt, M., & Yorke-Smith, N. (2020) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-019-01518-4 · Cited by 77
A two-phase genetic annealing method for integrated Earth observation satellite scheduling problems
Zhu, W., Hu, X., Xia, W., & Jin, P. (2017) · Soft Computing · doi:10.1007/s00500-017-2889-8 · Cited by 72
Zhu, K.-J., Li, J.-F., & Baoyin, H.-X. (2010) · Acta Astronautica · doi:10.1016/j.actaastro.2009.05.029 · Cited by 71
Gu, Y., Han, C. S., Chen, Y., Liu, S., & Wang, X. (2022) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2022.3205565 · Cited by 71
Self-citationLi, Z., & Li, X. (2019) · Advances in Space Research · doi:10.1016/j.asr.2019.01.043 · Cited by 70
Robust earth observation satellite scheduling with uncertainty of cloud coverage
Wang, X., Song, G., Leus, R., & Han, C. (2020) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2019.2947978 · Cited by 70 · cited 2×
“Optical EOSs are affected by clouds and light [1], [30], while SAR EOSs and EM EOSs are sensitive to EM signals [9], [31], [32].”
BackgroundSelf-citationXhafa, F., & Ip, A. W. H. (2021) · Enterprise Information Systems · doi:10.1080/17517575.2019.1593508 · Cited by 57
Multi-satellite scheduling framework and algorithm for very large area observation
Xu, Y., Liu, X., He, R., & Chen, Y. (2020) · Acta Astronautica · doi:10.1016/j.actaastro.2019.10.041 · Cited by 57
Wei, L., Xing, L., Wan, Q., Song, Y., & Chen, Y. (2021) · Computers & Industrial Engineering · doi:10.1016/j.cie.2021.107530 · Cited by 54
Self-citationA knowledge-based evolutionary algorithm for relay satellite system mission scheduling problem
Song, Y., Xing, L., Wang, M., Yi, Y., Xiang, W., & Zhang, Z. (2020) · Computers & Industrial Engineering · doi:10.1016/j.cie.2020.106830 · Cited by 48
Self-citationChang, Z., Zhou, Z., Xing, L., & Yao, F. (2021) · Memetic Computing · doi:10.1007/s12293-021-00333-w · Cited by 44
Self-citationMulti-satellite Observation Scheduling Algorithm Based on Hybrid Genetic Particle Swarm Optimization
Chen, Y., Zhang, D., Zhou, M., & Zou, H. (2012) · Lecture notes in electrical engineering · doi:10.1007/978-3-642-26001-8_58 · Cited by 38
QUEST – A new quadratic decision model for the multi-satellite scheduling problem
Berger, J., Lo, N., & Barkaoui, M. (2020) · Computers & Operations Research · doi:10.1016/j.cor.2019.104822 · Cited by 37
Wu, J. D., Yao, F., Song, Y., He, L., Fang, L., Du, Y., Yan, J., Chen, Y., Xing, L., & Ou, J. (2023) · Information Sciences · doi:10.1016/j.ins.2023.04.003 · Cited by 32
Self-citationBoukabara, S., Eyre, J. R., Anthes, R. A., Holmlund, K., Germain, K. M. S., & Hoffman, R. N. (2021) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2021.3070248 · Cited by 26
Jiang, X., Song, Y., & Xing, L. (2022) · IEEE Access · doi:10.1109/access.2022.3157286 · Cited by 22
Self-citationEvolutionary approaches to dynamic earth observation satellites mission planning under uncertainty
Povéda, G., Regnier-Coudert, O., Teichteil-Königsbuch, F., Dupont, G., Arnold, A., Guerra, J., & Picard, M. (2019) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3321707.3321859 · Cited by 21
Chang, Z., & Zhou, Z. (2024) · Annals of Operations Research · doi:10.1007/s10479-024-06156-5 · Cited by 20
He, Y., Wu, G., Chen, Y., & Witold Pedrycz, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.05847 · Cited by 16
Wu, G., Mao, X., Chen, Y., Wang, X., Liao, W., & Pedrycz, W. (2022) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2022.3228832 · Cited by 16
Self-citationA hybrid discrete particle swarm optimization for satellite scheduling problem
Zhang, D., Guo, L., Cai, B., Sun, N., & Wang, Q. (2013) · IEEE Conference Anthology · doi:10.1109/anthology.2013.6784716 · Cited by 11
Wei, D., Li, S., Wu, X., Song, Y., & Tan, R. (2021) · IOP Conference Series Earth and Environmental Science · doi:10.1088/1755-1315/687/1/012121 · Cited by 5
Self-citationThree multi-objective memtic algorithms for observation scheduling problem of active-imaging AEOSPreprint
Chang, Z., & Zhou, Z. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2207.01250 · Cited by 1
Cited by
Reinforcement learning-assisted evolutionary algorithm: A survey and research opportunities
Song, Y., Wu, Y., Guo, Y., Yan, R., Suganthan, P. N., Zhang, Y., Pedrycz, W., Das, S., Mallipeddi, R., Ajani, O. S., et al. (2024) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2024.101517 · Cited by 168
Self-citationEvolutionary Reinforcement Learning: A Systematic Review and Future Directions
Lin, Y., Lin, F., Cai, G., Chen, H., Zou, L., Liu, Y., & Wu, P. (2025) · Mathematics · doi:10.3390/math13050833 · Cited by 45
Su, C., Zhang, C., Wang, C., Cen, W., Chen, G., & Xie, L. (2024) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2024.101605 · Cited by 44
Wu, J., Wang, Z., Song, Y., Zhou, X., & Cheng, L. (2025) · Computers & Industrial Engineering · doi:10.1016/j.cie.2025.110933 · Cited by 43
Self-citationEnergy-Efficient Satellite Range Scheduling Using a Reinforcement Learning-Based Memetic Algorithm
Song, Y., Suganthan, P. N., Pedrycz, W., Yan, R., Fan, D., & Zhang, Y. (2024) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2024.3371964 · Cited by 42
Self-citation
Metadata
- Authors
- Song, Y., Ou, J., Pedrycz, W., Suganthan, P. N., Wang, X., Xing, L., & Zhang, Y.
- Affiliations
- Xidian University (CN)
- Xiangtan University (CN)
- University of Alberta (CA)
- Qatar University (QA)
- Delft University of Technology (NL)
- Beihang University (CN)
- ORCID
- Venue
- IEEE Transactions on Systems, Man, and Cybernetics: Systems
- Published
- 2024-04
- Volume
- 54
- Issue
- 4
- Pages
- 2576-2589
- ISSN
- 2168-2216 (ISSN-L)
- 2168-2232
- OpenAlex
- W4390872313
- Semantic Scholar
- 5176f8e9f8670487c82cd7fd7705adfe50ed8b06
- Cited by
- 63
- References
- 44
- Citations by year
- 2026: 12 · 2025: 33 · 2024: 18
- FWCI
- 10.89
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Systems Man and Cybernetics Systems (publishedVersion)
- Qatar University QSpace (Qatar University) (submittedVersion)
- Funders
- Science and Technology Innovation Team of Shaanxi Province (2023-CX-TD-07)
- Special Project in Major Fields of Guangdong Universities (2021ZDZX1019)
- Hunan Key Laboratory of Intelligent Decision-Making Technology for Emergency Management (2020TP1013)
- Topics
- Physical Sciences › Engineering › Aerospace Engineering › Satellite Communication Systems
- Physical Sciences › Engineering › Industrial and Manufacturing Engineering › Scheduling and Optimization Algorithms
- Physical Sciences › Computer Science › Artificial Intelligence › Metaheuristic Optimization Algorithms Research
- Keywords
- deep reinforcement learning, genetic algorithm, mixed integer programming model, spaceborne SAR, task scheduling, Q-value estimation, elite strategy, resource utilization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.