Generalized Model and Deep Reinforcement Learning-Based Evolutionary Method for Multitype Satellite Observation Scheduling
The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
Multitype satellite observation, including optical observation satellites, synthetic aperture radar (SAR) satellites, and electromagnetic satellites, has become an important direction in integrated satellite applications due to its ability to cope with various complex situations. In the multitype satellite observation scheduling problem (MTSOSP), the constraints involved in different types of satellites make the problem challenging. This article proposes a mixed-integer programming model and a generalized profit representation method in the model to effectively cope with the situation of multiple types of satellite observations. To obtain a suitable observation plan, a deep reinforcement learning-based genetic algorithm (DRL-GA) is proposed by combining the learning method and genetic algorithm. The DRL-GA adopts a solution generation method to obtain the initial population and assist with local search. In this method, a set of statistical indicators that consider resource utilization and task arrangement performance are regarded as states. By using deep neural networks to estimate the$Q$value of each action, this method can determine the preferred order of task scheduling. An individual update strategy and an elite strategy are used to enhance the search performance of DRL-GA. Simulation results verify that DRL-GA can effectively solve the MTSOSP and outperforms the state-of-the-art algorithms in several aspects. This work reveals the advantages of the proposed generalized model and scheduling method, which exhibit good scalability for various types of observation satellite scheduling problems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In contrast, agile EOSs (AEOSs) can maneuver along both the roll and pitch axes, providing additional flexibility to look ahead or look back within the VTW (Lemaˆ ıtre et al., 2002; Wang et al., 2020; Song et al., 2024).”
From Scheduling multiple agile Earth observation satellites with multiple observations (2026) · cites this paper as Song et al., 2024
Citations
Cites
Dueling Network Architectures for Deep Reinforcement Learning
Wang, Z., Schaul, T., Hessel, M., van Hasselt, H., Lanctot, M., & de Freitas, N. (2015) · arXiv · doi:10.48550/arxiv.1511.06581 · Cited by 3,300
Vinyals, O., Fortunato, M., & Jaitly, N. (2015) · neural information processing systems · Cited by 2,043
Chuvieco, E., Mouillot, F., van der Werf, G. R., San Miguel, J., Tanase, M., Koutsias, N., García, M., Yebra, M., Padilla, M., Gitas, I., et al. (2019) · Remote Sensing of Environment · doi:10.1016/j.rse.2019.02.013 · Cited by 619
Pisinger, D., & Ropke, S. (2019) · International Series in Operations Research & Management Science · doi:10.1007/978-3-319-91086-4_4 · Cited by 395
Half a century of satellite remote sensing of sea-surface temperature
Minnett, P. J., Alvera-Azcárate, A., Chin, T. M., Corlett, G. K., Gentemann, C. L., Karagali, I., Li, X., Marsouin, A., Marullo, S., Maturi, E., et al. (2019) · Remote Sensing of Environment · doi:10.1016/j.rse.2019.111366 · Cited by 342
Three Scheduling Algorithms Applied to the Earth Observing Systems Domain
Wolfe, W. J., & Sorensen, S. E. (2000) · Management Science · doi:10.1287/mnsc.46.1.148.15134 · Cited by 313
Wang, X., Wu, G., Xing, L., & Pedrycz, W. (2021) · IEEE Systems Journal · doi:10.1109/jsyst.2020.2997050 · Cited by 260 · cited 1×
“EAs, including metaheuristics, are commonly used in practical engineering applications [22].”
BackgroundSelf-citationTian, Y., Li, X., Ma, H., Zhang, X., Tan, K. C., & Jin, Y. (2023) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2022.3146882 · Cited by 232
Du, Y., Li, J.-Q., Chen, X.-L., Duan, P.-Y., & Pan, Q.-K. (2023) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2022.3145706 · Cited by 202
Machine Learning into Metaheuristics: A Survey and Taxonomy
Talbi, E.-G. (2022) · ACM Computing Surveys · doi:10.1145/3459664 · Cited by 168
Cited by
Reinforcement learning-assisted evolutionary algorithm: A survey and research opportunities
Song, Y., Wu, Y., Guo, Y., Yan, R., Suganthan, P. N., Zhang, Y., Pedrycz, W., Das, S., Mallipeddi, R., Ajani, O. S., et al. (2024) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2024.101517 · Cited by 168
Self-citationEvolutionary Reinforcement Learning: A Systematic Review and Future Directions
Lin, Y., Lin, F., Cai, G., Chen, H., Zou, L., Liu, Y., & Wu, P. (2025) · Mathematics · doi:10.3390/math13050833 · Cited by 45
Su, C., Zhang, C., Wang, C., Cen, W., Chen, G., & Xie, L. (2024) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2024.101605 · Cited by 44
Wu, J., Wang, Z., Song, Y., Zhou, X., & Cheng, L. (2025) · Computers & Industrial Engineering · doi:10.1016/j.cie.2025.110933 · Cited by 43
Self-citationEnergy-Efficient Satellite Range Scheduling Using a Reinforcement Learning-Based Memetic Algorithm
Song, Y., Suganthan, P. N., Pedrycz, W., Yan, R., Fan, D., & Zhang, Y. (2024) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2024.3371964 · Cited by 42
Self-citation
Metadata
- Authors
- Song, Y., Ou, J., Pedrycz, W., Suganthan, P. N., Wang, X., Xing, L., & Zhang, Y.
- Affiliations
- Xidian University (CN)
- Xiangtan University (CN)
- University of Alberta (CA)
- Qatar University (QA)
- Delft University of Technology (NL)
- Beihang University (CN)
- ORCID
- Venue
- IEEE Transactions on Systems, Man, and Cybernetics: Systems
- Published
- 2024-04
- Volume
- 54
- Issue
- 4
- Pages
- 2576-2589
- ISSN
- 2168-2216 (ISSN-L)
- 2168-2232
- OpenAlex
- W4390872313
- Semantic Scholar
- 5176f8e9f8670487c82cd7fd7705adfe50ed8b06
- Cited by
- 63
- References
- 44
- Citations by year
- 2026: 12 · 2025: 33 · 2024: 18
- FWCI
- 10.89
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Systems Man and Cybernetics Systems (publishedVersion)
- Qatar University QSpace (Qatar University) (submittedVersion)
- Funders
- Science and Technology Innovation Team of Shaanxi Province (2023-CX-TD-07)
- Special Project in Major Fields of Guangdong Universities (2021ZDZX1019)
- Hunan Key Laboratory of Intelligent Decision-Making Technology for Emergency Management (2020TP1013)
- Topics
- Physical Sciences › Engineering › Aerospace Engineering › Satellite Communication Systems
- Physical Sciences › Engineering › Industrial and Manufacturing Engineering › Scheduling and Optimization Algorithms
- Physical Sciences › Computer Science › Artificial Intelligence › Metaheuristic Optimization Algorithms Research
- Keywords
- deep reinforcement learning, genetic algorithm, mixed integer programming model, spaceborne SAR, task scheduling, Q-value estimation, elite strategy, resource utilization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Generalized Model and Deep Reinforcement Learning-Based Evolutionary Method for Multitype Satellite Observation Scheduling. https://app.cochat.ai/papers/10.1109/tsmc.2023.3345928
- The paper
- Song, Y., Ou, J., Pedrycz, W., Suganthan, P. N., Wang, X., Xing, L., & Zhang, Y. (2024). Generalized Model and Deep Reinforcement Learning-Based Evolutionary Method for Multitype Satellite Observation Scheduling. IEEE Transactions on Systems, Man, and Cybernetics: Systems. https://doi.org/10.1109/tsmc.2023.3345928
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.