Generalized Model and Deep Reinforcement Learning-Based Evolutionary Method for Multitype Satellite Observation Scheduling
The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
Multitype satellite observation, including optical observation satellites, synthetic aperture radar (SAR) satellites, and electromagnetic satellites, has become an important direction in integrated satellite applications due to its ability to cope with various complex situations. In the multitype satellite observation scheduling problem (MTSOSP), the constraints involved in different types of satellites make the problem challenging. This article proposes a mixed-integer programming model and a generalized profit representation method in the model to effectively cope with the situation of multiple types of satellite observations. To obtain a suitable observation plan, a deep reinforcement learning-based genetic algorithm (DRL-GA) is proposed by combining the learning method and genetic algorithm. The DRL-GA adopts a solution generation method to obtain the initial population and assist with local search. In this method, a set of statistical indicators that consider resource utilization and task arrangement performance are regarded as states. By using deep neural networks to estimate the$Q$value of each action, this method can determine the preferred order of task scheduling. An individual update strategy and an elite strategy are used to enhance the search performance of DRL-GA. Simulation results verify that DRL-GA can effectively solve the MTSOSP and outperforms the state-of-the-art algorithms in several aspects. This work reveals the advantages of the proposed generalized model and scheduling method, which exhibit good scalability for various types of observation satellite scheduling problems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In contrast, agile EOSs (AEOSs) can maneuver along both the roll and pitch axes, providing additional flexibility to look ahead or look back within the VTW (Lemaˆ ıtre et al., 2002; Wang et al., 2020; Song et al., 2024).”
From Scheduling multiple agile Earth observation satellites with multiple observations (2026) · cites this paper as Song et al., 2024
Citations
Cites
Dueling Network Architectures for Deep Reinforcement Learning
Wang, Z., Schaul, T., Hessel, M., van Hasselt, H., Lanctot, M., & de Freitas, N. (2015) · arXiv · doi:10.48550/arxiv.1511.06581 · Cited by 3,300
Vinyals, O., Fortunato, M., & Jaitly, N. (2015) · neural information processing systems · Cited by 2,986
Chuvieco, E., Mouillot, F., van der Werf, G. R., San Miguel, J., Tanase, M., Koutsias, N., García, M., Yebra, M., Padilla, M., Gitas, I., et al. (2019) · Remote Sensing of Environment · doi:10.1016/j.rse.2019.02.013 · Cited by 619
Pisinger, D., & Ropke, S. (2019) · International Series in Operations Research & Management Science · doi:10.1007/978-3-319-91086-4_4 · Cited by 395
Half a century of satellite remote sensing of sea-surface temperature
Minnett, P. J., Alvera-Azcárate, A., Chin, T. M., Corlett, G. K., Gentemann, C. L., Karagali, I., Li, X., Marsouin, A., Marullo, S., Maturi, E., et al. (2019) · Remote Sensing of Environment · doi:10.1016/j.rse.2019.111366 · Cited by 342
Three Scheduling Algorithms Applied to the Earth Observing Systems Domain
Wolfe, W. J., & Sorensen, S. E. (2000) · Management Science · doi:10.1287/mnsc.46.1.148.15134 · Cited by 313
Wang, X., Wu, G., Xing, L., & Pedrycz, W. (2021) · IEEE Systems Journal · doi:10.1109/jsyst.2020.2997050 · Cited by 260 · cited 1×
“EAs, including metaheuristics, are commonly used in practical engineering applications [22].”
BackgroundSelf-citationTian, Y., Li, X., Ma, H., Zhang, X., Tan, K. C., & Jin, Y. (2023) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2022.3146882 · Cited by 232
Du, Y., Li, J.-Q., Chen, X.-L., Duan, P.-Y., & Pan, Q.-K. (2023) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2022.3145706 · Cited by 202
Machine Learning into Metaheuristics: A Survey and Taxonomy
Talbi, E.-G. (2022) · ACM Computing Surveys · doi:10.1145/3459664 · Cited by 168
Cited by
Reinforcement learning-assisted evolutionary algorithm: A survey and research opportunities
Song, Y., Wu, Y., Guo, Y., Yan, R., Suganthan, P. N., Zhang, Y., Pedrycz, W., Das, S., Mallipeddi, R., Ajani, O. S., et al. (2024) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2024.101517 · Cited by 168
Self-citationEvolutionary Reinforcement Learning: A Systematic Review and Future Directions
Lin, Y., Lin, F., Cai, G., Chen, H., Zou, L., Liu, Y., & Wu, P. (2025) · Mathematics · doi:10.3390/math13050833 · Cited by 45
Su, C., Zhang, C., Wang, C., Cen, W., Chen, G., & Xie, L. (2024) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2024.101605 · Cited by 44
Wu, J., Wang, Z., Song, Y., Zhou, X., & Cheng, L. (2025) · Computers & Industrial Engineering · doi:10.1016/j.cie.2025.110933 · Cited by 43
Self-citationEnergy-Efficient Satellite Range Scheduling Using a Reinforcement Learning-Based Memetic Algorithm
Song, Y., Suganthan, P. N., Pedrycz, W., Yan, R., Fan, D., & Zhang, Y. (2024) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2024.3371964 · Cited by 42
Self-citationMeng, K., Wu, B., Xin, B., Deng, F., & Chen, C. (2025) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2025.102145 · Cited by 30
Wu, R., Zheng, J., Li, X., Tang, H., Wang, X. V., & Li, Y. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128280 · Cited by 26
Self-citationLu, W., Gao, W., Liu, B., Niu, W., Peng, X., Yang, Z., & Song, Y. (2024) · Advances in Space Research · doi:10.1016/j.asr.2024.07.044 · Cited by 26
Self-citationScheduling multiple agile Earth observation satellites with multiple observations
Wang, X., Han, C., & Leus, R. (2026) · Advances in Space Research · doi:10.1016/j.asr.2025.10.042 · Cited by 24
Self-citationAn adaptive differential evolution algorithm based on archive reuse
Cui, Z., Zhao, B. Y., Zhao, T., Cai, X., & Chen, J. (2024) · Information Sciences · doi:10.1016/j.ins.2024.120524 · Cited by 23
Xu, Y., Jiang, X., Li, J., Xing, L., & Song, Y. (2024) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2024.101625 · Cited by 23
Self-citationLi, Z., Zhu, X. F., Liu, C., Song, J., Liu, Y., Yin, C., & Sun, W. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128350 · Cited by 19
Gu, Y., Li, Z., Liu, H., Luo, Q., Liu, H., & Wu, G. (2025) · Advances in Space Research · doi:10.1016/j.asr.2025.10.092 · Cited by 19
A comprehensive survey of multi-agent deep reinforcement learning for wireless spectrum management
Wang, Y., Lei, J., Shang, F., & Li, Y. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.131236 · Cited by 19
Zhou, G., Jin, Z., & Liu, D. (2025) · Remote Sensing · doi:10.3390/rs17121972 · Cited by 17
Qi, J., Hu, M., & Xing, L. (2024) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2024.101792 · Cited by 15
Self-citationNing, Y., Bai, Z., Wei, J., Suganthan, P. N., Xing, L., Wang, J., & Song, Y. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125555 · Cited by 13
Self-citationPerspectives on spatio-temporal intelligence
Li, D., Wang, M., Xiao, J., & Yang, B. (2025) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2025.12.011 · Cited by 13
Deep Reinforcement Learning for Dynamic Task Scheduling in Data Relay Satellite Networks
Chen, K., Yu, Q., Li, L., & Chen, J. (2025) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2025.3555594 · Cited by 13
Zhang, Y., Li, J., Ma, H., Su, Z., & Wu, J. D. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.130245 · Cited by 11
Self-citationYao, W., Shen, X., Zhang, G., Lu, Z., Wang, J., Song, Y., & Li, Z. (2025) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2025.101867 · Cited by 10
Self-citationZhang, Y., & Xing, L. (2024) · Mathematics · doi:10.3390/math12203221 · Cited by 9
Self-citationAbd, R. I., Findley, D. J., Mohammady, S., Ardakani, M., & Kim, K. S. (2025) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2025.3615970 · Cited by 9
Ji, M., Zhang, S., & Yang, J. (2025) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2025.110518 · Cited by 8
Fully-distributed autonomous scheduling for Earth-observing constellations
Yu, Y., Wang, J., Wang, W., Tan, L., Varatharajoo, R., & Zhang, C. (2025) · Astrodynamics · doi:10.1007/s42064-024-0253-1 · Cited by 8
Zhang, Z., Cheng, S., Shan, Y., Wang, Z., Ran, H., & Xing, L. (2024) · Symmetry · doi:10.3390/sym17010014 · Cited by 8
Self-citationZhu, Q., Yu, H., Li, K., & Zeng, J. (2024) · Information Sciences · doi:10.1016/j.ins.2024.121224 · Cited by 8
Wang, H., Huang, W., Magnússon, S., Lindgren, T., Chen, C., Wu, J., & Song, Y. (2025) · International Journal of Digital Earth · doi:10.1080/17538947.2025.2458024 · Cited by 7
Self-citationLu, W., Liu, B., Mu, Z., Wu, S., Song, Y., & Razoumny, V. Y. (2025) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2025.3617044 · Cited by 7
Self-citationFast Task Scheduling With Model Predictive Control Integrating a Priority-Based Heuristic
Liberati, F., Donsante, M., Cirino, C. M. F., & Tortorelli, A. (2025) · IEEE Access · doi:10.1109/access.2025.3529909 · Cited by 7
Liu, Z., Xiong, W., Han, C., & Yu, X. (2024) · Sensors · doi:10.3390/s24196396 · Cited by 6
EOS-Bench: A Comprehensive Benchmark for Earth Observation Satellite SchedulingPreprint
Yin, Q., Li, J., Cheng, J., Luo, Q., Riccardi, A., Chatterjee, A., Vazquez, R., Novara, C., Mavrovouniotis, M., Suganthan, P. N., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.25782 · Cited by 6
Self-citationShen, X., Lu, Z., Li, L., Chen, Y., Li, X., Wang, J., & Yao, W. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3513483 · Cited by 5
Ma, C., Huang, P., Liu, X., Wu, C., & Xu, R. L. (2025) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2025.101971 · Cited by 5
An Innovative Priority-Aware Mission Planning Framework for an Agile Earth Observation Satellite
Zhu, G., Zheng, Z., Ouyang, C., Guo, Y., & Sun, P. (2025) · Aerospace · doi:10.3390/aerospace12040309 · Cited by 4
A Multi-Pointer Network for Multiple Agile Optical Satellite Scheduling Problem
Liu, Z., Xiong, W., Han, C., & Zhao, K. (2024) · Aerospace · doi:10.3390/aerospace11100792 · Cited by 4
Multi-agent cooperation-based bi-criteria evolutionary many-objective optimization
Li, J., Liu, Y., Zou, J., Liu, S., Yang, S., & Zheng, J. P. (2025) · Applied Soft Computing · doi:10.1016/j.asoc.2025.113865 · Cited by 4
Cheng, J., Fan, M., Gu, Y., Tang, W., Luo, Q., Wang, Y., Wang, X., & Wu, G. (2026) · Information Sciences · doi:10.1016/j.ins.2026.123200 · Cited by 4
Self-citationChen, J. B., Pedrycz, W., Wang, F., Wu, J. D., Wu, G., Xing, L., Chen, Y., & Song, Y. (2026) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2026.3700605 · Cited by 4
Self-citationYao, H., Lou, H., Wang, D., Chen, Y., & Yan, J. (2024) · Remote Sensing · doi:10.3390/rs16234472 · Cited by 4
Filter transfer learning algorithm for nonlinear systems modeling with heterogeneous features
Han, H., Li, M., Wu, X., Yang, H., & Qiao, J. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.125445 · Cited by 4
Wu, W., Wu, X., Liu, F., Liu, S., Wang, T., & Xing, Z. (2025) · Journal of Aerospace Engineering · doi:10.1061/jaeeez.aseng-6187 · Cited by 4
A reinforcement learning-enhanced meta-heuristic framework for network dismantling
Wu, M., Shi, W. J., Guo, F., Dai, B., Mou, J., Tan, S., Lu, X. B., & Ou, C. (2025) · Journal of Physics Complexity · doi:10.1088/2632-072x/adfff1 · Cited by 3
A Review of Deep Reinforcement Learning for Autonomous Earth Observation Satellite Scheduling
Wang, K., Jin, H., & Yu, R. (2026) · IEEE Access · doi:10.1109/access.2026.3675302 · Cited by 3
Optimizing Collaborative Space–Air–Ground Earth Observation: A decision-making perspective
Wu, Q., Xie, Y., Wang, K., & Pun, M.-O. (2025) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2025.3586570 · Cited by 3
Task planning using immune tabu search genetic algorithm for satellite swarm earth observations
Wu, X., Liu, K., Ma, Q., Liu, D., & Wang, E. (2025) · Advances in Space Research · doi:10.1016/j.asr.2025.07.009 · Cited by 2
Zhu, J., Hu, Q., Wu, J. D., Du, Y., Liu, X., Song, Y., Pedrycz, W., & Xing, L. (2026) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2026.3680859 · Cited by 2
Self-citationTask Scheduling Method of Revisit Tasks for Satellite Constellation Towards Wildfire Management
Wen, Z., Liu, Y., Zhang, S., & Hu, H. (2025) · Electronics Letters · doi:10.1049/ell2.70197 · Cited by 1
Autonomous scheduling method for multi-satellite collaboration with multi-dimensional optimization
Chen, X., He, J., Dai, G., Wang, M., Lei, P., & Tian, T. (2025) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2025.102255 · Cited by 1
Farid, Y., & Jungers, R. M. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.132504 · Cited by 1
CBBA-based Decentralized Task Allocation Framework for Multiple Observation Satellites
Lee, K., Kim, S. M., Kim, M., & Choi, H. (2025) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2026.01.054 · Cited by 1
Song, Y., Guo, Y., Xing, L., Wu, J. D., Wang, J., Huai, S., & Pedrycz, W. (2026) · Advances in Space Research · doi:10.1016/j.asr.2026.06.023 · Cited by 1
Self-citationCao, S., Liu, X. Y., He, L., & Chun, J. (2026) · ENGINEERING Management · doi:10.1007/s42524-026-5194-3 · Cited by 1
A Hybrid Preference Interaction Mechanism for Multi-Satellite Imaging Dynamic Mission Planning
Yang, X., Hu, M., Huang, G., & Wang, Y. (2024) · Electronics · doi:10.3390/electronics13122374 · Cited by 2
(2024) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2024.3372199
Long, X., Yang, L., Huang, H., & Xu, S. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4841712
Tawfeeq, B. A., Rahmani, A. M., Koochari, A., & Navimipour, N. J. (2025) · Engineering Reports · doi:10.1002/eng2.70104
Maximum Profit Heuristic Algorithm for Earth Observation Satellites Scheduling Problem
Li, T.-T., Li, J.-Y., Liu, X., Liu, D., Zhou, Q., Zhang, J., & Zhan, Z. (2025) · International Conference on Machine Intelligence Theory and Applications (MiTA) · doi:10.1109/mita66017.2025.11100189
Tian, H., Zhong, S., Cheng, Y., Liu, H., & Liu, D. (2025) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2025.11.303
Liu, Y., Xiong, W. H., & Yu, X. (2026) · Sensors · doi:10.3390/s26051606
Qian, Y., Su, L., Xu, M., & Wang, X. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.12293
Self-citationJiaxing, L. I., Wu, G., Fan, M., Luo, Q., & Wang, X. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6601235
Self-citationKim, S. J., Kim, M., & Choi, H. (2026) · Acta Astronautica · doi:10.1016/j.actaastro.2026.04.059
Problem-Specific Knowledge and Learning-Based Meta-Heuristics for On-Demand Food Delivery Scheduling
Ren, Y., Gao, K., Lin, Z., Wu, N., Wang, L., & Zhao, L. (2026) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2026.3688234
Optimization of Day-Ahead Initial Generation Scheduling under Multiple Constraints
Sun, B. (2026) · Ingegneria Sismica · doi:10.65102/is20261080
Ren, X., Yang, S., Dai, G., & Wang, M. (2026) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2026.102446
Agile Project Portfolio Realignment: A PbRL-EMOA Framework for Shifting Strategic Priority
Dai, Y., Chen, Z., Dou, Y., Pedrycz, W., Song, Y., & Jiang, J. (2026) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2026.3705431
Self-citationLong, X., Leping, Y. A. N. G., Zhu, Y., Weiwei, C. A. I., Huang, H., & Zhao, X. (2026) · Acta Astronautica · doi:10.1016/j.actaastro.2026.07.057
Evolutionary Computation in Satellite System Optimization for Deployment and Scheduling: A Survey
Yang, Q.-T., Luo, L.-Y., Zhou, Q., Kwong, S., Zhang, J., & Zhan, Z. (2026) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2026.3729751
Song, Y., Wu, J., Wang, H., Wang, J., Zhang, Y., Jiang, X., Xing, L., & Hu, Q. (2026) · Aerospace Science and Technology · doi:10.1016/j.ast.2026.114061
Self-citationWu, X., Sun, C., & Bi, L. (2026) · Remote Sensing · doi:10.3390/rs18213675
Fu, H., Huang, H., Fu, S., Chen, Y., Mao, W., Zhang, G., Zhu, Y., Wang, J., Liu, Y., Liu, Y., et al. (2026) · Measurement · doi:10.1016/j.measurement.2026.123789
A schedule-repair-enhanced two-stage method for multi-satellite earth observation task scheduling
Song, Q., Zeng, F., & 侯金毅 (2026) · Journal of Physics Conference Series · doi:10.1088/1742-6596/3343/1/012033
Metadata
- Authors
- Song, Y., Ou, J., Pedrycz, W., Suganthan, P. N., Wang, X., Xing, L., & Zhang, Y.
- Affiliations
- Xidian University (CN)
- Xiangtan University (CN)
- University of Alberta (CA)
- Qatar University (QA)
- Delft University of Technology (NL)
- Beihang University (CN)
- ORCID
- Venue
- IEEE Transactions on Systems, Man, and Cybernetics: Systems
- Published
- 2024-04
- Volume
- 54
- Issue
- 4
- Pages
- 2576-2589
- ISSN
- 2168-2216 (ISSN-L)
- 2168-2232
- OpenAlex
- W4390872313
- Semantic Scholar
- 5176f8e9f8670487c82cd7fd7705adfe50ed8b06
- Cited by
- 63
- References
- 44
- Citations by year
- 2026: 12 · 2025: 33 · 2024: 18
- FWCI
- 10.89
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Systems Man and Cybernetics Systems (publishedVersion)
- Qatar University QSpace (Qatar University) (submittedVersion)
- Funders
- Science and Technology Innovation Team of Shaanxi Province (2023-CX-TD-07)
- Special Project in Major Fields of Guangdong Universities (2021ZDZX1019)
- Hunan Key Laboratory of Intelligent Decision-Making Technology for Emergency Management (2020TP1013)
- Topics
- Physical Sciences › Engineering › Aerospace Engineering › Satellite Communication Systems
- Physical Sciences › Engineering › Industrial and Manufacturing Engineering › Scheduling and Optimization Algorithms
- Physical Sciences › Computer Science › Artificial Intelligence › Metaheuristic Optimization Algorithms Research
- Keywords
- deep reinforcement learning, genetic algorithm, mixed integer programming model, spaceborne SAR, task scheduling, Q-value estimation, elite strategy, resource utilization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.