The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
RL-GA: A Reinforcement Learning-based Genetic Algorithm for Electromagnetic Detection Satellite Scheduling Problem
Open accessAbstract
The study of electromagnetic detection satellite scheduling problem (EDSSP) has attracted attention due to the detection requirements for a large number of targets. This paper proposes a mixed-integer programming model for the EDSSP problem and a genetic algorithm based on reinforcement learning (RL-GA). Numerous factors that affect electromagnetic detection are considered in the model, such as detection mode, bandwidth, and other factors. The RL-GA embeds a Q-learning method into an improved genetic algorithm, and the evolution of each individual depends on the decision of the agent. Q-learning is used to guide the population search process by choosing evolution operators. In this way, the search information can be effectively used by the reinforcement learning method. In the algorithm, we design a reward function to update the Q value. According to the problem characteristics, a new combination ofis proposed. The RL-GA also uses an elite individual retention strategy to improve search performance. After that, a task time window selection algorithm (TTWSA) is proposed to evaluate the performance of population evolution. Several experiments are used to examine the scheduling effect of the proposed algorithm. Through the experimental verification of multiple instances, it can be seen that the RL-GA can solve the EDSSP problem effectively. Compared with the state-of-the-art algorithms, the RL-GA performs better in several aspects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Wang, X., Wu, G., Xing, L., & Pedrycz, W. (2021) · IEEE Systems Journal · doi:10.1109/jsyst.2020.2997050 · Cited by 260 · cited 2×
“Compared with the electromagnetic detection satellite scheduling problem, there are many studies related to the optical satellite observation scheduling problem[4, 5].”
BackgroundMethodSelf-citationScheduling Space–Ground Communications for the Air Force Satellite Control Network
Barbulescu, L., Watson, J.-P., Whitley, L. D., & Howe, A. E. (2004) · Journal of Scheduling · doi:10.1023/b:josh.0000013053.32600.3c · Cited by 232
Optimization-Based Scheduling Method for Agile Earth-Observing Satellite Constellation
Cho, D.-H., Kim, J.-H., Choi, H.-L., & Ahn, J. (2018) · Journal of Aerospace Information Systems · doi:10.2514/1.i010620 · Cited by 98
MOEA based memetic algorithms for multi-objective satellite range scheduling problem
Du, Y., Xing, L., Zhang, J., Chen, Y., & He, Y. (2019) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2019.100576 · Cited by 69 · cited 1×
“Song et al. and Du et al. used non-dominated sorting-based and decomposition-based multi-objective evolutionary algorithms, respectively, to find high-quality solutions for satellite range scheduling problems[19, 20].”
BackgroundSelf-citationEvaluation of struggle strategy in Genetic Algorithms for ground stations scheduling problem
Xhafa, F., Herrero, X., Barolli, A., Barolli, L., & Takizawa, M. (2013) · Journal of Computer and System Sciences · doi:10.1016/j.jcss.2013.01.023 · Cited by 51
Research works printed but not linked: 33
- Lin, 2005, Daily imaging scheduling of an earth observation satellite, IEEE Trans. Syst. Man Cybern.- A: Syst. Hum., 35, 213, 10.1109/TSMCA.2005.843380 · DOI · Paper page
- Yaodong, 2016, Research on mission scheduling of electronic reconnaissance satellites based on multi-area, DEStech Trans. Engi. Technol. Res. Iceea
- Li, 2011, Research on the method of electronic reconnaissance satellites mission planning for continuous reconnaissance of moving target, J. Acad. Equip. Command Technol.
- Xhafa, 2021, Optimisation problems and resolution methods in satellite scheduling and space-craft operation: A survey, Enterp. Inf. Syst., 15, 1022, 10.1080/17517575.2019.1593508 · DOI · Paper page
- Berger, 2020, QUEST–A new quadratic decision model for the multi-satellite scheduling problem, Comput. Oper. Res., 115, 10.1016/j.cor.2019.104822 · DOI
- Niu, 2018, Satellite scheduling of large areal tasks for rapid response to natural disaster using a multi-objective genetic algorithm, Int. J. Disaster Risk Reduct., 28, 813, 10.1016/j.ijdrr.2018.02.013 · DOI
- Chen, 2019, A mixed integer linear programming model for multi-satellite scheduling, European J. Oper. Res., 275, 694, 10.1016/j.ejor.2018.11.058 · DOI · Paper page
- Zheng, 2017, Swarm satellite mission scheduling & planning using hybrid dynamic mutation genetic algorithm, Acta Astronaut., 137, 243, 10.1016/j.actaastro.2017.04.027 · DOI
- Li, 2019, A multi-objective binary-encoding differential evolution algorithm for proactive scheduling of agile earth observation satellites, Adv. Space Res., 63, 3258, 10.1016/j.asr.2019.01.043 · DOI
- Chen, 2010, ACO algorithm of satellite data transmission scheduling based on solution construction graph, Syst. Eng. Electron., 32, 592
- Xiang, 2021, Knowledge-based memetic algorithm for joint task planning of multi-platform earth observation system, Comput. Ind. Eng., 160, 10.1016/j.cie.2021.107559 · doi:10.1016/j.cie.2021.107559
- Barbulescu, 2006, Understanding algorithm performance on an oversubscribed scheduling application, J. Artificial Intelligence Res., 27, 577, 10.1613/jair.2038 · DOI
- Zhibo, 2021, Multi-satellites imaging scheduling using individual reconfiguration based integer coding genetic algorithm, Acta Astronaut., 178, 645, 10.1016/j.actaastro.2020.08.041 · DOI
- Zhang, 2022, An improved genetic algorithm for the integrated satellite imaging and data transmission scheduling problem, Comput. Oper. Res., 139, 10.1016/j.cor.2021.105626 · DOI
- Song, 2019, Learning-guided nondominated sorting genetic algorithm II for multi-objective satellite range scheduling problem, Swarm Evol. Comput., 49, 194, 10.1016/j.swevo.2019.06.008 · DOI
- Xhafa, 2012, Genetic algorithms for satellite scheduling problems, Mob. Inf. Syst., 8, 351
- Wei, 2021, Deep reinforcement learning and parameter transfer based approach for the multi-objective agile earth observation satellite scheduling problem, Appl. Soft Comput., 110, 10.1016/j.asoc.2021.107607 · DOI
- Hsieh, 2016, A Q-learning-based swarm optimization algorithm for economic dispatch problem, Neural Comput. Appl., 27, 2333, 10.1007/s00521-015-2070-1 · DOI
- Li, 2019, Differential evolution based on reinforcement learning with fitness ranking for solving multimodal multi-objective problems, Swarm Evol. Comput., 49, 234, 10.1016/j.swevo.2019.06.010 · DOI
- Tian, 2022, Deep reinforcement learning based adaptive operator selection for evolutionary multi-objective optimization, IEEE Trans. Emerg. Top. Comput. Intell.
- Zhang, 2022, Multi-objective particle swarm optimization with multi-mode collaboration based on reinforcement learning for path planning of unmanned air vehicles, Knowl.-Based Syst.
- Du, 2022, Knowledge-based reinforcement learning and estimation of distribution algorithm for flexible job shop scheduling problem, IEEE Trans. Emerg. Top. Comput. Intell.
- He, 2020, A generic Markov decision process model and reinforcement learning method for scheduling agile earth observation satellites, IEEE Trans. Syst. Man Cybern.: Syst.
- Wei, 2021, A multi-objective memetic approach for time-dependent agile earth observation satellite scheduling problem, Comput. Ind. Eng., 159, 10.1016/j.cie.2021.107530 · DOI
- Barbulescu, 2004, Scheduling space–ground communications for the air force satellite control network, J. Sched., 7, 7, 10.1023/B:JOSH.0000013053.32600.3c · DOI · Paper page
- Vallada, 2011, A genetic algorithm for the unrelated parallel machine scheduling problem with sequence dependent setup times, European J. Oper. Res., 211, 612, 10.1016/j.ejor.2011.01.011 · doi:10.1016/j.ejor.2011.01.011
- Kumar, 2020, Conservative Q-learning for offline reinforcement learning, Adv. Neural Inf. Process. Syst., 33, 1179
- Watkins, 1992, Q-learning, Mach. Learn., 8, 279
- Peng, 2019, Agile earth observation satellite scheduling: An orienteering problem with time-dependent profits and travel times, Comput. Oper. Res., 111, 84, 10.1016/j.cor.2019.05.030 · DOI · Paper page
- Song, 2018, A hybrid genetic algorithm for satellite image downlink scheduling problem, Discrete Dyn. Nat. Soc., 2018, 10.1155/2018/1531452 · DOI
- He, 2018, An improved adaptive large neighborhood search algorithm for multiple agile satellites scheduling, Comput. Oper. Res., 100, 12, 10.1016/j.cor.2018.06.020 · DOI · Paper page
- Pan, 2011, A discrete artificial bee colony algorithm for the lot-streaming flow shop scheduling problem, Inform. Sci., 181, 2455, 10.1016/j.ins.2009.12.025 · doi:10.1016/j.ins.2009.12.025
- Zhang, 2022, An improved genetic algorithm for the integrated satellite imaging and data transmission scheduling problem, Comput. Oper. Res., 139, 10.1016/j.cor.2021.105626 · DOI
Cited by
A Multiple Agile Satellite Staring Observation Mission Planning Method for Dense Regions
Huang, W., Wang, H., Yi, D., Wang, S., Zhang, B., & Cui, J. (2023) · Remote Sensing · doi:10.3390/rs15225317 · Cited by 19
Scheduling multiple agile Earth observation satellites with multiple observations
Wang, X., Han, C., & Leus, R. (2026) · Advances in Space Research · doi:10.1016/j.asr.2025.10.042 · Cited by 24
A Multi-Pointer Network for Multiple Agile Optical Satellite Scheduling Problem
Liu, Z., Xiong, W., Han, C., & Zhao, K. (2024) · Aerospace · doi:10.3390/aerospace11100792 · Cited by 4
Metadata
- Authors
- Song, Y., Wei, L., Yang, Q., Wu, J., Xing, L., & Chen, Y.
- Venue
- Swarm and Evolutionary Computation
- Publisher
- Elsevier BV
- Published
- 2023-03
- Volume
- 77
- Pages
- 101236
- ISSN
- 2210-6502 (ISSN-L)
- OpenAlex
- W4315574835
- Cited by
- 182
- References
- 6
- FWCI
- 24.34
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- doi.org/10.15223/policy-017 (stm-asf)
- doi.org/10.15223/policy-037 (stm-asf)
- doi.org/10.15223/policy-012 (stm-asf)
- doi.org/10.15223/policy-029 (stm-asf)
- doi.org/10.15223/policy-004 (stm-asf)
- Funders
- National Natural Science Foundation of China (61773120, 71901213, 72001212)
- Hunan Provincial Innovation Foundation for Postgraduate (CX20200585)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: RL-GA: A Reinforcement Learning-based Genetic Algorithm for Electromagnetic Detection Satellite Scheduling Problem. https://app.cochat.ai/papers/10.1016/j.swevo.2023.101236
- The paper
- Song, Y., Wei, L., Yang, Q., Wu, J., Xing, L., & Chen, Y. (2023). RL-GA: A Reinforcement Learning-based Genetic Algorithm for Electromagnetic Detection Satellite Scheduling Problem. Swarm and Evolutionary Computation. https://doi.org/10.1016/j.swevo.2023.101236
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.