Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 182

The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.

RL-GA: A Reinforcement Learning-based Genetic Algorithm for Electromagnetic Detection Satellite Scheduling Problem

Open access
Song, Yanjie, Wei, Luona, Yang, Qing, Wu, Jian, Xing, Lining, Chen, Yingwu · 2023 · Swarm and Evolutionary Computation

Abstract

The study of electromagnetic detection satellite scheduling problem (EDSSP) has attracted attention due to the detection requirements for a large number of targets. This paper proposes a mixed-integer programming model for the EDSSP problem and a genetic algorithm based on reinforcement learning (RL-GA). Numerous factors that affect electromagnetic detection are considered in the model, such as detection mode, bandwidth, and other factors. The RL-GA embeds a Q-learning method into an improved genetic algorithm, and the evolution of each individual depends on the decision of the agent. Q-learning is used to guide the population search process by choosing evolution operators. In this way, the search information can be effectively used by the reinforcement learning method. In the algorithm, we design a reward function to update the Q value. According to the problem characteristics, a new combination ofis proposed. The RL-GA also uses an elite individual retention strategy to improve search performance. After that, a task time window selection algorithm (TTWSA) is proposed to evaluate the performance of population evolution. Several experiments are used to examine the scheduling effect of the proposed algorithm. Through the experimental verification of multiple instances, it can be seen that the RL-GA can solve the EDSSP problem effectively. Compared with the state-of-the-art algorithms, the RL-GA performs better in several aspects.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.swevo.2023.101236

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 6 references

Research works printed but not linked: 33

  1. Lin, 2005, Daily imaging scheduling of an earth observation satellite, IEEE Trans. Syst. Man Cybern.- A: Syst. Hum., 35, 213, 10.1109/TSMCA.2005.843380 · DOI · Paper page
  2. Yaodong, 2016, Research on mission scheduling of electronic reconnaissance satellites based on multi-area, DEStech Trans. Engi. Technol. Res. Iceea
  3. Li, 2011, Research on the method of electronic reconnaissance satellites mission planning for continuous reconnaissance of moving target, J. Acad. Equip. Command Technol.
  4. Xhafa, 2021, Optimisation problems and resolution methods in satellite scheduling and space-craft operation: A survey, Enterp. Inf. Syst., 15, 1022, 10.1080/17517575.2019.1593508 · DOI · Paper page
  5. Berger, 2020, QUEST–A new quadratic decision model for the multi-satellite scheduling problem, Comput. Oper. Res., 115, 10.1016/j.cor.2019.104822 · DOI
  6. Niu, 2018, Satellite scheduling of large areal tasks for rapid response to natural disaster using a multi-objective genetic algorithm, Int. J. Disaster Risk Reduct., 28, 813, 10.1016/j.ijdrr.2018.02.013 · DOI
  7. Chen, 2019, A mixed integer linear programming model for multi-satellite scheduling, European J. Oper. Res., 275, 694, 10.1016/j.ejor.2018.11.058 · DOI · Paper page
  8. Zheng, 2017, Swarm satellite mission scheduling & planning using hybrid dynamic mutation genetic algorithm, Acta Astronaut., 137, 243, 10.1016/j.actaastro.2017.04.027 · DOI
  9. Li, 2019, A multi-objective binary-encoding differential evolution algorithm for proactive scheduling of agile earth observation satellites, Adv. Space Res., 63, 3258, 10.1016/j.asr.2019.01.043 · DOI
  10. Chen, 2010, ACO algorithm of satellite data transmission scheduling based on solution construction graph, Syst. Eng. Electron., 32, 592
  11. Xiang, 2021, Knowledge-based memetic algorithm for joint task planning of multi-platform earth observation system, Comput. Ind. Eng., 160, 10.1016/j.cie.2021.107559 · doi:10.1016/j.cie.2021.107559
  12. Barbulescu, 2006, Understanding algorithm performance on an oversubscribed scheduling application, J. Artificial Intelligence Res., 27, 577, 10.1613/jair.2038 · DOI
  13. Zhibo, 2021, Multi-satellites imaging scheduling using individual reconfiguration based integer coding genetic algorithm, Acta Astronaut., 178, 645, 10.1016/j.actaastro.2020.08.041 · DOI
  14. Zhang, 2022, An improved genetic algorithm for the integrated satellite imaging and data transmission scheduling problem, Comput. Oper. Res., 139, 10.1016/j.cor.2021.105626 · DOI
  15. Song, 2019, Learning-guided nondominated sorting genetic algorithm II for multi-objective satellite range scheduling problem, Swarm Evol. Comput., 49, 194, 10.1016/j.swevo.2019.06.008 · DOI
  16. Xhafa, 2012, Genetic algorithms for satellite scheduling problems, Mob. Inf. Syst., 8, 351
  17. Wei, 2021, Deep reinforcement learning and parameter transfer based approach for the multi-objective agile earth observation satellite scheduling problem, Appl. Soft Comput., 110, 10.1016/j.asoc.2021.107607 · DOI
  18. Hsieh, 2016, A Q-learning-based swarm optimization algorithm for economic dispatch problem, Neural Comput. Appl., 27, 2333, 10.1007/s00521-015-2070-1 · DOI
  19. Li, 2019, Differential evolution based on reinforcement learning with fitness ranking for solving multimodal multi-objective problems, Swarm Evol. Comput., 49, 234, 10.1016/j.swevo.2019.06.010 · DOI
  20. Tian, 2022, Deep reinforcement learning based adaptive operator selection for evolutionary multi-objective optimization, IEEE Trans. Emerg. Top. Comput. Intell.
  21. Zhang, 2022, Multi-objective particle swarm optimization with multi-mode collaboration based on reinforcement learning for path planning of unmanned air vehicles, Knowl.-Based Syst.
  22. Du, 2022, Knowledge-based reinforcement learning and estimation of distribution algorithm for flexible job shop scheduling problem, IEEE Trans. Emerg. Top. Comput. Intell.
  23. He, 2020, A generic Markov decision process model and reinforcement learning method for scheduling agile earth observation satellites, IEEE Trans. Syst. Man Cybern.: Syst.
  24. Wei, 2021, A multi-objective memetic approach for time-dependent agile earth observation satellite scheduling problem, Comput. Ind. Eng., 159, 10.1016/j.cie.2021.107530 · DOI
  25. Barbulescu, 2004, Scheduling space–ground communications for the air force satellite control network, J. Sched., 7, 7, 10.1023/B:JOSH.0000013053.32600.3c · DOI · Paper page
  26. Vallada, 2011, A genetic algorithm for the unrelated parallel machine scheduling problem with sequence dependent setup times, European J. Oper. Res., 211, 612, 10.1016/j.ejor.2011.01.011 · doi:10.1016/j.ejor.2011.01.011
  27. Kumar, 2020, Conservative Q-learning for offline reinforcement learning, Adv. Neural Inf. Process. Syst., 33, 1179
  28. Watkins, 1992, Q-learning, Mach. Learn., 8, 279
  29. Peng, 2019, Agile earth observation satellite scheduling: An orienteering problem with time-dependent profits and travel times, Comput. Oper. Res., 111, 84, 10.1016/j.cor.2019.05.030 · DOI · Paper page
  30. Song, 2018, A hybrid genetic algorithm for satellite image downlink scheduling problem, Discrete Dyn. Nat. Soc., 2018, 10.1155/2018/1531452 · DOI
  31. He, 2018, An improved adaptive large neighborhood search algorithm for multiple agile satellites scheduling, Comput. Oper. Res., 100, 12, 10.1016/j.cor.2018.06.020 · DOI · Paper page
  32. Pan, 2011, A discrete artificial bee colony algorithm for the lot-streaming flow shop scheduling problem, Inform. Sci., 181, 2455, 10.1016/j.ins.2009.12.025 · doi:10.1016/j.ins.2009.12.025
  33. Zhang, 2022, An improved genetic algorithm for the integrated satellite imaging and data transmission scheduling problem, Comput. Oper. Res., 139, 10.1016/j.cor.2021.105626 · DOI

Cited by

See all 182

Metadata

Authors
Song, Y., Wei, L., Yang, Q., Wu, J., Xing, L., & Chen, Y.
Venue
Swarm and Evolutionary Computation
Publisher
Elsevier BV
Published
2023-03
Volume
77
Pages
101236
ISSN
2210-6502 (ISSN-L)
OpenAlex
W4315574835
Cited by
182
References
6
FWCI
24.34
Type
journal article
Language
en
Open access
green
Funders
  • National Natural Science Foundation of China (61773120, 71901213, 72001212)
  • Hunan Provincial Innovation Foundation for Postgraduate (CX20200585)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: RL-GA: A Reinforcement Learning-based Genetic Algorithm for Electromagnetic Detection Satellite Scheduling Problem. https://app.cochat.ai/papers/10.1016/j.swevo.2023.101236
The paper
Song, Y., Wei, L., Yang, Q., Wu, J., Xing, L., & Chen, Y. (2023). RL-GA: A Reinforcement Learning-based Genetic Algorithm for Electromagnetic Detection Satellite Scheduling Problem. Swarm and Evolutionary Computation. https://doi.org/10.1016/j.swevo.2023.101236

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.