The DOI matches its Crossref record; 35 of the 37 references it cites were found in a registry or an index.
Task Scheduling Under a Novel Framework for Data Relay Satellite Network via Deep Reinforcement Learning
Abstract
Data relay satellite networks (DRSNs) face the challenge of increasing relay mission demands in space networks. To improve the task scheduling efficiency of DRSN further, we propose a novel task scheduling framework, wherein a scheduling sequence is generated by selecting one antenna and selecting one task for the antenna in each step. Subsequently, the task scheduling problem of DRSN (TSPD) is regarded as a sequential decision-making problem and is optimized using a method based on deep reinforcement learning (DRL), which overcomes the difficulty of designing heuristics with massive efforts. In this study, a mathematical model and corresponding Markov decision model based on our proposed scheduling framework are constructed, and for the first time, a policy network that includes one encoder based on the attention mechanism and two decoders is designed to solve the TSPD. In addtion, extensive experiments are conducted to verify the effectiveness of our scheduling framework and demonstrate that the DRL method can obtain a scheduling scheme with the highest profits with decent generalization to different task scales, number of user spacecrafts and execution duration of tasks.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 3,416
Vinyals, O., Fortunato, M., & Jaitly, N. (2015) · neural information processing systems · Cited by 2,043
Three Scheduling Algorithms Applied to the Earth Observing Systems Domain
Wolfe, W. J., & Sorensen, S. E. (2000) · Management Science · doi:10.1287/mnsc.46.1.148.15134 · Cited by 313
Wang, X., Wu, G., Xing, L., & Pedrycz, W. (2021) · IEEE Systems Journal · doi:10.1109/jsyst.2020.2997050 · Cited by 260 · cited 1×
“In the future work, we will consider the methods to handle the dynamic disturbance factors in the TSPD [12], [24], [40], [41] such as the arrival of temporary tasks.”
MethodSelf-citationThe Space-Terrestrial Integrated Network: An Overview
Yao, H., Wang, L., Wang, X., Lu, Z., & Liu, Y. (2018) · IEEE Communications Magazine · doi:10.1109/mcom.2018.1700038 · Cited by 223
Deep Reinforcement Learning for Solving the Heterogeneous Capacitated Vehicle Routing Problem
Li, J., Ma, Y., Gao, R., Cao, Z., Lim, A., Song, W., & Zhang, J. (2022) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2021.3111082 · Cited by 209
Self-citationWang, P., Reinelt, G., Gao, P., & Tan, Y. (2011) · Computers & Industrial Engineering · doi:10.1016/j.cie.2011.02.015 · Cited by 195
Attention, Learn to Solve Routing Problems!
Kool, W., van Hoof, H., & Welling, M. (2018) · UvA-DARE (University of Amsterdam) · doi:10.48550/arxiv.1803.08475 · Cited by 171
Research works printed but not linked: 5
- du, 2021, Survey on models, algorithms and general techniques for spacecraft mission scheduling, ACTA Automatica Sinica, 47, 2715
- reddy, 1986, Single Processor Scheduling with Job Priorities and Arbitrary Ready and Due Times
- guo, 2018, Relay satellite system task scheduling algorithm based on double-layer priority, Appl Res Comput, 35, 1506
- he, 2018, Scheduling model and heuristic algorithm for tracking and data relay satellite considering multiple slide windows, J Zheiiang Univ (Eng Sci ), 39, 11
- zhang, 2011, Study of TDRS dynamic scheduling problem, J Syst Simul, 23, 1464
Cited by
Helini, K., Bhavani, S., Shivakumar, K., Gayathri, B., Mande, S., & Medishetti, S. K. (2025) · International Conference on Pervasive Computing and Social Networking (ICPCSN) · doi:10.1109/icpcsn65854.2025.11035912 · Cited by 57
Zhou, D., Sheng, M., Bao, C., Wang, Y., Li, J., & Han, Z. (2025) · IEEE Transactions on Communications · doi:10.1109/tcomm.2025.3529250 · Cited by 48
Self-citationWu, G., Liu, Z., Fan, M., & Wu, K. (2024) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2024.3377647 · Cited by 51
Self-citationChang, Z., Punnen, A. P., Zhou, Z., & Cheng, S. (2023) · Computers & Operations Research · doi:10.1016/j.cor.2023.106388 · Cited by 51
EOA: Energy and Temperature Aware Scheduling in Cloud-Fog Computing Environment
Kasturi, S. B., Raju, S. S. H., Srikanth, N., Anusha, K., Revathi, M., & Medishetti, S. K. (2025) · International Conference on Pervasive Computing and Social Networking (ICPCSN) · doi:10.1109/icpcsn65854.2025.11035542 · Cited by 43
Metadata
- Authors
- Li, J., Wu, G., Liao, T., Fan, M., Mao, X., & Pedrycz, W.
- Affiliations
- Central South University (CN)
- PLA Academy of Military Science (CN)
- University of Alberta (CA)
- Venue
- IEEE Transactions on Vehicular Technology
- Published
- 2023-05
- Volume
- 72
- Issue
- 5
- Pages
- 6654-6668
- ISSN
- 0018-9545 (ISSN-L)
- 1939-9359
- OpenAlex
- W4313476524
- Semantic Scholar
- 719ea7cbb68038b75d49fa21f5ba4d6ae482e585
- Cited by
- 61
- References
- 37
- Citations by year
- 2026: 14 · 2025: 33 · 2024: 10 · 2023: 4
- FWCI
- 7.43
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Vehicular Technology (publishedVersion)
- Funders
- National Natural Science Foundation of China (62073341)
- Natural Science Fund for Distinguished Young Scholars of Hunan Province (2019JJ20026)
- Topics
- Physical Sciences › Engineering › Aerospace Engineering › Satellite Communication Systems
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Wireless Network Optimization
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Space Technology and Applications
- Keywords
- task scheduling, deep reinforcement learning, Markov decision process, attention mechanism, policy networks, antenna selection, sequential decision making, space networks, scheduling framework
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Task Scheduling Under a Novel Framework for Data Relay Satellite Network via Deep Reinforcement Learning. https://app.cochat.ai/papers/10.1109/tvt.2022.3233358
- The paper
- Li, J., Wu, G., Liao, T., Fan, M., Mao, X., & Pedrycz, W. (2023). Task Scheduling Under a Novel Framework for Data Relay Satellite Network via Deep Reinforcement Learning. IEEE Transactions on Vehicular Technology. https://doi.org/10.1109/tvt.2022.3233358
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.