The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Deep Reinforcement Learning for Delay-Oriented IoT Task Scheduling in SAGIN
Abstract
In this article, we investigate a computing task scheduling problem in space-air-ground integrated network (SAGIN) for delay-oriented Internet of Things (IoT) services. In the considered scenario, an unmanned aerial vehicle (UAV) collects computing tasks from IoT devices and then makes online offloading decisions, in which the tasks can be processed at the UAV or offloaded to the nearby base station or the remote satellite. Our objective is to design a task scheduling policy that minimizes offloading and computing delay of all tasks given the UAV energy capacity constraint. To this end, we first formulate the online scheduling problem as an energy-constrained Markov decision process (MDP). Then, considering the task arrival dynamics, we develop a novel deep risk-sensitive reinforcement learning algorithm. Specifically, the algorithm evaluates the risk, which measures the energy consumption that exceeds the constraint, for each state and searches the optimal parameter weighing the minimization of delay and risk while learning the optimal policy. Extensive simulation results demonstrate that the proposed algorithm can reduce the task processing delay by up to 30% compared to probabilistic configuration methods while satisfying the UAV energy capacity constraint.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
Computer Architecture: A Quantitative Approach
Hennessy, J. L., & Patterson, D. A. (1989) · UCLA - Biblioteca de Ciencias y Tecnologia Felix Morales Bueno · Cited by 9,375
Markov decision processes: Discrete stochastic dynamic programming
Hazeghi, K., & Puterman, M. L. (1995) · Journal of the American Statistical Association · doi:10.2307/2291177 · Cited by 8,037
A general regression neural network
Specht, D. F. (1991) · IEEE Transactions on Neural Networks · doi:10.1109/72.97934 · Cited by 4,492
Computer architecture: a quantitative approach
Shute, M. (1993) · Microelectronics Journal · doi:10.1016/0026-2692(93)90111-q · Cited by 3,336
Efficient multi-user computation offloading for mobile-edge cloud computing
Chen, X., Jiao, L., Li, W., & Fu, X. (2016) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2015.2487344 · Cited by 2,675
Mobile Edge Computing: A Survey
Abbas, N., Zhang, Y., Taherkordi, A., & Skeie, T. (2018) · IEEE Internet of Things Journal · doi:10.1109/jiot.2017.2750180 · Cited by 2,474
Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing
Zhou, Z., Chen, X., Li, E., Zeng, L., Luo, K., & Zhang, J. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2918951 · Cited by 2,455 · cited 1×
“latency of task execution, but also save the power consumption of IoT devices [7].”
BackgroundMarkov Decision Processes: Discrete Stochastic Dynamic Programming
Baxter, L. A. (1995) · Technometrics · doi:10.1080/00401706.1995.10484354 · Cited by 2,415
Energy-Efficient UAV Communication With Trajectory Optimization
Zeng, Y., & Zhang, R. (2017) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2017.2688328 · Cited by 2,164
Joint Trajectory and Communication Design for Multi-UAV Enabled Wireless Networks
Wu, Q., Zeng, Y., & Zhang, R. (2018) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2017.2789293 · Cited by 1,978
Convergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498 · cited 1×
“The analytics results of input image/video from these IoT devices can help achieve automated drilling control [4].”
BackgroundSpace/Aerial-Assisted Computing Offloading for IoT Applications: A Learning-Based Approach
Cheng, X., Lyu, F., Quan, W., Zhou, C., He, H., Shi, W., & Shen, X. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2906789 · Cited by 867
Self-citationSoftware Defined Space-Air-Ground Integrated Vehicular Networks: Challenges and Solutions
Zhang, N., Zhang, S., Yang, P., Alhussein, O., Zhuang, W., & Shen, X. S. (2017) · IEEE Communications Magazine · doi:10.1109/mcom.2017.1601156 · Cited by 467
Self-citationZeng, D., Gu, L., Guo, S., Cheng, Z., & Yu, S. (2016) · IEEE Transactions on Computers · doi:10.1109/tc.2016.2536019 · Cited by 426
EMM: Energy-Aware Mobility Management for Mobile Edge Computing in Ultra Dense Networks
Sun, Y., Zhou, S., & Xu, J. (2017) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2017.2760160 · Cited by 420
Optimizing Space-Air-Ground Integrated Networks by Artificial Intelligence
Kato, N., Fadlullah, Z. M., Tang, F., Mao, B., Tani, S., Okamura, A., & Liu, J. (2019) · IEEE Wireless Communications · doi:10.1109/mwc.2018.1800365 · Cited by 404
UAV Trajectory Optimization for Data Offloading at the Edge of Multiple Cells
Cheng, F., Zhang, S., Li, Z., Chen, Y., Zhao, N., Yu, F. R., & Leung, V. C. M. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2811942 · Cited by 350
AI-Assisted Network-Slicing Based Next-Generation Wireless Networks
Shen, X., Gao, J., Wu, W., Lyu, K., Li, M., Zhuang, W., Li, X., & Rao, J. (2020) · IEEE Open Journal of Vehicular Technology · doi:10.1109/ojvt.2020.2965100 · Cited by 342
Self-citationAir-Ground Integrated Mobile Edge Networks: Architecture, Challenges, and Opportunities
Cheng, N., Xu, W., Shi, W., Zhou, Y., Lu, N., Zhou, H., & Shen, X. (2018) · IEEE Communications Magazine · doi:10.1109/mcom.2018.1701092 · Cited by 323
Self-citationUltra-Dense LEO: Integration of Satellite Access Networks into 5G and Beyond
Di, B., Song, L., Li, Y., & Poor, H. V. (2019) · IEEE Wireless Communications · doi:10.1109/mwc.2019.1800301 · Cited by 318
Partial Offloading Scheduling and Power Allocation for Mobile Edge Computing Systems
Kuang, Z., Li, L., Gao, J., Zhao, L., & Liu, A. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2911455 · Cited by 311
Optimal Schedule of Mobile Edge Computing for Internet of Things Using Partial Information
Lyu, X., Ni, W., Tian, H., Liu, R. P., Wang, X., Giannakis, G. B., & Paulraj, A. (2017) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2017.2760186 · Cited by 251
Adaptive Deployment for UAV-Aided Communication Networks
Wang, Z., Duan, L., & Zhang, R. (2019) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2926279 · Cited by 231
Wang, F., Xu, J., & Cui, S. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.2964765 · Cited by 210
Vatalaro, F., Corazza, G. E., Caini, C., & Ferrarelli, C. (1995) · IEEE Journal on Selected Areas in Communications · doi:10.1109/49.345873 · Cited by 204
Risk-Sensitive Reinforcement Learning Applied to Control under Constraints
Geibel, P., & Wysotzki, F. (2005) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1666 · Cited by 200
Risk-sensitive reinforcement learning applied to control under constraints
Geibel, P., & Wysotzki, F. (2005) · Cited by 199
Characterizing Urban Vehicle-to-Vehicle Communications for Reliable Safety Applications
Lyu, F., Zhu, H., Cheng, N., Zhou, H., Xu, W., Li, M., & Shen, X. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2920813 · Cited by 180
Self-citationDynamic Spectrum Access in Multi-Channel Cognitive Radio Networks
Zhang, N., Liang, H., Cheng, N., Tang, Y., Mark, J. W., & Shen, X. (2014) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2014.141109 · Cited by 129
Self-citationAir-Ground Integrated Vehicular Network Slicing With Content Pushing and Caching
Zhang, S., Quan, W., Li, J., Shi, W., Yang, P., & Shen, X. (2018) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2018.2864425 · Cited by 125
Self-citationOnline Orchestration of Cross-Edge Service Function Chaining for Cost-Efficient Edge Computing
Zhou, Z., Wu, Q., & Chen, X. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2927070 · Cited by 119
Edge Coordinated Query Configuration for Low-Latency and Accurate Video Analytics
Yang, P., Lyu, F., Wu, W. R., Zhang, N., Yu, L., & Shen, X. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2949347 · Cited by 104
Self-citationSAGECELL: Software-Defined Space-Air-Ground Integrated Moving Cells
Zhou, Z., Feng, J., Zhang, C., Chang, Z., Zhang, Y., & Huq, K. M. S. (2018) · IEEE Communications Magazine · doi:10.1109/mcom.2018.1701008 · Cited by 99
Reinforcement Learning-Based Downlink Interference Control for Ultra-Dense Small Cells
Xiao, L., Zhang, H., Xiao, Y., Wan, X., Liu, S., Wang, L., & Poor, H. V. (2019) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2945951 · Cited by 98
Investigation on the UAV-To-Satellite Optical Communication Systems
Li, M., Hong, Y., Zeng, C., Song, Y., & Zhang, X. (2018) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2018.2864419 · Cited by 94
Delay-Aware IoT Task Scheduling in Space-Air-Ground Integrated Network
Zhou, C., Wu, W. R., He, H., Yang, P., Lyu, F., Cheng, N., & Shen, X. (2019) · Globecom · doi:10.1109/globecom38437.2019.9013393 · Cited by 76
Self-citationSecure Communications in Tiered 5G Wireless Networks With Cooperative Jamming
Huo, Y., Fan, X., Ma, L., et al. (2019) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2912611 · Cited by 70
Edge-Aided Computing and Transmission Scheduling for LTE-U-Enabled IoT
He, H., Shan, H., Huang, A., Ye, Q. J., & Zhuang, W. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3017207 · Cited by 49
Self-citationSmall Satellite Market Observations
Buchen, E. (2015) · Digital Commons - USU (Utah State University) · Cited by 44
Cited by
Semantic Communications for Future Internet: Fundamentals, Applications, and Challenges
Yang, W., Du, H., Liew, Z. Q., Lim, W. Y. B., Xiong, Z., Niyato, D., Chi, X., Shen, X., & Miao, C. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3223224 · Cited by 670
Self-citationEvolution of Non-Terrestrial Networks From 5G to 6G: A Survey
Azari, M. M., Solanki, S., Chatzinotas, S., Kodheli, O., Sallouha, H., Colpaert, A., Mendoza Montoya, J. F., Pollin, S., Haqiqatnejad, A., Mostaani, A., et al. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3199901 · Cited by 668
Xu, M., Ng, W. C., Lim, W. Y. B., Kang, J., Xiong, Z., Niyato, D., Yang, Q., Shen, X., & Miao, C. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3221119 · Cited by 564
Self-citationAI-Native Network Slicing for 6G Networks
Wu, W., Zhou, C., Li, M., Wu, H., Zhou, H., Zhang, N., Shen, X. S., & Zhuang, W. (2022) · IEEE Wireless Communications · doi:10.1109/mwc.001.2100338 · Cited by 392
Self-citationHolistic Network Virtualization and Pervasive Network Intelligence for 6G
Shen, X., Gao, J., Wu, W., Li, M., Zhou, C., & Zhuang, W. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3135829 · Cited by 392
Self-citation
Metadata
- Authors
- Zhou, C., Wu, W., He, H., Yang, P., Lyu, F., Cheng, N., & Shen, X.
- Venue
- IEEE Transactions on Wireless Communications
- Published
- 2021-02
- Volume
- 20
- Issue
- 2
- Pages
- 911-925
- ISSN
- 1536-1276 (ISSN-L)
- 1558-2248
- OpenAlex
- W3131309288
- Cited by
- 334
- References
- 41
- FWCI
- 22.82
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.