The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Space/Aerial-Assisted Computing Offloading for IoT Applications: A Learning-Based Approach
Abstract
Internet of Things (IoT) computing offloading is a challenging issue, especially in remote areas where common edge/cloud infrastructure is unavailable. In this paper, we present a space-air-ground integrated network (SAGIN) edge/cloud computing architecture for offloading the computation-intensive applications considering remote energy and computation constraints, where flying unmanned aerial vehicles (UAVs) provide near-user edge computing and satellites provide access to the cloud computing. First, for UAV edge servers, we propose a joint resource allocation and task scheduling approach to efficiently allocate the computing resources to virtual machines (VMs) and schedule the offloaded tasks. Second, we investigate the computing offloading problem in SAGIN and propose a learning-based approach to learn the optimal offloading policy from the dynamic SAGIN environments. Specifically, we formulate the offloading decision making as a Markov decision process where the system state considers the network dynamics. To cope with the system dynamics and complexity, we propose a deep reinforcement learning-based computing offloading approach to learn the optimal offloading policy on-the-fly, where we adopt the policy gradient method to handle the large action space and actor-critic method to accelerate the learning process. Simulation results show that the proposed edge VM allocation and task scheduling approach can achieve near-optimal performance with very low complexity and the proposed learning-based computing offloading algorithm not only converges fast but also achieves a lower total cost compared with other offloading approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 3,416
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Deterministic Policy Gradient Algorithms
Silver, D., Lever, G., Heess, N., Degris, T., Wierstra, D., & Riedmiller, M. (2014) · HAL · Cited by 3,275
Optimal LAP Altitude for Maximum Coverage
Al-Hourani, A., Kandeepan, S., & Lardner, S. (2014) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2014.2342736 · Cited by 3,161
5G: A Tutorial Overview of Standards, Trials, Challenges, Deployment, and Practice
Shafi, M., Molisch, A. F., Smith, P. J., Haustein, T., Zhu, P., De Silva, P., Tufvesson, F., Benjebbour, A., & Wunder, G. (2017) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2017.2692307 · Cited by 2,304
Joint Trajectory and Communication Design for Multi-UAV Enabled Wireless Networks
Wu, Q., Zeng, Y., & Zhang, R. (2018) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2017.2789293 · Cited by 1,978
Dynamic computation offloading for mobile-edge computing with energy harvesting devices
Mao, Y., Zhang, J., & Letaief, K. B. (2016) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2016.2611964 · Cited by 1,705
Energy-Efficient Resource Allocation for Mobile-Edge Computation Offloading
You, C., Huang, K., Chae, H., & Kim, B.-H. (2017) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2016.2633522 · Cited by 1,503
Research works printed but not linked: 4
- 2018, Study on New Radio (NR) to support non terrestrial networks
- 2017, ARM Cortex-M for Beginners
- patel, 2014, Mobile-edge computing - introductory technical white paper
- jagtap, 2017, Comparative Study of Project Loon and Facebook Aquila
Cited by
Towards 6G wireless communication networks: vision, enabling technologies, and new paradigm shifts
You, X., Wang, C.-X., Huang, J., Gao, X., Zhang, Z., Wang, M., Huang, Y., Zhang, C., Jiang, Y., Wang, J., et al. (2021) · Science China Information Sciences · doi:10.1007/s11432-020-2955-6 · Cited by 2,027
Self-citationEdge artificial intelligence for 6g: vision, enabling technologies, and applications
Letaief, K. B., Shi, Y., Lu, J., & Lu, J. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126076 · Cited by 829
“In the scenario without abundant edge and cloud computing infrastructures, SAGIN provides an ubiquitous computing platform for the multi-layer hierarchical edge learning system, where the flying UAVs serve as the proximal edge computing, and the low earth orbit satellites serve as the relays to the cloud computing [21…”
BackgroundEnabling Massive IoT Toward 6G: A Comprehensive Survey
Guo, F., Yu, F. R., Zhang, H., Li, X., Ji, H., & Leung, V. C. M. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3063686 · Cited by 701
Semantic Communications for Future Internet: Fundamentals, Applications, and Challenges
Yang, W., Du, H., Liew, Z. Q., Lim, W. Y. B., Xiong, Z., Niyato, D., Chi, X., Shen, X., & Miao, C. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3223224 · Cited by 670
Self-citationEvolution of Non-Terrestrial Networks From 5G to 6G: A Survey
Azari, M. M., Solanki, S., Chatzinotas, S., Kodheli, O., Sallouha, H., Colpaert, A., Mendoza Montoya, J. F., Pollin, S., Haqiqatnejad, A., Mostaani, A., et al. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3199901 · Cited by 668
Xu, W., Yang, Z., Ng, D. W. K., Levorato, M., Eldar, Y. C., & Debbah, M. (2023) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2023.3239189 · Cited by 660
Xu, Y., Gui, G., Gacanin, H., & Adachi, F. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3059896 · Cited by 648
Xu, M., Ng, W. C., Lim, W. Y. B., Kang, J., Xiong, Z., Niyato, D., Yang, Q., Shen, X., & Miao, C. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3221119 · Cited by 564
Self-citationEdge Computing with Artificial Intelligence: A Machine Learning Perspective
Hua, H., Li, Y., Wang, T., Dong, N., Li, W., & Cao, J. (2023) · ACM Computing Surveys · doi:10.1145/3555802 · Cited by 563
A Survey on Green 6G Network: Architecture and Technologies
Huang, T., Yang, W., Wu, J., Ma, J., Zhang, X., & Zhang, D. (2019) · IEEE Access · doi:10.1109/access.2019.2957648 · Cited by 562
Energy-Efficient UAV-Assisted Mobile Edge Computing: Resource Allocation and Trajectory Optimization
Li, M., Cheng, N., Gao, J., Wang, Y., Zhao, L., & Shen, X. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.2968343 · Cited by 508
Self-citationIntegrated Satellite-Terrestrial Networks Toward 6G: Architectures, Applications, and Challenges
Zhu, X., & Jiang, C. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3126825 · Cited by 453
UAV assistance paradigm: State-of-the-art in applications and challenges
Alzahrani, B., Oubbati, O. S., Barnawi, A., Atiquzzaman, M., & Alghazzawi, D. (2020) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2020.102706 · Cited by 437
A Survey of Recent Advances in Edge-Computing-Powered Artificial Intelligence of Things
Chang, Z., Liu, S., Xiong, X., Cai, Z., & Tu, G. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3088875 · Cited by 418
Perception Task Offloading With Collaborative Computation for Autonomous Driving
Xiao, Z., Shu, J., Jiang, H., Min, G., Chen, H., & Han, Z. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3227027 · Cited by 394
Holistic Network Virtualization and Pervasive Network Intelligence for 6G
Shen, X., Gao, J., Wu, W., Li, M., Zhou, C., & Zhuang, W. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3135829 · Cited by 392
Self-citationAI-Assisted Network-Slicing Based Next-Generation Wireless Networks
Shen, X., Gao, J., Wu, W., Lyu, K., Li, M., Zhuang, W., Li, X., & Rao, J. (2020) · IEEE Open Journal of Vehicular Technology · doi:10.1109/ojvt.2020.2965100 · Cited by 342
Self-citationFlight Delay Prediction Based on Aviation Big Data and Machine Learning
Gui, G., Liu, F., Sun, J., Yang, J., Zhou, Z., & Zhao, D. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2954094 · Cited by 337
Deep Reinforcement Learning for Delay-Oriented IoT Task Scheduling in SAGIN
Zhou, C., Wu, W., He, H., Yang, P., Lyu, F., Cheng, N., & Shen, X. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3029143 · Cited by 334
Self-citationDing, R., Gao, F., & Shen, X. S. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3016024 · Cited by 331
Self-citationChai, F., Zhang, Q., Yao, H., Xin, X., Gao, R., & Guizani, M. (2023) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2023.3238771 · Cited by 331
Path Planning for UAV-Mounted Mobile Edge Computing With Deep Reinforcement Learning
Liu, Q., Shi, L., Sun, L., Li, J., Ding, M., & Shu, F. S. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.2982508 · Cited by 323
Aerospace Integrated Networks Innovation for Empowering 6G: A Survey and Future Challenges
Zhou, D., Sheng, M., Li, J., & Han, Z. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3245614 · Cited by 309
AI for UAV-Assisted IoT Applications: A Comprehensive Review
Cheng, N., Wu, S., Wang, X., Yin, Z., Li, C., Chen, W., & Chen, F. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3268316 · Cited by 307
A survey on computation offloading modeling for edge computing
Lin, H., Zeadally, S., Chen, Z., Labiod, H., & Wang, L. (2020) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2020.102781 · Cited by 305
SDN/NFV-Empowered Future IoV With Enhanced Communication, Computing, and Caching
Zhuang, W., Ye, Q., Lyu, F., Cheng, N., & Ren, J. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2951169 · Cited by 301
Self-citationAI Models for Green Communications Towards 6G
Mao, B., Tang, F., Kawamoto, Y., & Kato, N. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3130901 · Cited by 300
Deep Reinforcement Learning for Autonomous Internet of Things: Model, Applications and Challenges
Lei, L., Tan, Y., Zheng, K., Liu, S., Zhang, K., & Shen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2988367 · Cited by 298
Self-citationToward Autonomous Multi-UAV Wireless Network: A Survey of Reinforcement Learning-Based Approaches
Bai, Y., Zhao, H., Zhang, X., Chang, Z., Jäntti, R., & Yang, K. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3323344 · Cited by 295
Completion Time and Energy Optimization in the UAV-Enabled Mobile-Edge Computing System
Zhan, C., Hu, H., Sui, X., Liu, Z., & Niyato, D. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2993260 · Cited by 283
Satellite-Terrestrial Integrated Edge Computing Networks: Architecture, Challenges, and Open Issues
Xie, R., Tang, Q., Wang, Q., Liu, X., Yu, F. R., & Huang, T. (2020) · IEEE Network · doi:10.1109/mnet.011.1900369 · Cited by 279
Du, J., Yu, F. R., Lu, G., Wang, J., Jiang, J., & Chu, X. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3003449 · Cited by 278
Jia, Z., Sheng, M., Li, J., Niyato, D., & Han, Z. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3021255 · Cited by 271
Physical-Layer Security in Space Information Networks: A Survey
Li, B., Fei, Z., Zhou, C., & Zhang, Y. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2943900 · Cited by 267
Self-citationA Gentle Introduction to Reinforcement Learning and its Application in Different Fields
Naeem, M., Rizvi, S. T. H., & Coronato, A. (2020) · IEEE Access · doi:10.1109/access.2020.3038605 · Cited by 257
M., P., Bourouis, S., Ahmed, A. N., M., V., K.G.S., V., Alhakami, W., & Hamdi, M. (2022) · Computer Communications · doi:10.1016/j.comcom.2022.05.014 · Cited by 108
Task Offloading With Multi-Tier Computing Resources in Next Generation Wireless Networks
Wang, K., Jin, J., Yang, Y., Zhang, T., Nallanathan, A., Tellambura, C., & Jabbari, B. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3227102 · Cited by 95
Secure and Personalized Edge Computing Services in 6G Heterogeneous Vehicular Networks
Hui, Y., Cheng, N., Su, Z., Huang, Y., Zhao, P., Luan, T. H., & Li, C. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3065970 · Cited by 76
Directed Search: A New Operator in NSGA-II for Task Scheduling in IoT Based on Cloud-Fog Computing
Mousavi, S., Mood, S. E., Souri, A., & Javidi, M. M. (2023) · IEEE Transactions on Cloud Computing · doi:10.1109/tcc.2022.3188926 · Cited by 51
“As mentioned in the previous section, FC cannot handle the computation-intensive applications [10].”
Background
Metadata
- Authors
- Cheng, X., Lyu, F., Quan, W., Zhou, C., He, H., Shi, W., & Shen, X.
- Venue
- IEEE Journal on Selected Areas in Communications
- Published
- 2019-05
- Volume
- 37
- Issue
- 5
- Pages
- 1117-1129
- ISSN
- 0733-8716 (ISSN-L)
- 1558-0008
- OpenAlex
- W2924948991
- Cited by
- 867
- References
- 35
- FWCI
- 59.62
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Funders
- National Natural Science Foundation of China (91638204)
- Natural Sciences and Engineering Research Council of Canada
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.