Joint Offloading and Resource Allocation for Hybrid Cloud and Edge Computing in SAGINs: A Decision Assisted Hybrid Action Space Deep Reinforcement Learning Approach
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
In recent years, the amalgamation of satellite communications and aerial platforms into space-air-ground integrated network (SAGINs) has emerged as an indispensable area of research for future communications due to the global coverage capacity of low Earth orbit (LEO) satellites and the flexible Deployment of aerial platforms. This paper presents a deep reinforcement learning (DRL)-based approach for the joint optimization of offloading and resource allocation in hybrid cloud and multi-access edge computing (MEC) scenarios within SAGINs. The proposed system considers the presence of multiple satellites, clouds and unmanned aerial vehicles (UAVs). The multiple tasks from ground users are modeled as directed acyclic graphs (DAGs). With the goal of reducing energy consumption and latency in MEC, we propose a novel multi-agent algorithm based on DRL that optimizes both the offloading strategy and the allocation of resources in the MEC infrastructure within SAGIN. A hybrid action algorithm is utilized to address the challenge of hybrid continuous and discrete action space in the proposed problems, and a decision-assisted DRL method is adopted to reduce the impact of unavailable actions in the training process of DRL. Through extensive simulations, the results demonstrate the efficacy of the proposed learning-based scheme, the proposed approach consistently outperforms benchmark schemes, highlighting its superior performance and potential for practical applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132 · cited 1×
“Moreover, we compare the proposed algorithm DM-SAC-H with the following benchmarks: Multi-agent PPO (M-PPO) [48] (widely used DRL algorithm), Parametrized DQN [49] (a DQN & DDPG hybrid framework), and A3C [50] (a asynchronous multi-agent DRL approach).”
MethodSpace-Air-Ground Integrated Network: A Survey
Liu, J., Shi, Y., Fadlullah, Z. M., & Kato, N. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2841996 · Cited by 1,281
Collaborative Mobile Edge Computing in 5G Networks: New Paradigms, Scenarios, and Challenges
Tran, T. X., Hajisami, A., Pandey, P., & Pompili, D. (2017) · IEEE Communications Magazine · doi:10.1109/mcom.2017.1600863 · Cited by 874
Satellite-5G Integration: A Network Perspective
Giambene, G., Kota, S., & Pillai, P. (2018) · IEEE Network · doi:10.1109/mnet.2018.1800037 · Cited by 341 · cited 1×
“In addition, satellite initiatives like those from SES Networks (formerly known as O3b) and Telesat [4] are also advancing, with their objective being to offer high-speed and low-latency internet access services with global coverage.”
BackgroundMaximum a Posteriori Policy Optimisation
Abdolmaleki, A., Springenberg, J. T., Tassa, Y., Munos, R., Heess, N., & Riedmiller, M. (2018) · arXiv · doi:10.48550/arxiv.1806.06920 · Cited by 259 · cited 1×
“…of soft-Q-networks for discrete and continuous agents as (53) Moreover, we can obtain the cost functions of policy networks for discrete and continuous agents as Subsequently, we employed the maximum aposteriori policy optimisation [45] algorithm to jointly optimize the decoupled policies.”
MethodLEO Satellite Constellations for 5G and Beyond: How Will They Reshape Vertical Domains?
Liu, S., Gao, Z., Wu, Y., Kwan Ng, D. W., Gao, X., Wong, K.-K., Chatzinotas, S., & Ottersten, B. (2021) · IEEE Communications Magazine · doi:10.1109/mcom.001.2001081 · Cited by 244
Metadata
- Authors
- Huang, C., Chen, G., Xiao, P., Xiao, Y., Han, Z., & Chambers, J. A.
- Venue
- IEEE Journal on Selected Areas in Communications
- Published
- 2024-05
- Volume
- 42
- Issue
- 5
- Pages
- 1029-1043
- ISSN
- 0733-8716 (ISSN-L)
- 1558-0008
- OpenAlex
- W4391935850
- Cited by
- 161
- References
- 6
- FWCI
- 28.37
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Joint Offloading and Resource Allocation for Hybrid Cloud and Edge Computing in SAGINs: A Decision Assisted Hybrid Action Space Deep Reinforcement Learning Approach. https://app.cochat.ai/papers/10.1109/jsac.2024.3365899
- The paper
- Huang, C., Chen, G., Xiao, P., Xiao, Y., Han, Z., & Chambers, J. A. (2024). Joint Offloading and Resource Allocation for Hybrid Cloud and Edge Computing in SAGINs: A Decision Assisted Hybrid Action Space Deep Reinforcement Learning Approach. IEEE Journal on Selected Areas in Communications. https://doi.org/10.1109/jsac.2024.3365899
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.