The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Deep Reinforcement Learning for Stochastic Computation Offloading in Digital Twin Networks
Open accessAbstract
The rapid development of industrial Internet of Things (IIoT) requires industrial production towards digitalization to improve network efficiency. Digital Twin is a promising technology to empower the digital transformation of IIoT by creating virtual models of physical objects. However, the provision of network efficiency in IIoT is very challenging due to resource-constrained devices, stochastic tasks, and resources heterogeneity. Distributed resources in IIoT networks can be efficiently exploited through computation offloading to reduce energy consumption while enhancing data processing efficiency. In this article, we first propose a new paradigm digital twin network to build network topology and the stochastic task arrival model in IIoT systems. Then, we formulate the stochastic computation offloading and resource allocation problem to minimize the long-term energy efficiency. As the formulated problem is a stochastic programming problem, we leverage Lyapunov optimization technique to transform the original problem into a deterministic per-time slot problem. Finally, we present asynchronous actor-critic algorithm to find the optimal stochastic computation offloading policy. Illustrative results demonstrate that our proposed scheme is able to significantly outperforms the benchmarks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
The Digital Twin Paradigm for Future NASA and U.S. Air Force Vehicles
Glaessgen, E., & Stargel, D. (2012) · 53rd AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference 20th AIAA/ASME/AHS Adaptive Structures Conference 14th AIAA · doi:10.2514/6.2012-1818 · Cited by 3,395 · cited 1×
“The concept of digital twin is first proposed in [2] and applied by NASA to comprehensive diagnosis and maintenance of flight systems.”
MethodStochastic Network Optimization with Application to Communication and Queueing Systems
Neely, M. J. (2010) · Synthesis lectures on communication networks · doi:10.2200/s00271ed1v01y201006cnt007 · Cited by 2,218
Taleb, T., Samdanis, K., Mada, B., Flinck, H., Dutta, S., & Sabella, D. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2705720 · Cited by 1,775
Mao, Y., Zhang, J., Song, S. H., & Letaief, K. B. (2017) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2017.2717986 · Cited by 690
Joint Load Balancing and Offloading in Vehicular Edge Computing and Networks
Dai, Y., Xu, D., Maharjan, S., & Zhang, Y. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2876298 · Cited by 464
Self-citationJoint Computation Offloading and User Association in Multi-Task Mobile Edge Computing
Dai, Y., Xu, D., Maharjan, S., & Zhang, Y. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2876804 · Cited by 372
Self-citationCommunication-Efficient Federated Learning for Digital Twin Edge Networks in Industrial IoT
Lu, Y., Huang, X., Zhang, K., Maharjan, S., & Zhang, Y. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.3010798 · Cited by 316
Self-citationDeep Learning Empowered Task Offloading for Mobile Edge Computing in Urban Informatics
Zhang, K., Zhu, Y., Leng, S., He, Y., Maharjan, S., & Zhang, Y. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2903191 · Cited by 309
Self-citationDai, Y., Xu, D., Zhang, K., Maharjan, S., & Zhang, Y. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.2973705 · Cited by 260
Self-citation
Cited by
Digital Twin Networks: A Survey
Wu, Y., Zhang, K., & Zhang, Y. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3079510 · Cited by 847
Self-citationXu, M., Ng, W. C., Lim, W. Y. B., Kang, J., Xiong, Z., Niyato, D., Yang, Q., Shen, X., & Miao, C. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3221119 · Cited by 564
A comprehensive review of digital twin — part 1: modeling and twinning enabling technologies
Thelen, A., Zhang, X., Fink, O., Lu, Y., Ghosh, S., Youn, B. D., Todd, M. D., Mahadevan, S., Hu, C., & Hu, Z. (2022) · Structural and Multidisciplinary Optimization · doi:10.1007/s00158-022-03425-4 · Cited by 441
Federated Learning With Non-IID Data: A Survey
Lu, Z., Pan, H., Dai, Y., Si, X., & Zhang, Y. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3376548 · Cited by 430
Self-citationHolistic Network Virtualization and Pervasive Network Intelligence for 6G
Shen, X., Gao, J., Wu, W., Li, M., Zhou, C., & Zhuang, W. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3135829 · Cited by 392
Metadata
- Authors
- Dai, Y., Zhang, K., Maharjan, S., & Zhang, Y.
- Venue
- IEEE Transactions on Industrial Informatics
- Published
- 2021-07
- Volume
- 17
- Issue
- 7
- Pages
- 4968-4977
- ISSN
- 1551-3203 (ISSN-L)
- 1941-0050
- OpenAlex
- W3049282540
- Cited by
- 296
- References
- 18
- FWCI
- 18.03
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Deep Reinforcement Learning for Stochastic Computation Offloading in Digital Twin Networks. https://app.cochat.ai/papers/10.1109/tii.2020.3016320
- The paper
- Dai, Y., Zhang, K., Maharjan, S., & Zhang, Y. (2021). Deep Reinforcement Learning for Stochastic Computation Offloading in Digital Twin Networks. IEEE Transactions on Industrial Informatics. https://doi.org/10.1109/tii.2020.3016320
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.