The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
MEC-Assisted Immersive VR Video Streaming Over Terahertz Wireless Networks: A Deep Reinforcement Learning Approach
Abstract
Immersive virtual reality (VR) video is becoming increasingly popular owing to its enhanced immersive experience. To enjoy ultrahigh resolution immersive VR video with wireless user equipments, such as head-mounted displays (HMDs), ultralow-latency viewport rendering, and data transmission are the core prerequisites, which could not be achieved without a huge bandwidth and superior processing capabilities. Besides, potentially very high energy consumption at the HMD may impede the rapid development of wireless panoramic VR video. Multiaccess edge computing (MEC) has emerged as a promising technology to reduce both the task processing latency and the energy consumption for HMD, while bandwidth-rich terahertz (THz) communication is expected to enable ultrahigh-speed wireless data transmission. In this article, we propose to minimize the long-term energy consumption of a THz wireless access-based MEC system for high quality immersive VR video services support by jointly optimizing the viewport rendering offloading and downlink transmit power control. Considering the time-varying nature of wireless channel conditions, we propose a deep reinforcement learning-based approach to learn the optimal viewport rendering offloading and transmit power control policies and an asynchronous advantage actor-critic (A3C)-based joint optimization algorithm is proposed. The simulation results demonstrate that the proposed algorithm converges fast under different learning rates, and outperforms existing algorithms in terms of minimized energy consumption and maximized reward.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Reinforcement Learning: An Introduction
Johnson, J. D., Li, J., & Chen, Z. (2000) · Neurocomputing · doi:10.1016/s0925-2312(00)00324-6 · Cited by 8,414
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
A Vision of 6G Wireless Systems: Applications, Trends, Technologies, and Open Research Problems
Saad, W., Bennis, M., & Chen, M. (2020) · IEEE Network · doi:10.1109/mnet.001.1900287 · Cited by 4,985
Deep Reinforcement Learning: A Brief Survey
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2743240 · Cited by 4,733
A Brief Survey of Deep Reinforcement Learning
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · arXiv · doi:10.48550/arxiv.1708.05866 · Cited by 4,733
Jornet, J. M., & Akyildiz, I. F. (2011) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2011.081011.100545 · Cited by 1,122
Artificial Neural Networks-Based Machine Learning for Wireless Networks: A Tutorial
Chen, M., Challita, U., Saad, W., Yin, C., & Debbah, M. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2926625 · Cited by 1,117
A Survey of Actor-Critic Reinforcement Learning: Standard and Natural Policy Gradients
Grondman, I., Busoniu, L., Lopes, G. A. D., & Babuska, R. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2012.2218595 · Cited by 1,042
In-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning
Wang, X., Han, Y., Wang, C., Zhao, Q., Chen, X., & Chen, M. (2019) · IEEE Network · doi:10.1109/mnet.2019.1800286 · Cited by 1,030 · cited 2×
“(MECSs) [12], [13], and consequently offers an opportunity to tackle the last two challenges [14].”
BackgroundSpace/Aerial-Assisted Computing Offloading for IoT Applications: A Learning-Based Approach
Cheng, X., Lyu, F., Quan, W., Zhou, C., He, H., Shi, W., & Shen, X. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2906789 · Cited by 867
Vehicular Edge Computing and Networking: A Survey
Liu, L., Chen, C., Pei, Q., Maharjan, S., & Zhang, Y. (2021) · Mobile Networks and Applications · doi:10.1007/s11036-020-01624-1 · Cited by 597
Learning-Based Computation Offloading for IoT Devices With Energy Harvesting
Min, M., Xiao, L., Chen, Y., Cheng, P., Wu, D., & Zhuang, W. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2890685 · Cited by 560
Han, C., Bicen, A. O., & Akyildiz, I. F. (2015) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2014.2386335 · Cited by 489
Smart Resource Allocation for Mobile Edge Computing: A Deep Reinforcement Learning Approach
Wang, J., Zhao, L., Liu, J., & Kato, N. (2021) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2019.2902661 · Cited by 451
Self-citationAdaptive Learning-Based Task Offloading for Vehicular Edge Computing Systems
Sun, Y., Guo, X., Song, J., Zhou, S., Jiang, Z., Liu, X., & Niu, Z. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2895593 · Cited by 369
Feng, J., Richard Yu, F., Pei, Q., Chu, X., Du, J., & Zhu, L. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2961707 · Cited by 332
Self-citationDu, J., Yu, F. R., Chu, X., Feng, J., & Lu, G. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2883156 · Cited by 302
Self-citationQiu, X., Liu, L., Chen, W., Hong, Z., & Zheng, Z. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2924015 · Cited by 287
Deep Reinforcement Learning for Mobile 5G and Beyond: Fundamentals, Applications, and Challenges
Xiong, Z., Zhang, Y., Niyato, D., Deng, R., Wang, P., & Wang, L.-C. (2019) · IEEE Vehicular Technology Magazine · doi:10.1109/mvt.2019.2903655 · Cited by 285
360° Video Viewing Dataset in Head-Mounted Virtual Reality
Lo, W.-C., Fan, C.-L., Lee, J., Huang, C., Chen, K.-T., & Hsu, C.-H. (2017) · ACM Multimedia Systems Conference (MMSys) · doi:10.1145/3083187.3083219 · Cited by 222
Resource-aware secure ECG healthcare monitoring through body sensor networks
Wang, H., Peng, D., Wang, W., Sharif, H., Chen, H., & Khoynezhad, A. B. (2010) · IEEE Wireless Communications · doi:10.1109/mwc.2010.5416345 · Cited by 149
A Wireless Health Monitoring System Using Mobile Phone Accessories
Mahmud, M. S., Wang, H., Esfar-E-Alam, A. M., & Fang, H. (2017) · IEEE Internet of Things Journal · doi:10.1109/jiot.2016.2645125 · Cited by 142
Distance-Aware Bandwidth-Adaptive Resource Allocation for Wireless Systems in the Terahertz Band
Han, C. Z., & Akyildiz, I. F. (2016) · IEEE Transactions on Terahertz Science and Technology · doi:10.1109/tthz.2016.2569460 · Cited by 137
Feng, J., Yu, F. R., Pei, Q., Du, J., & Zhu, L. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.2982627 · Cited by 133
Self-citationMEC-Assisted Panoramic VR Video Streaming Over Millimeter Wave Mobile Networks
Liu, Y., Liu, J., Argyriou, A., & Ci, S. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2876044 · Cited by 114
Chen, M., Saad, W., Yin, C., & Debbah, M. A. (2019) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2900624 · Cited by 102
Enabling Low-Latency Applications in LTE-A Based Mixed Fog/Cloud Computing Systems
Du, J., Zhao, L., Chu, X., Yu, F. R., Feng, J., & Chih‐Lin, I. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2882991 · Cited by 97
Self-citationFederated Echo State Learning for Minimizing Breaks in Presence in Wireless Virtual Reality Networks
Chen, M., Semiari, O., Saad, W., Liu, X., & Yin, C. (2018) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2942929 · Cited by 95
Dynamic Embedding and Quality of Service-Driven Adjustment for Cloud Networks
Cao, H., Wu, S., Aujla, G. S., Wang, Q., Yang, L., & Zhu, H. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2936074 · Cited by 90
On the Reliability of Wireless Virtual Reality at Terahertz (THz) Frequencies
Chaccour, C., Amer, R., Zhou, B., & Saad, W. (2019) · IFIP International Conference on New Technologies, Mobility and Security (NTMS) · doi:10.1109/ntms.2019.8763780 · Cited by 65
Social overlapping community-aware neighbor discovery for D2D communications
Wang, R., Yang, H., Wang, H., & Wu, D. (2016) · IEEE Wireless Communications · doi:10.1109/mwc.2016.7553023 · Cited by 47
Liquid State Based Transfer Learning for 360° Image Transmission in Wireless VR Networks
Chen, M., Saad, W., & Yin, C. (2019) · International Conference on Communications · doi:10.1109/icc.2019.8761494 · Cited by 5
Cited by
On the Road to 6G: Visions, Requirements, Key Technologies, and Testbeds
Wang, C.-X., You, X., Gao, X., Zhu, X., Li, Z., Zhang, C., Wang, H., Huang, Y., Chen, Y., Haas, H., et al. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3249835 · Cited by 2,336
Unleashing the Power of Edge-Cloud Generative AI in Mobile Networks: A Survey of AIGC Services
Xu, M., Du, H., Niyato, D., Kang, J., Xiong, Z., Mao, S., Han, Z., Jamalipour, A., Kim, D. I., Shen, X., et al. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3353265 · Cited by 449
Bi, S., Huang, L., Wang, H., & Zhang, Y.-J. A. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3085319 · Cited by 407
Liu, L., Zhao, M., Yu, M., Jan, M. A., Lan, D., & Taherkordi, A. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3142566 · Cited by 303
Machine Learning-Powered Encrypted Network Traffic Analysis: A Comprehensive Survey
Shen, M., Ye, K., Liu, X., Zhu, L., Kang, J., Yu, S., Li, Q., & Xu, K. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3208196 · Cited by 265
Metadata
- Authors
- Du, J., Yu, F. R., Lu, G., Wang, J., Jiang, J., & Chu, X.
- Venue
- IEEE Internet of Things Journal
- Published
- 2020-10
- Volume
- 7
- Issue
- 10
- Pages
- 9517-9529
- ISSN
- 2327-4662 (ISSN-L)
- 2372-2541
- OpenAlex
- W3036749975
- Cited by
- 278
- References
- 35
- FWCI
- 21.81
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.