Deep Reinforcement Learning for Dynamic Uplink/Downlink Resource Allocation in High Mobility 5G HetNet
The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Recently, the 5G is widely deployed for supporting communications of high mobility nodes including train, vehicular and unmanned aerial vehicles (UAVs) largely emerged as the main components for constructing the wireless heterogeneous network (HetNet). To further improve the radio utilization, the Time Division Duplex (TDD) is considered to be the potential full-duplex communication technology in the high mobility 5G network. However, the high mobility of users leads to the high dynamic network traffic and unpredicted link state change. A new method to predict the dynamic traffic and channel condition and schedule the TDD configuration in real-time is essential for the high mobility environment. In this paper, we investigate the channel model in the high mobility and heterogeneous network and proposed a novel deep reinforcement learning based intelligent TDD configuration algorithm to dynamically allocate radio resources in an online manner. In the proposal, the deep neural network is employed to extract the features of the complex network information, and the dynamic Q-value iteration based reinforcement learning with experience replay memory mechanism is proposed to adaptively change TDD Up/Down-link ratio by evaluated rewards. The simulation results show that the proposal achieves significant network performance improvement in terms of both network throughput and packet loss rate, comparing with conventional TDD resource allocation algorithms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fadlullah, Z. M., Tang, F., Mao, B., Kato, N., Akashi, O., Inoue, T., & Mizutani, K. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2707140 · Cited by 810 · cited 1×
“In recent years, machine learning is widely used for solving high dynamic and complexity problems in various networks [27], [28].”
BackgroundSelf-citationFuture Intelligent and Secure Vehicular Network Toward 6G: Machine-Learning Approaches
Tang, F., Kawamoto, Y., Kato, N., & Liu, J. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2954595 · Cited by 620 · cited 2×
“The reinforcement learning (RL) is one kind of machine learning that imitates human behaviors, which trains the agents (human) to do actions based on the cumulative reward (reflection from environment) of previous actions (temptations) [16].”
BackgroundSelf-citationDeep Learning for an Effective Nonorthogonal Multiple Access Scheme
Gui, G., Huang, H., Song, Y., & Sari, H. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2848294 · Cited by 505
Tang, F., Mao, B., Fadlullah, Z. M., Kato, N., Akashi, O., Inoue, T., & Mizutani, K. (2018) · IEEE Wireless Communications · doi:10.1109/mwc.2017.1700244 · Cited by 247
Self-citationOn a Novel Deep-Learning-Based Intelligent Partially Overlapping Channel Assignment in SDN-IoT
Tang, F., Mao, B., Fadlullah, Z. M., & Kato, N. (2018) · IEEE Communications Magazine · doi:10.1109/mcom.2018.1701227 · Cited by 123
Self-citation
Research works printed but not linked: 29
- 10.1109/18.782125 · doi:10.1109/18.782125
- 10.1109/VETECS.2011.5956777 · doi:10.1109/vetecs.2011.5956777
- 10.1109/LWC.2019.2962409 · DOI · Paper page
- 10.1109/MWC.2019.1900027 · DOI · Paper page
- foerster, 2017, Stabilising experience replay for deep multi-agent reinforcement learning, Proc 34th Int Conf Mach Learn, 70, 1146
- 10.1109/ICUMT.2012.6459791 · doi:10.1109/icumt.2012.6459791
- 10.1109/TVT.2016.2539285 · DOI
- 10.1109/TVT.2016.2519520 · doi:10.1109/tvt.2016.2519520
- 10.1109/MWC.2016.1600317WC · DOI · Paper page
- 10.1109/TC.2017.2709742 · DOI · Paper page
- 10.1109/JSAC.2019.2933891 · DOI · Paper page
- 10.1109/JSAC.2019.2933886 · DOI
- 10.1109/JSAC.2009.090209 · doi:10.1109/jsac.2009.090209
- 10.1109/53.665 · DOI · Paper page
- 10.1109/TWC.2018.2790912 · DOI
- 10.1109/MNET.2018.1800085 · DOI
- 10.1109/TVT.2019.2949122 · DOI · Paper page
- 10.1109/MCOM.2012.6353682 · doi:10.1109/mcom.2012.6353682
- 2019, Study on LTE Support for V2X Services
- 10.1109/TWC.2009.080528 · doi:10.1109/twc.2009.080528
- 10.1109/ICCW.2014.6881267 · doi:10.1109/iccw.2014.6881267
- 10.1109/MWC.2016.7422408 · DOI · Paper page
- 10.1109/MWC.2013.6472200 · doi:10.1109/mwc.2013.6472200
- 10.1109/ICCW.2014.6881313 · DOI
- 10.1109/TVT.2018.2854287 · doi:10.1109/tvt.2018.2854287
- 10.1109/VTCSpring.2015.7145850 · doi:10.1109/vtcspring.2015.7145850
- 10.1109/ICCNC.2016.7440591 · DOI
- 10.1109/JIOT.2018.2838574 · DOI · Paper page
- 10.1109/TVT.2017.2753280 · DOI · Paper page
Cited by
A Survey of Recent Advances in Edge-Computing-Powered Artificial Intelligence of Things
Chang, Z., Liu, S., Xiong, X., Cai, Z., & Tu, G. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3088875 · Cited by 418
Agarwal, B., Togou, M. A., Ruffini, M., & Muntean, G.-M. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3207967 · Cited by 123
“In high mobility 5G HetNet, the authors of [120] investigated using DRL to adaptively assign TDD UL/DL resources.”
MethodOn Model Transmission Strategies in Federated Learning With Lossy Communications
Su, X., Zhou, Y., Cui, L., & Liu, J. (2023) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2023.3240883 · Cited by 47
Self-citationCui, K., Song, J., Zhang, L., Tao, Y., Liu, W., & Shi, D. (2023) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2022.3231239 · Cited by 34
Multi-agent deep reinforcement learning based resource management in heterogeneous V2X networks
Zhao, J., Hu, F., Li, J., & Nie, Y. (2025) · Digital Communications and Networks · doi:10.1016/j.dcan.2023.06.003 · Cited by 21
Metadata
- Authors
- Tang, F., Zhou, Y., & Kato, N.
- Venue
- IEEE Journal on Selected Areas in Communications
- Published
- 2020-12
- Volume
- 38
- Issue
- 12
- Pages
- 2773-2782
- ISSN
- 0733-8716 (ISSN-L)
- 1558-0008
- OpenAlex
- W3038366466
- Cited by
- 214
- References
- 5
- FWCI
- 10.21
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.