Meta-Reinforcement Learning Based Resource Allocation for Dynamic V2X Communications
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
This paper studies the allocation of shared resources between vehicle-to-infrastructure (V2I) and vehicle-to-vehicle (V2V) links in vehicle-to-everything (V2X) communications. In existing algorithms, dynamic vehicular environments and quantization of continuous power become the bottlenecks for providing an effective and timely resource allocation policy. In this paper, we develop two algorithms to deal with these difficulties. First, we propose a deep reinforcement learning (DRL)-based resource allocation algorithm to improve the performance of both V2I and V2V links. Specifically, the algorithm uses deep Q-network (DQN) to solve the sub-band assignment and deep deterministic policy-gradient (DDPG) to solve the continuous power allocation problem. Second, we propose a meta-based DRL algorithm to enhance the fast adaptability of the resource allocation policy in the dynamic environment. Numerical results demonstrate that the proposed DRL-based algorithm can significantly improve the performance compared to the DQN-based algorithm that quantizes continuous power. In addition, the proposed meta-based DRL algorithm can achieve the required fast adaptation in the new environment with limited experiences.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512 · cited 8×
“Based on the MAML algorithm on training the parameters initialization, we employ a two-level training mechanism to design the meta reinforcement learning algorithm: one is called individual-level update and the other is called global-level update.”
BackgroundMethodInfluentialDeep Reinforcement Learning: An Overview
Li, Y. (2017) · arXiv · doi:10.48550/arxiv.1701.07274 · Cited by 762 · cited 1×
“By combining RL with DNN, deep RL (DRL) is designed in [14], which extends RL to deal with the large”
MethodWireless Networks Design in the Era of Deep Learning: Model-Based, AI-Based, or Both?
Zappone, A., Di Renzo, M., & Debbah, M. (2019) · arXiv · doi:10.48550/arxiv.1902.02647 · Cited by 685
Spectrum Sharing in Vehicular Networks Based on Multi-Agent Reinforcement Learning
Liang, L., Ye, H., & Li, G. Y. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2933962 · Cited by 559
Zhang, X., Peng, M., Yan, S., & Sun, Y. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2962715 · Cited by 282 · cited 3×
“In order to enhance the reliability of safety-critical messages delivery in V2V links, a two-timescale federated DRL-based semi-decentralized algorithm was proposed to optimize the selection of transmission mode and resources in V2X communications [23].”
BackgroundMethodTransfer Learning and Meta Learning-Based Fast Downlink Beamforming Adaptation
Yuan, Y., Zheng, G., Wong, K.-K., Ottersten, B., & Luo, Z.-Q. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3035843 · Cited by 133 · cited 1×
“The ability of meta-learning in solving mismatch issues has been proven in computer vision [26] and wireless communications [27], [28].”
BackgroundSelf-citationApplications of Deep Reinforcement Learning in Communications and Networking: A Survey
Luong, N. C., Hoang, D. T., Gong, S., Niyato, D., Wang, P., Liang, Y.-C., & Kim, D. I. (2018) · arXiv · doi:10.48550/arxiv.1810.07862 · Cited by 17
Research works printed but not linked: 28
- puterman, 2014, Markov Decision Processes Discrete Stochastic Dynamic Programming
- 10.1038/nature14236 · DOI · Paper page
- 2016, Technical specification group radio access network Study on LTE-based V2X services
- 10.1109/MVT.2017.2752798 · DOI · Paper page
- silver, 0, Deterministic policy gradient algorithms, Proc Int Conf Int Conf Mach Learn, 387
- 10.1109/COMST.2019.2904897 · DOI · Paper page
- 10.1109/TCOMM.2019.2924010 · DOI · Paper page
- mohri, 2012, Foundations of Machine Learning
- sutton, 2018, Reinforcement Learning An Introduction
- 10.1109/COMST.2019.2916583 · DOI · Paper page
- 10.1109/JPROC.2019.2947490 · DOI · Paper page
- 10.1109/JPROC.2019.2957798 · DOI · Paper page
- 10.1109/TVT.2017.2760281 · DOI · Paper page
- 10.1109/TITS.2018.2832219 · DOI
- 10.1109/TSP.2020.3043879 · DOI
- 10.1109/TVT.2015.2479248 · DOI · Paper page
- 10.1109/TVT.2015.2487365 · DOI · Paper page
- 10.1109/TCOMM.2017.2699194 · DOI · Paper page
- 2018, Technical specification group services and system aspects Study on enhancement of 3GPP support for 5G V2X services
- 10.1109/TWC.2015.2509978 · DOI · Paper page
- 10.1109/TWC.2018.2816942 · DOI · Paper page
- 10.1109/TWC.2018.2827958 · DOI · Paper page
- 10.1109/JIOT.2014.2327587 · DOI · Paper page
- 10.1109/LCOMM.2018.2828407 · DOI · Paper page
- 10.1109/COMST.2018.2888904 · DOI · Paper page
- zhang, 1987, Artificial intelligence inspired transmission scheduling in cognitive vehicular communications and networks, IEEE Internet of Things Journal, 6
- 10.1109/TVT.2019.2897134 · DOI · Paper page
- 10.1109/JIOT.2020.2982699 · DOI
Cited by
Resource Allocation in V2X Networks: From Classical Optimization to Machine Learning-Based Solutions
Parvini, M., Schulz, P., & Fettweis, G. (2024) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2024.3380509 · Cited by 27
“In [22], the authors propose a RL based subchannel assignment and power control algorithm aiming at maximizing the data rate of V2I links while satisfying the latency requirement of V2V links.”
BackgroundExplainable AI-Aided Feature Selection and Model Reduction for DRL-Based V2X Resource Allocation
Khan, N., Abdallah, A., Celik, A., Eltawil, A. M., & Coleri, S. (2025) · IEEE Transactions on Communications · doi:10.1109/tcomm.2025.3554655 · Cited by 20
Joint Resource Allocation for V2X Sensing and Communication Based on MADDPG
Zhong, Z., & Peng, Z. (2025) · IEEE Access · doi:10.1109/access.2025.3527049 · Cited by 11
Metadata
- Authors
- Yuan, Y., Zheng, G., Wong, K.-K., & Letaief, K. B.
- Venue
- IEEE Transactions on Vehicular Technology
- Published
- 2021-09
- Volume
- 70
- Issue
- 9
- Pages
- 8964-8977
- ISSN
- 0018-9545 (ISSN-L)
- 1939-9359
- OpenAlex
- W3185834621
- Cited by
- 133
- References
- 9
- FWCI
- 5.69
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- Engineering and Physical Sciences Research Council (EP/N007840/1, EP/T015985/1)
- Leverhulme Trust Research (RPG-2017-129)
- Hong Kong Research Grant Council (16220719)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Meta-Reinforcement Learning Based Resource Allocation for Dynamic V2X Communications. https://app.cochat.ai/papers/10.1109/tvt.2021.3098854
- The paper
- Yuan, Y., Zheng, G., Wong, K.-K., & Letaief, K. B. (2021). Meta-Reinforcement Learning Based Resource Allocation for Dynamic V2X Communications. IEEE Transactions on Vehicular Technology. https://doi.org/10.1109/tvt.2021.3098854
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.