CoChat

Meta-Reinforcement Learning Based Resource Allocation for Dynamic V2X Communications

Open access
Yuan, Yi, Zheng, Gan, Wong, Kai-Kit, Letaief, Khaled B. · 2021 · IEEE Transactions on Vehicular Technology
Cited by 133

The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.

Abstract

This paper studies the allocation of shared resources between vehicle-to-infrastructure (V2I) and vehicle-to-vehicle (V2V) links in vehicle-to-everything (V2X) communications. In existing algorithms, dynamic vehicular environments and quantization of continuous power become the bottlenecks for providing an effective and timely resource allocation policy. In this paper, we develop two algorithms to deal with these difficulties. First, we propose a deep reinforcement learning (DRL)-based resource allocation algorithm to improve the performance of both V2I and V2V links. Specifically, the algorithm uses deep Q-network (DQN) to solve the sub-band assignment and deep deterministic policy-gradient (DDPG) to solve the continuous power allocation problem. Second, we propose a meta-based DRL algorithm to enhance the fast adaptability of the resource allocation policy in the dynamic environment. Numerical results demonstrate that the proposed DRL-based algorithm can significantly improve the performance compared to the DQN-based algorithm that quantizes continuous power. In addition, the proposed meta-based DRL algorithm can achieve the required fast adaptation in the new environment with limited experiences.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/tvt.2021.3098854

Cites

9 of 9 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 9 references

Research works printed but not linked: 28

  1. puterman, 2014, Markov Decision Processes Discrete Stochastic Dynamic Programming
  2. 10.1038/nature14236 · DOI · Paper page
  3. 2016, Technical specification group radio access network Study on LTE-based V2X services
  4. 10.1109/MVT.2017.2752798 · DOI · Paper page
  5. silver, 0, Deterministic policy gradient algorithms, Proc Int Conf Int Conf Mach Learn, 387
  6. 10.1109/COMST.2019.2904897 · DOI · Paper page
  7. 10.1109/TCOMM.2019.2924010 · DOI · Paper page
  8. mohri, 2012, Foundations of Machine Learning
  9. sutton, 2018, Reinforcement Learning An Introduction
  10. 10.1109/COMST.2019.2916583 · DOI · Paper page
  11. 10.1109/JPROC.2019.2947490 · DOI · Paper page
  12. 10.1109/JPROC.2019.2957798 · DOI · Paper page
  13. 10.1109/TVT.2017.2760281 · DOI · Paper page
  14. 10.1109/TITS.2018.2832219 · DOI
  15. 10.1109/TSP.2020.3043879 · DOI
  16. 10.1109/TVT.2015.2479248 · DOI · Paper page
  17. 10.1109/TVT.2015.2487365 · DOI · Paper page
  18. 10.1109/TCOMM.2017.2699194 · DOI · Paper page
  19. 2018, Technical specification group services and system aspects Study on enhancement of 3GPP support for 5G V2X services
  20. 10.1109/TWC.2015.2509978 · DOI · Paper page
  21. 10.1109/TWC.2018.2816942 · DOI · Paper page
  22. 10.1109/TWC.2018.2827958 · DOI · Paper page
  23. 10.1109/JIOT.2014.2327587 · DOI · Paper page
  24. 10.1109/LCOMM.2018.2828407 · DOI · Paper page
  25. 10.1109/COMST.2018.2888904 · DOI · Paper page
  26. zhang, 1987, Artificial intelligence inspired transmission scheduling in cognitive vehicular communications and networks, IEEE Internet of Things Journal, 6
  27. 10.1109/TVT.2019.2897134 · DOI · Paper page
  28. 10.1109/JIOT.2020.2982699 · DOI

Cited by

See all 133

Metadata

Authors
Yuan, Y., Zheng, G., Wong, K.-K., & Letaief, K. B.
Venue
IEEE Transactions on Vehicular Technology
Published
2021-09
Volume
70
Issue
9
Pages
8964-8977
ISSN
  • 0018-9545 (ISSN-L)
  • 1939-9359
OpenAlex
W3185834621
Cited by
133
References
9
FWCI
5.69
Type
journal article
Language
en
Open access
green
Funders
  • Engineering and Physical Sciences Research Council (EP/N007840/1, EP/T015985/1)
  • Leverhulme Trust Research (RPG-2017-129)
  • Hong Kong Research Grant Council (16220719)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Meta-Reinforcement Learning Based Resource Allocation for Dynamic V2X Communications. https://app.cochat.ai/papers/10.1109/tvt.2021.3098854
The paper
Yuan, Y., Zheng, G., Wong, K.-K., & Letaief, K. B. (2021). Meta-Reinforcement Learning Based Resource Allocation for Dynamic V2X Communications. IEEE Transactions on Vehicular Technology. https://doi.org/10.1109/tvt.2021.3098854

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.