The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Age of Information Aware Radio Resource Management in Vehicular Networks: A Proactive Deep Reinforcement Learning Perspective
Open accessAbstract
In this paper, we investigate the problem of age of information (AoI)-aware radio resource management for expected long-term performance optimization in a Manhattan grid vehicle-to-vehicle network. With the observation of global network state at each scheduling slot, the roadside unit (RSU) allocates the frequency bands and schedules packet transmissions for all vehicle user equipment-pairs (VUE-pairs). We model the stochastic decision-making procedure as a discrete-time single-agent Markov decision process (MDP). The technical challenges in solving the optimal control policy originate from high spatial mobility and temporally varying traffic information arrivals of the VUE-pairs. To make the problem solving tractable, we first decompose the original MDP into a series of per-VUE-pair MDPs. Then we propose a proactive algorithm based on long short-term memory and deep reinforcement learning techniques to address the partial observability and the curse of high dimensionality in local network state space faced by each VUE-pair. With the proposed algorithm, the RSU makes the optimal frequency band allocation and packet scheduling decision at each scheduling slot in a decentralized way in accordance with the partial observations of the global network state at the VUE-pairs. Numerical experiments validate the theoretical analysis and demonstrate the significant performance improvements from the proposed algorithm.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Bellman, R. (1957) · Indiana University Mathematics Journal · doi:10.1512/iumj.1957.6.56038 · Cited by 2,408
Chen, C. L. P., & Liu, Z. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2716952 · Cited by 1,957
Self-citationA generic quantitative relationship between quality of experience and quality of service
Fiedler, M., Hossfeld, T., & Tran-Gia, P. (2010) · IEEE Network · doi:10.1109/mnet.2010.5430142 · Cited by 837
Chen, X., Zhang, H., Wu, C., Mao, S., Ji, Y., & Bennis, M. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2876279 · Cited by 680
Self-citationMachine learning for vehicular networks: Recent advances and application examples
Ye, H., Liang, L., Ye Li, G., Kim, J., Lu, L., & Wu, M. (2018) · IEEE Vehicular Technology Magazine · doi:10.1109/mvt.2018.2811185 · Cited by 303
Information-centric networking for connected vehicles: a survey and future perspectives
Amadeo, M., Campolo, C., & Molinaro, A. (2016) · IEEE Communications Magazine · doi:10.1109/mcom.2016.7402268 · Cited by 264
Cited by
Rathore, M. M., Shah, S. A., Shukla, D., Bentafat, E., & Bakiras, S. (2021) · IEEE Access · doi:10.1109/access.2021.3060863 · Cited by 616
Li, X., Lu, L., Ni, W., Jamalipour, A., Zhang, D., & Du, H. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3173057 · Cited by 188
Jiang, X., Yu, F. R., Song, T., & Leung, V. C. M. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3065209 · Cited by 88
Cui, K., Song, J., Zhang, L., Tao, Y., Liu, W., & Shi, D. (2023) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2022.3231239 · Cited by 34
Metadata
- Authors
- Chen, X., Wu, C., Chen, T., Zhang, H., Liu, Z., Zhang, Y., & Bennis, M.
- Venue
- IEEE Transactions on Wireless Communications
- Published
- 2020-04
- Volume
- 19
- Issue
- 4
- Pages
- 2268-2281
- ISSN
- 1536-1276 (ISSN-L)
- 1558-2248
- OpenAlex
- W2998881388
- Cited by
- 187
- References
- 12
- FWCI
- 15.79
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.