A Q-learning based SPS Resource Scheduling Algorithm for Reliable C-V2X Communication
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
In 5G networks, the Ultra Reliable Low Latency Communication (URLLC) scenario is studied specifically to support the Cellular-Vehicle-to-Everything (C-V2X) communication. In Mode 4 of the Third Generation Partnership Project (3GPP), the vehicles are enabled to transmit the messages in the decentralized mode without a central network controlling the radio resources by using the Semi-Persistent Scheduling (SPS) algorithm. In SPS, the channel sensing information is used for the resource reservation process by the vehicle itself in order to achieve a fast access to the vehicle network. However, the conventional SPS with a fixed reservation process would lead to a high collision probability of the packets in the case of high traffic density. Based on the study of impacts of SPS with reservation probabilities to both collision ratio and delay through simulations, a Q-learning based SPS (Q-SPS) algorithm is proposed in order to make an intelligent decision on the reservation probability with a reward feedback corresponding to the dynamic change of C-V2X network environment. The simulation results show that the update delay can be reduced by 32% while the packet reception rate is maintained at 95%, when compared with the conventional SPS algorithm in high traffic density.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“It is worthwhile to note from existing studies that the optimal RC parameter trained by RL can intelligently reduce consecutive collision probabilities in highly dynamic sidelink communication.”
From Reinforcement Learning-Based Resource Allocation Scheme of NR-V2X Sidelink for Joint Communication and Sensing (2025) · cites this paper as [35]
Citations
Cites
IEEE 802.11bd & 5G NR V2X: Evolution of Radio Access Technologies for V2X Communications
Naik, G., Choudhury, B., & Park, J.-M. (2019) · IEEE Access · doi:10.1109/access.2019.2919489 · Cited by 570
Toward Intelligent Vehicular Networks: A Machine Learning Framework
Liang, L., Ye, H., & Li, G. Y. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2872122 · Cited by 240 · cited 2×
“Each block in the radio resource grid as shown in Figure 1 is composed of one or several subchannels, which is simply called "CAM resource" [8].”
MethodMulti-Hop Connectivity Probability in Infrastructure-Based Vehicular Networks
Zhang, W., Chen, Y., Yang, Y., Wang, X., Zhang, Y., Hong, X., & Mao, G. (2012) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2012.120508 · Cited by 120 · cited 1×
“The positions of the vehicles are modelled as a homogeneous Poisson point process (PPP) with an average speed of 120km/h, which in good agreement with the real distributions [12].”
BackgroundMasini, B. M., Bazzi, A., & Zanella, A. (2018) · Sensors · doi:10.3390/s18072207 · Cited by 109
Cecchini, G., Bazzi, A., Masini, B. M., & Zanella, A. (2017) · 2017 5th IEEE International Conference on Models and Technologies for Intelligent Transportation Systems (MT-ITS) · doi:10.1109/mtits.2017.8005625 · Cited by 107 · cited 1×
“The existing SPS algorithm cannot support Ultra Reliable Low Latency Communication (URLLC) in V2X basic security applications [4].”
MethodHaider, A., & Hwang, S. (2019) · Electronics · doi:10.3390/electronics8080846 · Cited by 53 · cited 2×
“In [6] two benchmark algorithms are identified that provide a reference to evaluate other resource scheduling algorithms including SPS: Random and Ordered.”
BackgroundMethodCooperative Resource Allocation and Scheduling for 5G eV2X Services
Bonjorn, N., Foukalas, F., Canellas, F., & Pop, P. (2019) · IEEE Access · doi:10.1109/access.2018.2889190 · Cited by 48 · cited 1×
“The aforementioned use-cases require more stringent packet delivery and transmission delay guarantee [2].”
BackgroundAnalytical Investigation of Two Benchmark Resource Allocation Algorithms for LTE-V2V
Bazzi, A., Zanella, A., Cecchini, G., & Masini, B. M. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2909438 · Cited by 41 · cited 1×
“These V2X use-cases not only improve road safety but also assist in better traffic management and cater to the infotainment needs of passengers, such as advanced driving, car platooning, remote driving [1].”
BackgroundOn Latency and Reliability of Road Hazard Warnings Over the Cellular V2X Sidelink Interface
Campolo, C., Molinaro, A., Berthet, A. O., & Vinel, A. V. (2019) · IEEE Communications Letters · doi:10.1109/lcomm.2019.2931686 · Cited by 35 · cited 1×
“3GPP recommends using the sensing based Semi-Persistent Scheduling (SPS) algorithm to manage this kind of packets, which has fixed size and periodic characteristics [3].”
MethodAn explicit reservation-augmented resource allocation scheme for C-V2X sidelink mode 4
Jeon, Y., & Kim, H. (2020) · IEEE Access · doi:10.1109/access.2020.3015549 · Cited by 34 · cited 1×
“In [7], a adaptive transmission power control algorithm by using the channel sensing information of SPS to the transmission power control is proposed.”
MethodAsynchronous Traffic on the Sidelink of 5G V2X
Romeo, F., Campolo, C., Molinaro, A., & Berthet, A. O. (2020) · 2020 IEEE International Conference on Communications Workshops (ICC Workshops) · doi:10.1109/iccworkshops49005.2020.9145466 · Cited by 23 · cited 1×
“Performance results are obtained by using the LTEV2Vsim simulator [11].”
MethodDecentralized Deep Reinforcement Learning for Delay-Power Tradeoff in Vehicular Communications
Chen, X., Wu, C., Zhang, H., Zhang, Y., Bennis, M., & Vuojala, H. (2019) · International Conference on Communications · doi:10.1109/icc.2019.8761949 · Cited by 4 · cited 3×
“In [5] the performance of SPS is evaluated, and a new method is proposed to broadcast the value of resource Reselection Counter (RC) to the neighbor vehicles.”
MethodInfluential
Cited by
Multiagent Reinforcement Learning-Based Semi-Persistent Scheduling Scheme in C-V2X Mode 4
Gu, B., Chen, W., Alazab, M., Tan, X., & Guizani, M. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3189019 · Cited by 48
“Among the few works that employed RL algorithms to improve the performance of the SPS scheme, Yan et al. [29] utilized a Q-learning algorithm to adjust the resource reselection probability to increase the PRR in dense traffic scenarios.”
MethodWang, P., & Wang, S. (2023) · Tsinghua Science and Technology · doi:10.26599/tst.2021.9010099 · Cited by 32
Self-citationLi, Z., Wang, P., Shen, Y., & Li, S. (2025) · Sensors · doi:10.3390/s25020302 · Cited by 15
“Specifically, Reference [35] uses Q-learning to optimize SPS algorithm parameters, including reservation probability (RP) and reselection counter ( RC ), enhance packet reception rate (PRR) and reduce update delay (UD) in high-dynamic vehicular networks.”
Self-citationSanada, K., Hatano, H., & Mori, K. (2024) · International Conference on Communications · doi:10.1109/icc51166.2024.10622860 · Cited by 6
“Figure 1 shows the resource selection mechanism in SB-SPS [7], [8].”
BackgroundRadio Resource Selection in C-V2X Mode 4: A Multiagent Deep Reinforcement Learning Approach
Chen, W., Gu, B., Tan, X., & Wei, C. (2022) · International Conference on Computer Communications and Networks (ICCCN) · doi:10.1109/icccn54977.2022.9868865 · Cited by 5
“Among the few works that employ RL algorithms to improve the performance of the SPS scheme, Yan et al. in [15] utilized a Q-learning algorithm to adjust the resource reselection probability to increase the PRR in dense traffic scenarios.”
Method
Metadata
- Authors
- Lu, Y., Wang, P., Wang, S., & Yao, W.
- Affiliations
- Donghua University (CN)
- Venue
- 2021 5th International Conference on Digital Signal Processing
- Publisher
- ACM
- Published
- 2021-02-26
- Pages
- 201-206
- OpenAlex
- W3204510008
- Semantic Scholar
- d65ae3bd582cba546c548b586421490004f5936d
- Cited by
- 10
- References
- 12
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 1 · 2023: 1 · 2022: 4 · 2021: 1
- FWCI
- 2.75
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE International Conference on Digital Signal Processing (DSP) (publishedVersion)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Vehicular Ad Hoc Networks (VANETs)
- Physical Sciences › Engineering › Control and Systems Engineering › Traffic control and management
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Wireless Network Optimization
- Keywords
- Q-learning, semi-persistent scheduling, ultra-reliable low-latency communication, packet collision probability, distributed resource allocation, vehicular networks, 5G, packet reception rate, update delay
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.