Distributed Cooperative Reinforcement Learning-Based Traffic Signal Control That Integrates V2X Networks’ Dynamic Clustering
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
With the acceleration of urbanization in the world, urban traffic congestion has become an urgent challenge in most cities. Adaptive traffic signal control is the most approved control method to solve the problem, and accurate real-time traffic information is critical to this solution. This paper presents distributed cooperative reinforcement learning-based traffic control that integrates V2X networks’ dynamic clustering algorithm. To obtain traffic flow information accurately and instantaneously, it is important to improve the cluster stability in V2X networks. A dynamic clustering algorithm is proposed based on the enhanced affinity propagation. The proposed clustering algorithm introduces the initial cluster partition to maintain a proper cluster size and adds the lane and destination factors to improve the cluster's stability. The algorithm can provide efficient and accurate traffic state information to traffic signal controls. By integrating the clustering algorithm, a cooperative reinforcement learning control scheme is proposed to balance the traffic load. To address the tough dimensionality curse of reinforcement learning, a distributed mechanism for intersection cooperation is introduced, and a fast gradient-descent function approximation method is proposed to improve the controls’ real-time performance. The proposed intelligent traffic control scheme that integrates the stable clustering algorithm can effectively improve the traffic throughput, reduce the average waiting time, and avoid congestion. Numerical simulations on real scenarios validate the performance of the proposed approach.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
A Comprehensive Survey of Multiagent Reinforcement Learning
Busoniu, L., Babuska, R., & De Schutter, B. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2007.913919 · Cited by 2,235 · cited 1×
“process [45] in which the game only occurs among neighboring agents.”
Background
Cited by
Future Intelligent and Secure Vehicular Network Toward 6G: Machine-Learning Approaches
Tang, F., Kawamoto, Y., Kato, N., & Liu, J. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2954595 · Cited by 620
“Another application of reinforcement learning in the vehicular networks is to predict the traffic load of different blocks and automatically offload the network traffic to balance overheads between the blocks [101].”
BackgroundA Deep Reinforcement Learning Network for Traffic Light Cycle Control
Liang, X., Du, X., Wang, G., & Han, Z. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2890726 · Cited by 604
Multi-Agent Deep Reinforcement Learning for Urban Traffic Light Control in Vehicular Networks
Wu, T., Zhou, P., Liu, K., Yuan, Y., Wang, X., Huang, H., & Wu, D. O. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.2997896 · Cited by 307
Maadi, S., Stein, S., Hong, J., & Murray-Smith, R. (2022) · Sensors · doi:10.3390/s22197501 · Cited by 50
Deep Reinforcement Learning for Traffic Signal Control Model and Adaptation Study
Tan, J., Yuan, Q., Guo, W., Xie, N., Liu, F., Wei, J., & Zhang, X. (2022) · Sensors · doi:10.3390/s22228732 · Cited by 32
“With the development of communication technology, sensor technology in urban traffic systems has been enhanced to efficiently and accurately acquire complex traffic information to improve traffic signal control strategies [2].”
Background
Metadata
- Authors
- Liu, W., Qin, G., He, Y., & Jiang, F.
- Venue
- IEEE Transactions on Vehicular Technology
- Published
- 2017-10
- Volume
- 66
- Issue
- 10
- Pages
- 8667-8681
- ISSN
- 0018-9545 (ISSN-L)
- 1939-9359
- OpenAlex
- W2613084637
- Cited by
- 127
- References
- 2
- FWCI
- 7.23
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Distributed Cooperative Reinforcement Learning-Based Traffic Signal Control That Integrates V2X Networks’ Dynamic Clustering. https://app.cochat.ai/papers/10.1109/tvt.2017.2702388
- The paper
- Liu, W., Qin, G., He, Y., & Jiang, F. (2017). Distributed Cooperative Reinforcement Learning-Based Traffic Signal Control That Integrates V2X Networks’ Dynamic Clustering. IEEE Transactions on Vehicular Technology. https://doi.org/10.1109/tvt.2017.2702388
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.