The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Reinforcement learning-based multi-agent system for network traffic signal control
Abstract
A challenging application of artificial intelligence systems involves the scheduling of traffic signals in multi-intersection vehicular networks. This paper introduces a novel use of a multi-agent system and reinforcement learning (RL) framework to obtain an efficient traffic signal control policy. The latter is aimed at minimising the average delay, congestion and likelihood of intersection cross-blocking. A five-intersection traffic network has been studied in which each intersection is governed by an autonomous intelligent agent. Two types of agents, a central agent and an outbound agent, were employed. The outbound agents schedule traffic signals by following the longest-queue-first (LQF) algorithm, which has been proved to guarantee stability and fairness, and collaborate with the central agent by providing it local traffic statistics. The central agent learns a value function driven by its local and neighbours' traffic conditions. The novel methodology proposed here utilises the Q-Learning algorithm with a feedforward neural network for value function approximation. Experimental results clearly demonstrate the advantages of multi-agent RL-based control over LQF governed isolated single-intersection control, thus paving the way for efficient distributed traffic signal control in complex settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural Networks: A Comprehensive Foundation
Haykin, S. (1998) · Cited by 30,070
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
Watkins, C. (1989) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.17863/cam.132164 · Cited by 5,297
A theory of cerebellar function
Albus, J. S. (1971) · Mathematical Biosciences · doi:10.1016/0025-5564(71)90051-4 · Cited by 2,539
Review of road traffic control strategies
Papageorgiou, M., Kiakaki, C., Dinopoulou, V., Kotsialos, A., & Wang, Y. (2003) · Proceedings of the IEEE · doi:10.1109/jproc.2003.819610 · Cited by 1,251
(2008) · Intelligent Infrastructure · doi:10.1201/9781482281767-9 · Cited by 665
Reinforcement Learning for True Adaptive Traffic Signal Control
Abdulhai, B., Pringle, R., & Karakoulas, G. J. (2003) · Journal of Transportation Engineering · doi:10.1061/(asce)0733-947x(2003)129:3(278 · Cited by 548
A multivariable regulator approach to traffic-responsive network-wide signal control
Diakaki, C., Papageorgiou, M., & Aboudolas, K. (2002) · Control Engineering Practice · doi:10.1016/s0967-0661(01)00121-6 · Cited by 438
Self-organizing Traffic Lights
cgershen@vub.ac.be, E. M. A., & Gershenson, C. (2005) · Complex Systems · doi:10.25088/complexsystems.16.1.29 · Cited by 268
Adaptive traffic signal control using approximate dynamic programming
Cai, C., Wong, C. K., & Heydecker, B. G. (2009) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2009.04.005 · Cited by 228
Self-Organizing Traffic LightsPreprint
Gershenson, C. (2004) · arXiv (Cornell University) · doi:10.48550/arxiv.nlin/0411066 · Cited by 130
A Collaborative Reinforcement Learning Approach to Urban Traffic Control Optimization
Salkham, A., Cunningham, R., Garg, A., & Cahill, V. (2008) · IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT) · doi:10.1109/wiiat.2008.88 · Cited by 109
Reinforcement Learning for the True Adaptive Traffic Signal Control
Abdulhai, B., Pringle, R., & Karakoulas, G. J. (2003) · Cited by 62
Papageorfiou, M., Ben-Akiva, M. E., Bottom, J., Bovy, P. H. L., Hoogendoom, S. P., Hounsell, N. B., Kotsialos, A., & McDonald, M. (2007) · Elsevier eBooks · Cited by 36
Cited by
Big Data Analytics in Intelligent Transportation Systems: A Survey
Zhu, L., Yu, F. R., Wang, Y., Ning, B., & Tang, T. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2018.2815678 · Cited by 1,075
Deep Reinforcement Learning for Intelligent Transportation Systems: A Survey
Haydari, A., & Yilmaz, Y. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3008612 · Cited by 690
IntelliLight: A Reinforcement Learning Approach for Intelligent Traffic Light Control
Wei, H., Zheng, G., Yao, H., & Li, Z. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3220096 · Cited by 684
A Deep Reinforcement Learning Network for Traffic Light Cycle Control
Liang, X., Du, X., Wang, G., & Han, Z. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2890726 · Cited by 604
A review of cooperative multi-agent deep reinforcement learning
Oroojlooy, A., & Hajinezhad, D. (2023) · Applied Intelligence · doi:10.1007/s10489-022-04105-y · Cited by 482
Metadata
- Authors
- Arel, I., Liu, C., Urbanik, T., & Kohls, A. G.
- Venue
- IET Intelligent Transport Systems
- Published
- 2010-06-04
- Volume
- 4
- Issue
- 2
- Pages
- 128-135
- ISSN
- 1751-956X (ISSN-L)
- 1751-9578
- OpenAlex
- W2074500080
- Cited by
- 592
- References
- 16
- FWCI
- 18.59
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.