The DOI matches its Crossref record; 128 of the 128 references it cites were found in a registry or an index.
Deep Reinforcement Learning for Intelligent Transportation Systems: A Survey
Open accessAbstract
Latest technological improvements increased the quality of transportation. New data-driven approaches bring out a new research direction for all control-based systems, e.g., in transportation, robotics, IoT and power systems. Combining data-driven applications with transportation systems plays a key role in recent transportation applications. In this paper, the latest deep reinforcement learning (RL) based traffic control applications are surveyed. Specifically, traffic signal control (TSC) applications based on (deep) RL, which have been studied extensively in the literature, are discussed in detail. Different problem formulations, RL parameters, and simulation environments for TSC are discussed comprehensively. In the literature, there are also several autonomous driving applications studied with deep RL models. Our survey extensively summarizes existing works in this field by categorizing them with respect to application types, control models and studied algorithms. In the end, we discuss the challenges and open questions regarding deep RL-based transportation applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Congested traffic states in empirical observations and microscopic simulations
Treiber, M., Hennecke, A., & Helbing, D. (2000) · Physical Review E · doi:10.1103/physreve.62.1805 · Cited by 4,762
Trust region policy optimization
Schulman, J., Levine, S., Moritz, P., Jordan, M. I., & Abbeel, P. (2015) · arXiv · doi:10.48550/arxiv.1502.05477 · Cited by 4,578
CARLA: An open urban driving simulator
Dosovitskiy, A., Ros, G., Codevilla, F., Lopez, A., & Koltun, V. (2017) · arXiv · doi:10.48550/arxiv.1711.03938 · Cited by 3,718
Addressing Function Approximation Error in Actor-Critic Methods
Fujimoto, S., van Hoof, H., & Meger, D. (2018) · arXiv · doi:10.48550/arxiv.1802.09477 · Cited by 3,650
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 3,416
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Dueling Network Architectures for Deep Reinforcement Learning
Wang, Z., Schaul, T., Hessel, M., van Hasselt, H., Lanctot, M., & de Freitas, N. (2015) · arXiv · doi:10.48550/arxiv.1511.06581 · Cited by 3,300
Deep reinforcement learning for autonomous driving: A survey
Kiran, B. R., Sobh, I., Talpaert, V., Mannion, P., Sallab, A. A. A., Yogamani, S., & Perez, P. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3054625 · Cited by 2,342
On-line Q-learning Using Connectionist Systems
Rummery, G. A. (1994) · Cited by 1,477
SUMO - Simulation of Urban MObility An Overview
Behrisch, M., Bieker, L., Erdmann, J., & Krajzewicz, D. (2011) · elib (German Aerospace Center) · Cited by 1,472
General Lane-Changing Model MOBIL for Car-Following Models
Kesting, A., Treiber, M., & Helbing, D. (2007) · Transportation Research Record: Journal of the Transportation Research Board · doi:10.3141/1999-10 · Cited by 1,345
Derivative-free optimization: a review of algorithms and comparison of software implementations
Rios, L. M., & Sahinidis, N. V. (2013) · Journal of Global Optimization · doi:10.1007/s10898-012-9951-y · Cited by 1,276
Benchmarking Deep Reinforcement Learning for Continuous Control
Duan, Y., Chen, X., Houthooft, R., Schulman, J., & Abbeel, P. (2016) · arXiv · doi:10.48550/arxiv.1604.06778 · Cited by 1,114
Multi-Agent Deep Reinforcement Learning for Large-Scale Traffic Signal Control
Chu, T., Wang, J., Codeca, L., & Li, Z. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2901791 · Cited by 1,046
Deep Reinforcement Learning framework for Autonomous Driving
Sallab, A. E., Abdou, M., Perot, E., & Yogamani, S. (2017) · Electronic Imaging · doi:10.2352/issn.2470-1173.2017.19.avm-023 · Cited by 1,045
Evolution Strategies as a Scalable Alternative to Reinforcement Learning
Salimans, T., Ho, J., Chen, X., Sidor, S., & Sutskever, I. (2017) · arXiv · doi:10.48550/arxiv.1703.03864 · Cited by 1,027
Extended time-to-collision measures for road traffic safety assessment
Minderhoud, M. M., & Bovy, P. H. L. (2001) · Accident Analysis & Prevention · doi:10.1016/s0001-4575(00)00019-1 · Cited by 954
ADVISOR: a systems analysis tool for advanced vehicle modeling
Markel, T., Brooker, A., Hendricks, T., Johnson, V, Kelly, K., Kramer, B., O’Keefe, M., Sprik, S., & Wipke, K. (2002) · Journal of Power Sources · doi:10.1016/s0378-7753(02)00189-1 · Cited by 849
van Hasselt, H. P. (2010) · Centrum Wiskunde & Informatica (CWI), the national research institute for mathematics and computer science in the Netherlands · Cited by 839
Applications of artificial intelligence in transport: An overview
Abduljabbar, R., Dia, H., Liyanage, S., & Bagloee, S. A. (2019) · Sustainability · doi:10.3390/su11010189 · Cited by 769
Riedmiller, M. (2005) · Lecture Notes in Computer Science · doi:10.1007/11564096_32 · Cited by 757
IntelliLight: A Reinforcement Learning Approach for Intelligent Traffic Light Control
Wei, H., Zheng, G., Yao, H., & Li, Z. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3220096 · Cited by 684
Unity: A General Platform for Intelligent Agents
Juliani, A., Berges, V.-P., Teng, E., Cohen, A., Harper, J., Elion, C., Goy, C., Gao, Y., Henry, H., Mattar, M., et al. (2018) · arXiv · doi:10.48550/arxiv.1809.02627 · Cited by 626 · cited 2×
“A policy gradient-based deep RL method is proposed for adaptive traffic intersection control in [29], which presents experiments on a novel realistic traffic environment called Unity3D by using raw pixels as an input state to policy-based DQN.”
BackgroundTraffic signal timing via deep reinforcement learning
Li, L., Lv, Y., & Wang, F.-Y. (2016) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2016.7508798 · Cited by 609
A Deep Reinforcement Learning Network for Traffic Light Cycle Control
Liang, X., Du, X., Wang, G., & Han, Z. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2890726 · Cited by 604
Reinforcement learning-based multi-agent system for network traffic signal control
Arel, I., Liu, C., Urbanik, T., & Kohls, A. G. (2010) · IET Intelligent Transport Systems · doi:10.1049/iet-its.2009.0070 · Cited by 592
Microscopic Traffic Flow Simulator VISSIM
Fellendorf, M., & Vortisch, P. (2010) · International Series in Operations Research & Management Science · doi:10.1007/978-1-4419-6142-6_2 · Cited by 551
Reinforcement Learning for True Adaptive Traffic Signal Control
Abdulhai, B., Pringle, R., & Karakoulas, G. J. (2003) · Journal of Transportation Engineering · doi:10.1061/(asce)0733-947x(2003)129:3(278 · Cited by 548
RLlib: Abstractions for Distributed Reinforcement Learning
Liang, E., Liaw, R., Moritz, P., Nishihara, R., Fox, R., Goldberg, K., Gonzalez, J. E., Jordan, M. I., & Stoica, I. (2017) · arXiv · doi:10.48550/arxiv.1712.09381 · Cited by 473
El-Tantawy, S., Abdulhai, B., & Abdelgawad, H. (2013) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2013.2255286 · Cited by 458
Stabilising Experience Replay for Deep Multi-Agent Reinforcement Learning
Foerster, J., Nardelli, N., Farquhar, G., Afouras, T., Torr, P. H. S., Kohli, P., & Whiteson, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.08887 · Cited by 397
Deep Learning for Intelligent Transportation Systems: A Survey of Emerging Trends
Veres, M., & Moussa, M. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2929020 · Cited by 394
Navigating Occluded Intersections with Autonomous Vehicles Using Deep Reinforcement Learning
Isele, D., Rahimi, R., Cosgun, A., Subramanian, K., & Fujimura, K. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8461233 · Cited by 379
Multiobjective Reinforcement Learning: A Comprehensive Overview
Liu, C., Xu, X., & Hu, D. (2015) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2014.2358639 · Cited by 361
Traffic light control using deep policy‐gradient and value‐function‐based reinforcement learning
Mousavi, S. S., Schukat, M., & Howley, E. (2017) · IET Intelligent Transport Systems · doi:10.1049/iet-its.2017.0153 · Cited by 354
Wu, Y., Tan, H., Peng, J., Zhang, H., & He, H. (2019) · Applied Energy · doi:10.1016/j.apenergy.2019.04.021 · Cited by 332
Reinforcement Learning With Function Approximation for Traffic Signal Control
LA, P., & Bhatnagar, S. (2011) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2010.2091408 · Cited by 321
Artificial Intelligence for Vehicle-to-Everything: A Survey
Tong, W., Hussain, A., Bo, W. X., & Maharjan, S. (2019) · IEEE Access · doi:10.1109/access.2019.2891073 · Cited by 320
TORCS, The Open Racing Car Simulator
Espié, E., Guionneau, C., Wymann, B., Christos Dimitrakakis, A., Coulom, R., & Sumner, A. J. (2005) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 313
Hoel, C.-J., Driggs-Campbell, K., Wolff, K., Laine, L., & Kochenderfer, M. J. (2020) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2019.2955905 · Cited by 308
Zhou, M., Yu, Y., & Qu, X. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2942014 · Cited by 299
Reinforcement Learning in Large Discrete Action Spaces.Preprint
Dulac-Arnold, G., Evans, R., Sunehag, P., & Coppin, B. (2015) · arXiv (Cornell University) · Cited by 292
Deep Reinforcement Learning in Large Discrete Action Spaces
Dulac-Arnold, G., Evans, R., van Hasselt, H., Sunehag, P., Lillicrap, T., Hunt, J., Mann, T., Weber, T., Degris, T., & Coppin, B. (2015) · arXiv · doi:10.48550/arxiv.1512.07679 · Cited by 290
Collaborative Multiagent Reinforcement Learning by Payoff Propagation
Kok, J. R., & Vlassis, N. A. (2006) · Open Repository and Bibliography (University of Luxembourg) · doi:10.5555/1248547.1248612 · Cited by 277
Energy Management Strategy for a Hybrid Electric Vehicle Based on Deep Reinforcement Learning
Hu, Y., Li, W., Xu, K., Zahid, T., Qin, F., & Li, C. (2018) · Applied Sciences · doi:10.3390/app8020187 · Cited by 275
An Experimental Review of Reinforcement Learning Algorithms for Adaptive Traffic Signal Control
Mannion, P., Duggan, J., & Howley, E. (2016) · Autonomic Road Transport Support Systems · doi:10.1007/978-3-319-25808-9_4 · Cited by 267
Aslani, M., Mesgari, M. S., & Wiering, M. (2017) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2017.09.020 · Cited by 250
PARAMICS?Parallel microscopic simulation of road traffic
Cameron, G. D. B., & Duncan, G. I. D. (1996) · The Journal of Supercomputing · doi:10.1007/bf00128098 · Cited by 246
Deep Deterministic Policy Gradient for Urban Traffic Light ControlPreprint
Casas, N. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.09035 · Cited by 240
Self-Organizing Traffic Lights: A Realistic Simulation
Cools, S.-B., Gershenson, C., & D’Hooghe, B. (2013) · Advanced Information and Knowledge Processing · doi:10.1007/978-1-4471-5113-5_3 · Cited by 236
Opportunities for multiagent systems and multiagent reinforcement learning in traffic control
Bazzan, A. L. C. (2009) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-008-9062-9 · Cited by 235
Cooperative Deep Reinforcement Learning for Large-Scale Traffic Grid Signal Control
Tan, T., Bao, F., Deng, Y., Jin, A., Dai, Q., & Wang, J. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2904742 · Cited by 234
Multiagent Reinforcement Learning for Urban Traffic Control Using Coordination Graphs
Kuyer, L., Whiteson, S., Bakker, B., & Vlassis, N. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-87479-9_61 · Cited by 231
Gao, J., Shen, Y., Liu, J., Ito, M., & Shiratori, N. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.02755 · Cited by 231
Using a Deep Reinforcement Learning Agent for Traffic Signal Control
Genders, W., & Razavi, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01142 · Cited by 229
A Survey on Reinforcement Learning Models and Algorithms for Traffic Signal Control
Yau, K.-L. A., Qadir, J., Khoo, H. L., Ling, M. H., & Komisarczuk, P. (2018) · ACM Computing Surveys · doi:10.1145/3068287 · Cited by 223
Urban traffic signal control using reinforcement learning agents
Balaji, P. G., German, X., & Srinivasan, D. (2010) · IET Intelligent Transport Systems · doi:10.1049/iet-its.2009.0096 · Cited by 213
Automated Speed and Lane Change Decision Making using Deep Reinforcement Learning
Hoel, C.-J., Wolff, K., & Laine, L. (2018) · 2018 21st International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2018.8569568 · Cited by 213
Traffic light control in non-stationary environments based on multi agent Q-learning
Abdoos, M., Mozayani, N., & Bazzan, A. L. C. (2011) · 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2011.6083114 · Cited by 205
Khamis, M. A., & Gomaa, W. (2014) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2014.01.007 · Cited by 204
Multi-Agent Reinforcement Learning for Traffic Light control
Wiering, M., Systemen, I., & Informática, D. E. (2000) · Utrecht University Repository (Utrecht University) · Cited by 196
Sample Efficient Actor-Critic with Experience Replay
Wang, Z., Bapst, V., Heess, N., Mnih, V., Munos, R., Kavukcuoglu, K., & de Freitas, N. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01224 · Cited by 192
Autonomous braking system via deep reinforcement learning
Chae, H., Kang, C. M., Kim, B., Kim, J., Chung, C. C., & Choi, J. W. (2017) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2017.8317839 · Cited by 187
Ye, Y., Zhang, X., & Sun, J. (2019) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2019.08.011 · Cited by 179
Reinforcement learning in continuous time: advantage updating
Baird, L. C. (1994) · Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94) · doi:10.1109/icnn.1994.374604 · Cited by 177
RLlib: Abstractions for Distributed Reinforcement Learning
Liang, E., Liaw, R., Nishihara, R., Moritz, P., Fox, R., Goldberg, K. Y., Gonzalez, J. E., Jordan, M. I., & Stoica, I. G. (2018) · International Conference on Machine Learning · Cited by 175
Traffic Signal Control Based on Reinforcement Learning with Graph Convolutional Neural Nets
Nishi, T., Otaki, K., Hayakawa, K., & Yoshimura, T. (2018) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2018.8569301 · Cited by 174
A Survey on Traffic Signal Control Methods
Wei, H., Zheng, G., Gayah, V. V., & Li, Z. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.08117 · Cited by 172
Cooperative Deep Q-Learning With Q-Value Transfer for Multi-Intersection Signal Control
Ge, H., Song, Y., Wu, C., Ren, J., & Tan, G. (2019) · IEEE Access · doi:10.1109/access.2019.2907618 · Cited by 171
Yu, C., Wang, X., Xu, X., Zhang, M., Ge, H., Ren, J., Sun, L., Chen, B., & Tan, G. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2893683 · Cited by 170
Expert Level Control of Ramp Metering Based on Multi-Task Deep Reinforcement Learning
Belletti, F., Haziza, D., Gomes, G., & Bayen, A. M. (2017) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2017.2725912 · Cited by 167
El-Tantawy, S., Abdulhai, B., & Abdelgawad, H. (2014) · Journal of Intelligent Transportation Systems · doi:10.1080/15472450.2013.810991 · Cited by 163
Lane Change Decision-making through Deep Reinforcement Learning with Rule-based Constraints
Wang, J., Zhang, Q., Zhao, D., & Chen, Y. (2019) · 2019 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852110 · Cited by 163
Dissipating stop-and-go waves in closed and open networks via deep reinforcement learning
Kreidieh, A. R., Wu, C., & Bayen, A. M. (2018) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2018.8569485 · Cited by 143
Simulation and optimization of traffic in a city
Wiering, M., Vreeken, J., van Veenen, J., & Koopman, A. (2004) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2004.1336426 · Cited by 133
Multi-Agent Reinforcement Learning: A Survey
Buşoniu, L., Babuška, R., & Schutter, B. D. (2006) · International Conference on Control, Automation, Robotics and Vision (ICARCV) · doi:10.1109/icarcv.2006.345353 · Cited by 130
Evaluating reinforcement learning state representations for adaptive traffic signal control
Genders, W., & Razavi, S. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.04.008 · Cited by 119
An agent-based learning towards decentralized and coordinated traffic signal control
El-Tantawy, S., & Abdulhai, B. (2010) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2010.5625066 · Cited by 118
A Collaborative Reinforcement Learning Approach to Urban Traffic Control Optimization
Salkham, A., Cunningham, R., Garg, A., & Cahill, V. (2008) · IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT) · doi:10.1109/wiiat.2008.88 · Cited by 109
Traffic Light Control by Multiagent Reinforcement Learning Systems
Bakker, B., Whiteson, S., Kester, L. J. H. M., & Groen, F. C. A. (2010) · Studies in computational intelligence · doi:10.1007/978-3-642-11688-9_18 · Cited by 109
Value‐based deep reinforcement learning for adaptive isolated intersection signal control
Wan, C., & Hwang, M. (2018) · IET Intelligent Transport Systems · doi:10.1049/iet-its.2018.5170 · Cited by 109
A Multi-Objective Agent-Based Control Approach With Application in Intelligent Traffic Signal System
Jin, J., & Ma, X. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2906260 · Cited by 106
Learning to Drive using Inverse Reinforcement Learning and Deep Q-NetworksPreprint
Sharifzadeh, S., Chiotellis, I., Triebel, R., & Cremers, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.03653 · Cited by 102
A Control Strategy of Autonomous Vehicles Based on Deep Reinforcement Learning
Xia, W., Li, H., & Li, B. (2016) · International Symposium on Computational Intelligence and Design · doi:10.1109/iscid.2016.2054 · Cited by 94
Combining policy gradient and Q-learning
O'Donoghue, B., Munos, R., Kavukcuoglu, K., & Mnih, V. (2016) · arXiv · doi:10.48550/arxiv.1611.01626 · Cited by 90
Simulation to scaled city: zero-shot policy transfer for traffic control via autonomous vehicles
Jang, K., Vinitsky, E., Chalaki, B., Remer, B., Beaver, L. E., Malikopoulos, A. A., & Bayen, A. M. (2019) · ACM/IEEE International Conference on Cyber-Physical Systems (ICCPS) · doi:10.1145/3302509.3313784 · Cited by 89
Reinforcement learning with average cost for adaptive control of traffic lights at intersections
Prashanth, L. A., & Bhatnagar, S. (2011) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2011.6082823 · Cited by 88
Xu, M., Wu, J., Huang, L., Zhou, R., Wang, T., & Hu, D. (2019) · Journal of Intelligent Transportation Systems · doi:10.1080/15472450.2018.1527694 · Cited by 83
Multiobjective Reinforcement Learning for Traffic Signal Control Using Vehicular Ad Hoc Network
Houli, D., Li, Z., & Zhang, Y. (2010) · EURASIP Journal on Advances in Signal Processing · doi:10.1155/2010/724035 · Cited by 80
An Efficient Deep Reinforcement Learning Model for Urban Traffic ControlPreprint
Lin, Y., Dai, X., Li, L., & Wang, F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.01876 · Cited by 80
Distributed Learning Agents in Urban Traffic Control
Camponogara, E., & Kraus, W. (2003) · Lecture notes in computer science · doi:10.1007/978-3-540-24580-3_38 · Cited by 78
A Survey of Intelligence Methods in Urban Traffic Signal Control
Zhi-yong, L. (2007) · Cited by 78
Deep Learning vs. Discrete Reinforcement Learning for Adaptive Traffic Signal Control
Shabestary, S. M. A., & Abdulhai, B. (2018) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2018.8569549 · Cited by 78
Deep reinforcement‐learning‐based driving policy for autonomous road vehicles
Makantasis, K., Kontorinaki, M., & Nikolos, I. K. (2019) · IET Intelligent Transport Systems · doi:10.1049/iet-its.2019.0249 · Cited by 77
Combining Deep Reinforcement Learning and Safety Based Control for Autonomous DrivingPreprint
Xiong, X., Wang, J., Zhang, F., & Li, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.00147 · Cited by 76
Asynchronous n-step Q-learning adaptive traffic signal control
Genders, W., & Razavi, S. (2019) · Journal of Intelligent Transportation Systems · doi:10.1080/15472450.2018.1491003 · Cited by 76
Deep Distributional Reinforcement Learning Based High-Level Driving Policy Determination
Min, K., Kim, H., & Huh, K. (2019) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2019.2919467 · Cited by 76
El-Tantawy, S., & Abdulhai, B. (2012) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2012.6338707 · Cited by 74
Adaptive Traffic Signal Control : Exploring Reward Definition For Reinforcement Learning
Touhbi, S., Babram, M. A., Nguyen-Huu, T., Marilleau, N., Hbid, M. L., Cambier, C., & Stinckwich, S. (2017) · Procedia Computer Science · doi:10.1016/j.procs.2017.05.327 · Cited by 73
Aziz, H. M. A., Zhu, F., & Ukkusuri, S. V. (2017) · Journal of Intelligent Transportation Systems · doi:10.1080/15472450.2017.1387546 · Cited by 66
Pandey, V., Wang, E., & Boyles, S. D. (2020) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2020.102715 · Cited by 60
Distributed learning and multi-objectivity in traffic light control
Brys, T., Pham, T., & Taylor, M. E. (2014) · Connection Science · doi:10.1080/09540091.2014.885282 · Cited by 59
Heterogeneous Multi-Agent Deep Reinforcement Learning for Traffic Lights Control.
Dusparić, I., & Calvo, J. A. (2018) · AICS · Cited by 53
Q-Learning for Adaptive Traffic Signal Control Based on Delay Minimization Strategy
Lu, S., Ximin, L., & Shiqiang, D. (2008) · IEEE International Conference on Networking, Sensing and Control (ICNSC) · doi:10.1109/icnsc.2008.4525304 · Cited by 43
Exploring Q-Learning Optimization in Traffic Signal Timing Plan Management
Chin, Y. K., Lee, L. K., Bolong, N., Yang, S. S., & Teo, K. T. K. (2011) · International Conference on Computational Intelligence, Communication Systems and Networks (CICSyN) · doi:10.1109/cicsyn.2011.64 · Cited by 43
Large-scale traffic grid signal control with regional Reinforcement Learning
Chu, T., Qu, S., & Wang, J. (2016) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.1109/acc.2016.7525014 · Cited by 42
Microscopic Traffic Simulation by Cooperative Multi-agent Deep Reinforcement Learning
Bacchiani, G., Molinari, D., & Patander, M. (2019) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/bgaa3250 · Cited by 35
Deep Reinforcement Learning for Intelligent Transportation SystemsPreprint
Liu, X., Ding, Z., Borst, S. C., & Walid, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.00979 · Cited by 32
Simulation-Based Reinforcement Learning for Real-World Autonomous Driving
Osiński, B., Jakubowski, A., Ziecina, P., Milos, P., Galias, C., Homoceanu, S., & Michalewski, H. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9196730 · Cited by 32
Deep Q Learning with LSTM for Traffic Light Control
Choe, C., Baek, S., Woon, B., & Kong, S.-H. (2018) · Asia-Pacific Conference on Communications (APCC) · doi:10.1109/apcc.2018.8633520 · Cited by 31
ERL: Edge Based Reinforcement Learning for Optimized Urban Traffic Light Control
Zhou, P., Braud, T., Alhilal, A. Y., Hui, P., & Kangasharju, J. (2019) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomw.2019.8730706 · Cited by 29
Deep Reinforcement Learning for Traffic Light Optimization
Coşkun, M., Baggag, A., & Chawla, S. (2018) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw.2018.00088 · Cited by 28
Deep, Consistent Behavioral Decision Making with Planning Features for Autonomous Vehicles
Qian, L., Xu, X., Zeng, Y., & Huang, J. (2019) · Electronics · doi:10.3390/electronics8121492 · Cited by 24
Targeted Knowledge Transfer for Learning Traffic Signal Plans
Xu, N., Zheng, G., Xu, K., Zhu, Y., & Li, Z. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-16145-3_14 · Cited by 20
Driving Decision and Control for Autonomous Lane Change based on Deep Reinforcement LearningPreprint
Shi, T., Wang, P., Cheng, X., Chan, C., & Huang, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.10171 · Cited by 19
Taylor, M. E., Jain, M., TANDON, P., Yokoo, M., & Tambe, M. (2011) · Advances in Complex Systems · doi:10.1142/s0219525911003104 · Cited by 16
Multiagent Reinforcement Learning Algorithm for Distributed Dynamic Pricing of Managed Lanes
Pandey, V., & Boyles, S. D. (2018) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2018.8569317 · Cited by 15
ES-CTC: A Deep Neuroevolution Model for Cooperative Intelligent Freeway Traffic ControlPreprint
Wu, Y., Tan, H., Jiang, Z., & Ran, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.04083 · Cited by 7
Cited by
Study on artificial intelligence: The state of the art and future prospects
Zhang, C., & Lu, Y. (2021) · Journal of Industrial Information Integration · doi:10.1016/j.jii.2021.100224 · Cited by 1,066
A Review of Deep Reinforcement Learning for Smart Building Energy Management
Yu, L., Qin, S., Zhang, M., Shen, C., Jiang, T., & Guan, X. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3078462 · Cited by 476
Edge Intelligence in Intelligent Transportation Systems: A Survey
Gong, T., Zhu, L., Yu, F. R., & Tang, T. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3275741 · Cited by 256
Machine Learning for Security in Vehicular Networks: A Comprehensive Survey
Talpur, A., & Gurusamy, M. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3129079 · Cited by 107
Deep Reinforcement Learning for Traffic Signal Control Model and Adaptation Study
Tan, J., Yuan, Q., Guo, W., Xie, N., Liu, F., Wei, J., & Zhang, X. (2022) · Sensors · doi:10.3390/s22228732 · Cited by 32
Metadata
- Authors
- Haydari, A., & Yilmaz, Y.
- Venue
- IEEE Transactions on Intelligent Transportation Systems
- Published
- 2022-01
- Volume
- 23
- Issue
- 1
- Pages
- 11-32
- ISSN
- 1524-9050 (ISSN-L)
- 1558-0016
- OpenAlex
- W3022861755
- Cited by
- 690
- References
- 128
- FWCI
- 32.78
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.