The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Development of an Efficient Driving Strategy for Connected and Automated Vehicles at Signalized Intersections: A Reinforcement Learning Approach
Open accessAbstract
The concept of Connected and Automated Vehicles (CAVs) enables instant traffic information to be shared among vehicle networks. With this newly proposed concept, a vehicle's driving behaviour will no longer be solely based on the driver's limited and incomplete observation. By taking advantages of the shared information, driving behaviours of CAVs can be improved greatly to a more responsible, accurate and efficient level. This study proposed a reinforcement-learning-based car following model for CAVs in order to obtain an appropriate driving behaviour to improve travel efficiency, fuel consumption and safety at signalized intersections in real-time. The result shows that by specifying an effective reward function, a controller can be learned and works well under different traffic demands as well as traffic light cycles with different durations. This study reveals a great potential of emerging reinforcement learning technologies in transport research and applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
(1999) · Cited by 5,147
Congested traffic states in empirical observations and microscopic simulations
Treiber, M., Hennecke, A., & Helbing, D. (2000) · Physical Review E · doi:10.1103/physreve.62.1805 · Cited by 4,762
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 3,416
Deterministic Policy Gradient Algorithms
Silver, D., Lever, G., Heess, N., Degris, T., Wierstra, D., & Riedmiller, M. (2014) · HAL · Cited by 3,275
Konda, V. R., & Tsitsiklis, J. N. (2002) · Cited by 2,202
The Impact of Cooperative Adaptive Cruise Control on Traffic-Flow Characteristics
van Arem, B., van Driel, C. J. G., & Visser, R. (2006) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2006.884615 · Cited by 1,490
Cooperative Adaptive Cruise Control in Real Traffic Situations
Milanés, V., Shladover, S. E., Spring, J., Nowakowski, C., Kawazoe, H., & Nakamura, M. (2014) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2013.2278494 · Cited by 1,130
Milanés, V., & Shladover, S. E. (2014) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2014.09.001 · Cited by 1,100
String-Stable CACC Design and Experimental Validation: A Frequency-Domain Approach
Naus, G. J. L., Vugts, R. P. A., Ploeg, J., van de Molengraft, M. J. G., & Steinbuch, M. (2010) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2010.2076320 · Cited by 916
Impacts of cooperative adaptive cruise control on freeway traffic flow
Shladover, S. E., Su, D., & Lu, X.-Y. (2012) · Transportation Research Record: Journal of the Transportation Research Board · doi:10.3141/2324-08 · Cited by 887
Autonomous vehicles: challenges, opportunities, and future implications for transportation policies
Bagloee, S. A., Tavana, M., Asadi, M., & Oliver, T. (2016) · Journal of Modern Transportation · doi:10.1007/s40534-016-0117-3 · Cited by 825
Ahn, K., Rakha, H. A., Trani, A. A., & Aerde, M. V. (2002) · Journal of Transportation Engineering · doi:10.1061/(asce)0733-947x(2002)128:2(182 · Cited by 816
Sugiyama, Y., Fukui, M., Kikuchi, M., Hasebe, K., Nakayama, A., Nishinari, K., Tadaki, S.-I., & Yukawa, S. (2008) · New Journal of Physics · doi:10.1088/1367-2630/10/3/033001 · Cited by 747
Emergence of Locomotion Behaviours in Rich Environments
Heess, N., TB, D., Sriram, S., Lemmon, J., Merel, J., Wayne, G., Tassa, Y., Erez, T., Wang, Z., Eslami, S. M. A., et al. (2017) · arXiv · doi:10.48550/arxiv.1707.02286 · Cited by 657
Cooperative Adaptive Cruise Control: A Reinforcement Learning Approach
Desjardins, C., & Chaib-draa, B. (2011) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2011.2157145 · Cited by 344
Zhou, M., Qu, X., & Jin, S. (2016) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2016.2606492 · Cited by 291
Self-citationWang, M., Daamen, W., Hoogendoorn, S. P., & van Arem, B. (2014) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2013.11.024 · Cited by 252
Ma, J., Li, X., Zhou, F., Hu, J., & Park, B. B. (2017) · Transportation Research Part B: Methodological · doi:10.1016/j.trb.2016.06.010 · Cited by 245
Peng, P., Wen, Y., Yang, Y., Yuan, Q., Tang, Z., Long, H., & Wang, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.10069 · Cited by 241
Zhou, F., Li, X., & Ma, J. (2017) · Transportation Research Part B: Methodological · doi:10.1016/j.trb.2016.05.007 · Cited by 216
Efficient control of fully automated connected vehicles at freeway merge segments
Letter, C., & Elefteriadou, L. (2017) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2017.04.015 · Cited by 215
A Unified Framework for Vehicle Rerouting and Traffic Light Control to Reduce Traffic Congestion
Cao, Z., Siwei, J., Zhang, J., & Guo, H. (2016) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2016.2613997 · Cited by 195
Traffic flow optimization: A reinforcement learning approach
Walraven, E., Spaan, M. T. J., & Bakker, B. (2016) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2016.01.001 · Cited by 183
Expert Level Control of Ramp Metering Based on Multi-Task Deep Reinforcement Learning
Belletti, F., Haziza, D., Gomes, G., & Bayen, A. M. (2017) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2017.2725912 · Cited by 167
Qu, X., Zhang, J., & Wang, S. (2017) · Transportation Research Part B: Methodological · doi:10.1016/j.trb.2017.07.003 · Cited by 167
Self-citationStabilizing Traffic with Autonomous Vehicles
Wu, C., Bayen, A. M., & Mehta, A. M. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460567 · Cited by 162
Drivers' estimates of time to collision
Hoffmann, E. R., & Mortimer, R. G. (1994) · Accident Analysis & Prevention · doi:10.1016/0001-4575(94)90042-6 · Cited by 142
Handling Cut-In Vehicles in Strings of Cooperative Adaptive Cruise Control Vehicles
Milanés, V., & Shladover, S. (2016) · Journal of Intelligent Transportation Systems / Taylor & Francis · doi:10.1080/15472450.2015.1016023 · Cited by 118
Review of Variable Speed Limits and Advisories
Lu, X., & Shladover, S. E. (2014) · Transportation Research Record Journal of the Transportation Research Board · doi:10.3141/2423-03 · Cited by 97
Emergent Behaviors in Mixed-Autonomy Traffic
Wu, C., Kreidieh, A., Vinitsky, E., & Bayen, A. M. (2017) · Conference on Robot Learning · Cited by 89
Yang, X., & Recker, W. W. (2005) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2005.11.001 · Cited by 83
Modeling the process of information relay through inter-vehicle communication
Wang, X. (2007) · Transportation Research Part B Methodological · doi:10.1016/j.trb.2006.11.002 · Cited by 82
An Efficient Deep Reinforcement Learning Model for Urban Traffic ControlPreprint
Lin, Y., Dai, X., Li, L., & Wang, F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.01876 · Cited by 80
Aziz, H. M. A., Zhu, F., & Ukkusuri, S. V. (2017) · Journal of Intelligent Transportation Systems · doi:10.1080/15472450.2017.1387546 · Cited by 66
Coupled vehicle and information flows: Message transport on a dynamic vehicle network
Schönhof, M., Kesting, A., Treiber, M., & Helbing, D. (2006) · Physica A Statistical Mechanics and its Applications · doi:10.1016/j.physa.2006.01.057 · Cited by 55
Maximizing the Probability of Arriving on Time: A Practical Q-Learning Method
Cao, Z., Guo, H., Zhang, J., Oliehoek, F. A., & Fastenrath, U. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11170 · Cited by 54
Schönhof, M., Treiber, M., Kesting, A., & Helbing, D. (2007) · Transportation Research Record Journal of the Transportation Research Board · doi:10.3141/1999-01 · Cited by 49
Cited by
Deep Reinforcement Learning for Intelligent Transportation Systems: A Survey
Haydari, A., & Yilmaz, Y. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3008612 · Cited by 690
Ganesh, A. H., & Xu, B. (2022) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2021.111833 · Cited by 285
Blockchain Intelligence for Internet of Vehicles: Challenges and Solutions
Wang, X., Zhu, H., Ning, Z., Guo, L., & Zhang, Y. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3305312 · Cited by 131
Flow-level coordination of connected and autonomous vehicles in multilane freeway ramp merging areas
Zhu, J., Tasic, I., & Qu, X. (2022) · Multimodal Transportation · doi:10.1016/j.multra.2022.100005 · Cited by 88
Self-citationHua, M., Qi, X., Chen, D., Jiang, K., Liu, Z. E., Sun, H., Zhou, Q., & Xu, H. (2025) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2025.3574280 · Cited by 88
“We then delve into various prominent MARL algorithms, establishing the context to enhance the understanding of our review.”
Metadata
- Authors
- Zhou, M., Yu, Y., & Qu, X.
- Venue
- IEEE Transactions on Intelligent Transportation Systems
- Published
- 2020-01
- Volume
- 21
- Issue
- 1
- Pages
- 433-443
- ISSN
- 1524-9050 (ISSN-L)
- 1558-0016
- OpenAlex
- W2976036462
- Cited by
- 299
- References
- 48
- FWCI
- 17.76
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.