The DOI matches its Crossref record; 101 of the 101 references it cites were found in a registry or an index.
Survey of Deep Reinforcement Learning for Motion Planning of Autonomous Vehicles
Open accessAbstract
Academic research in the field of autonomous vehicles has reached high popularity in recent years related to several topics as sensor technologies, V2X communications, safety, security, decision making, control, and even legal and standardization rules. Besides classic control design approaches, Artificial Intelligence and Machine Learning methods are present in almost all of these fields. Another part of research focuses on different layers of Motion Planning, such as strategic decisions, trajectory planning, and control. A wide range of techniques in Machine Learning itself have been developed, and this article describes one of these fields, Deep Reinforcement Learning (DRL). The paper provides insight into the hierarchical motion planning problem and describes the basics of DRL. The main elements of designing such a system are the modeling of the environment, the modeling abstractions, the description of the state and the perception models, the appropriate rewarding, and the realization of the underlying neural network. The paper describes vehicle models, simulation possibilities and computational requirements. Strategic decisions on different layers and the observation models, e.g., continuous and discrete state representations, grid-based, and camera-based solutions are presented. The paper surveys the state-of-art solutions systematized by the different tasks and levels of autonomous driving, such as car-following, lane-keeping, trajectory following, merging, or driving in dense traffic. Finally, open questions and future challenges are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Congested traffic states in empirical observations and microscopic simulations
Treiber, M., Hennecke, A., & Helbing, D. (2000) · Physical Review E · doi:10.1103/physreve.62.1805 · Cited by 4,762
Planning and acting in partially observable stochastic domains
Kaelbling, L. P., Littman, M. L., & Cassandra, A. R. (1998) · Artificial Intelligence · doi:10.1016/s0004-3702(98)00023-x · Cited by 4,149
CARLA: An open urban driving simulator
Dosovitskiy, A., Ros, G., Codevilla, F., Lopez, A., & Koltun, V. (2017) · arXiv · doi:10.48550/arxiv.1711.03938 · Cited by 3,718
A theory of learning from different domains
Ben-David, S., Blitzer, J., Crammer, K., Kulesza, A., Pereira, F., & Vaughan, J. W. (2010) · Machine Learning · doi:10.1007/s10994-009-5152-4 · Cited by 3,515
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Dueling Network Architectures for Deep Reinforcement Learning
Wang, Z., Schaul, T., Hessel, M., van Hasselt, H., Lanctot, M., & de Freitas, N. (2015) · arXiv · doi:10.48550/arxiv.1511.06581 · Cited by 3,300
Deterministic Policy Gradient Algorithms
Silver, D., Lever, G., Heess, N., Degris, T., Wierstra, D., & Riedmiller, M. (2014) · HAL · Cited by 3,275
Domain randomization for transferring deep neural networks from simulation to the real world
Tobin, J., Fong, R., Ray, A., Schneider, J., Zaremba, W., & Abbeel, P. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202133 · Cited by 3,124
A Survey of Motion Planning and Control Techniques for Self-Driving Urban Vehicles
Paden, B., Cap, M., Yong, S. Z., Yershov, D., & Frazzoli, E. (2016) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2016.2578706 · Cited by 2,585
Stanley: The robot that won the DARPA Grand Challenge
Thrun, S., Montemerlo, M., Dahlkamp, H., Stavens, D., Aron, A., Diebel, J., Fong, P., Gale, J., Halpenny, M., Hoffmann, G., et al. (2006) · Journal of Field Robotics · doi:10.1002/rob.20147 · Cited by 2,237
Using occupancy grids for mobile robot perception and navigation
Elfes, A. (1989) · Computer · doi:10.1109/2.30720 · Cited by 2,213
(2012) · elib (German Aerospace Center) · Cited by 1,994
General Lane-Changing Model MOBIL for Car-Following Models
Kesting, A., Treiber, M., & Helbing, D. (2007) · Transportation Research Record: Journal of the Transportation Research Board · doi:10.3141/1999-10 · Cited by 1,345
Nguyen, T. T., Nguyen, N. D., & Nahavandi, S. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.2977374 · Cited by 1,306
Cooperative Multi-Agent Learning: The State of the Art
Panait, L., & Luke, S. (2005) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-005-2631-2 · Cited by 1,237
Kalra, N., & Paddock, S. M. (2016) · Transportation Research Part A: Policy and Practice · doi:10.1016/j.tra.2016.09.010 · Cited by 1,221
Learning to Communicate with Deep Multi-Agent Reinforcement Learning
Foerster, J. N., Assael, Y. M., de Freitas, N., & Whiteson, S. (2016) · arXiv · doi:10.48550/arxiv.1605.06676 · Cited by 1,217
The Complexity of Decentralized Control of Markov Decision Processes
Bernstein, D. S., Givan, R., Immerman, N., & Zilberstein, S. (2002) · Mathematics of Operations Research · doi:10.1287/moor.27.4.819.297 · Cited by 1,192
A Concise Introduction to Decentralized POMDPs
Oliehoek, F. A., & Amato, C. (2016) · SpringerBriefs in Intelligent Systems · doi:10.1007/978-3-319-28929-8 · Cited by 968
Cooperative Multi-agent Control Using Deep Reinforcement Learning
Gupta, J. K., Egorov, M., & Kochenderfer, M. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-71682-4_5 · Cited by 874
Complexity of the mover's problem and generalizations
Reif, J. H. (1979) · 20th Annual Symposium on Foundations of Computer Science (sfcs 1979) · doi:10.1109/sfcs.1979.10 · Cited by 765
Kinematic and dynamic vehicle models for autonomous driving control design
Kong, J., Pfeiffer, M., Schildbach, G., & Borrelli, F. (2015) · 2015 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/ivs.2015.7225830 · Cited by 756
Kendall, A., Hawke, J., Janz, D., Mazur, P., Reda, D., Allen, J.-M., Lam, V.-D., Bewley, A., & Shah, A. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8793742 · Cited by 694
A survey and critique of multiagent deep reinforcement learning
Hernandez-Leal, P., Kartal, B., & Taylor, M. E. (2019) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-019-09421-1 · Cited by 671
Route Planning in Transportation Networks
Bast, H., Delling, D., Goldberg, A., Müller-Hannemann, M., Pajor, T., Sanders, P., Wagner, D., & Werneck, R. F. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-49487-6_2 · Cited by 610
Microscopic Traffic Flow Simulator VISSIM
Fellendorf, M., & Vortisch, P. (2010) · International Series in Operations Research & Management Science · doi:10.1007/978-1-4419-6142-6_2 · Cited by 551
Human-like autonomous car-following model with deep reinforcement learning
Zhu, M., Wang, X., & Wang, Y. (2018) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2018.10.024 · Cited by 533
Safe, Multi-Agent, Reinforcement Learning for Autonomous Driving
Shalev-Shwartz, S., Shammah, S., & Shashua, A. (2016) · arXiv · doi:10.48550/arxiv.1610.03295 · Cited by 509
A Systematic Review of Perception System and Simulators for Autonomous Vehicles Research
Rosique, F., Navarro, P. J., Fernández, C., & Padilla, A. (2019) · Sensors · doi:10.3390/s19030648 · Cited by 469
Zhu, M., Wang, Y., Pu, Z., Hu, J., Wang, X., & Ke, R. (2020) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2020.102662 · Cited by 465
If multi-agent learning is the answer, what is the question?
Shoham, Y., Powers, R., & Grenager, T. (2007) · Artificial Intelligence · doi:10.1016/j.artint.2006.02.006 · Cited by 410
Polack, P., Altche, F., d'Andrea-Novel, B., & de La Fortelle, A. (2017) · 2017 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/ivs.2017.7995816 · Cited by 408
The Robot That Won the DARPA Grand Challenge
Thrun, S. (2007) · Cited by 406
Navigating Occluded Intersections with Autonomous Vehicles Using Deep Reinforcement Learning
Isele, D., Rahimi, R., Cosgun, A., Subramanian, K., & Fujimura, K. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8461233 · Cited by 379
Cooperative Adaptive Cruise Control: A Reinforcement Learning Approach
Desjardins, C., & Chaib-draa, B. (2011) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2011.2157145 · Cited by 344
Probabilistic trajectory prediction with Gaussian mixture models
Wiest, J., Hoffken, M., Kresel, U., & Dietmayer, K. (2012) · 2012 IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2012.6232277 · Cited by 337
Virtual to Real Reinforcement Learning for Autonomous Driving
Pan, X., You, Y., Wang, Z., & Lu, C. (2017) · Procedings of the British Machine Vision Conference 2017 · doi:10.5244/c.31.11 · Cited by 326
Hoel, C.-J., Driggs-Campbell, K., Wolff, K., Laine, L., & Kochenderfer, M. J. (2020) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2019.2955905 · Cited by 308
A Reinforcement Learning Based Approach for Automated Lane Change Maneuvers
Wang, P., Chan, C.-Y., & de La Fortelle, A. (2018) · 2018 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/ivs.2018.8500556 · Cited by 299
A Unified Game-Theoretic Approach to Multiagent Reinforcement Learning
Lanctot, M., Zambaldi, V., Gruslys, A., Lazaridou, A., Tuyls, K., Perolat, J., Silver, D., & Graepel, T. (2017) · arXiv · doi:10.48550/arxiv.1711.00832 · Cited by 295
TORCS, The Open Racing Car Simulator
Espié, E., Guionneau, C., Wymann, B., Christos Dimitrakakis, A., Coulom, R., & Sumner, A. J. (2005) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 294
You, C., Lu, J., Filev, D., & Tsiotras, P. (2019) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2019.01.003 · Cited by 290
Probabilistic decision-making under uncertainty for autonomous driving using continuous POMDPs
Brechtel, S., Gindele, T., & Dillmann, R. (2014) · 17th International IEEE Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2014.6957722 · Cited by 279
Li, D., Zhao, D., Zhang, Q., & Chen, Y. (2019) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2019.2901089 · Cited by 216
Automated Speed and Lane Change Decision Making using Deep Reinforcement Learning
Hoel, C.-J., Wolff, K., & Laine, L. (2018) · 2018 21st International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2018.8569568 · Cited by 213
End-to-End Deep Reinforcement Learning for Lane Keeping AssistPreprint
Sallab, A. E., Abdou, M., Perot, E., & Yogamani, S. K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.04340 · Cited by 212
End-to-End Race Driving with Deep Reinforcement Learning
Jaritz, M., de Charette, R., Toromanoff, M., Perot, E., & Nashashibi, F. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460934 · Cited by 210
Multiagent Systems: A Survey from a Machine Learning Perspective
Stone, P., & Veloso, M. (1997) · doi:10.21236/ada333248 · Cited by 204
Ye, Y., Zhang, X., & Sun, J. (2019) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2019.08.011 · Cited by 179
Yu, C., Wang, X., Xu, X., Zhang, M., Ge, H., Ren, J., Sun, L., Chen, B., & Tan, G. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2893683 · Cited by 170
BayesSim: Adaptive Domain Randomization Via Probabilistic Inference for Robotics Simulators
Ramos, F. T., Possas, R., & Fox, D. (2019) · Robotics: Science and Systems · doi:10.15607/rss.2019.xv.029 · Cited by 170
A Reinforcement Learning Approach to Autonomous Decision Making of Intelligent Vehicles on Highways
Xu, X., Zuo, L., Li, X., Qian, L., Ren, J., & Sun, Z. (2019) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2018.2870983 · Cited by 168
Lane Change Decision-making through Deep Reinforcement Learning with Rule-based Constraints
Wang, J., Zhang, Q., Zhao, D., & Chen, Y. (2019) · 2019 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852110 · Cited by 163
Autonomous Highway Driving using Deep Reinforcement Learning
Nageshrao, S. P., Tseng, E., & Filev, D. (2019) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2019.8914621 · Cited by 162
Formulation of deep reinforcement learning architecture toward autonomous driving for on-ramp merge
Wang, P., & Chan, C. (2017) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2017.8317735 · Cited by 158
Multi-Agent Imitation Learning for Driving Simulation
Bhattacharyya, R., Phillips, D. J., Wulfe, B., Morton, J., Kuefler, A., & Kochenderfer, M. J. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593758 · Cited by 153
Learning how to drive in a real world simulation with deep Q-Networks
Wolf, P., Hubschneider, C., Weber, M., Bauer, A., Hartl, J., Dürr, F., & Zöllner, J. M. (2017) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2017.7995727 · Cited by 150
Robust Deep Reinforcement Learning for Security and Safety in Autonomous Vehicle Systems
Ferdowsi, A., Challita, U., Saad, W., & Mandayam, N. B. (2018) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2018.8569635 · Cited by 144
Driving in Dense Traffic with Model-Free Reinforcement Learning
Saxena, D. M., Bae, S., Nakhaei, A., Fujimura, K., & Likhachev, M. A. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197132 · Cited by 136
A Multiple-Goal Reinforcement Learning Method for Complex Vehicle Overtaking Maneuvers
Ngai, D. C. K., & Yung, N. H. C. (2011) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2011.2106158 · Cited by 128
Alizadeh, A., Moghadam, M., Bicer, Y., Üre, N. K., Yavas, U., & Kurtulus, C. (2019) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2019.8917192 · Cited by 127
Dou, Y., Yan, F., & Feng, D. (2016) · IEEE International Conference on Advanced Intelligent Mechatronics (AIM) · doi:10.1109/aim.2016.7576883 · Cited by 119
Cooperation-Aware Reinforcement Learning for Merging in Dense Traffic
Bouton, M., Nakhaei, A., Fujimura, K., & Kochenderfer, M. J. (2019) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2019.8916924 · Cited by 116
Deep Learning in Automotive Software
Falcini, F., Lami, G., & Costanza, A. M. (2017) · IEEE Software · doi:10.1109/ms.2017.79 · Cited by 111
Controlling an Autonomous Vehicle with Deep Reinforcement Learning
Folkers, A., Rick, M., & Büskens, C. (2019) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2019.8814124 · Cited by 111
Driving Decision and Control for Automated Lane Change Behavior based on Deep Reinforcement Learning
Shi, T., Wang, P., Cheng, X., Chan, C., & Huang, D. (2019) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2019.8917392 · Cited by 102
Pesce, E., & Montana, G. (2020) · Machine Learning · doi:10.1007/s10994-019-05864-5 · Cited by 97
A Control Strategy of Autonomous Vehicles Based on Deep Reinforcement Learning
Xia, W., Li, H., & Li, B. (2016) · International Symposium on Computational Intelligence and Design · doi:10.1109/iscid.2016.2054 · Cited by 94
Overtaking Maneuvers in Simulated Highway Driving using Deep Reinforcement Learning
Kaushik, M., Prasad, V., Krishna, K. M., & Ravindran, B. (2018) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2018.8500718 · Cited by 87
End-to-End Driving in a Realistic Racing Game with Deep Reinforcement Learning
Perot, E., Jaritz, M., Toromanoff, M., & de Charette, R. (2017) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.64 · Cited by 84
Learning to overtake in TORCS using simple reinforcement learning
Loiacono, D., Prete, A., Lanzi, P. L., & Cardamone, L. (2010) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2010.5586191 · Cited by 78
Safe Reinforcement Learning for Autonomous Vehicles through Parallel Constrained Policy Optimization
Wen, L., Duan, J., Li, S. E., Xu, S., & Peng, H. (2020) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc45102.2020.9294262 · Cited by 78
Qiao, Z., Muelling, K., Dolan, J. M., Palanisamy, P., & Mudalige, P. (2018) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2018.8500603 · Cited by 72
Wolf, P., Kurzer, K., Wingert, T., Kuhnt, F., & Zöllner, J. M. (2018) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2018.8500427 · Cited by 68
An, H., & Jung, J.-I. (2019) · Electronics · doi:10.3390/electronics8050543 · Cited by 58
Reinforcement Learning with Probabilistic Guarantees for Autonomous DrivingPreprint
Bouton, M., Karlsson, J., Nakhaei, A., Fujimura, K., Kochenderfer, M. J., & Tůmová, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.07189 · Cited by 53
Deep Q-Network Based Decision Making for Autonomous Driving
Ronecker, M. P., & Zhu, Y. (2019) · International Conference on Robotics and Automation Sciences (ICRAS) · doi:10.1109/icras.2019.8808950 · Cited by 49
Bai, Z., Shangguan, W., Cai, B., & Chai, L. (2019) · Chinese Control Conference (CCC) · doi:10.23919/chicc.2019.8866005 · Cited by 48
Ma, X., Driggs-Campbell, K., & Kochenderfer, M. J. (2018) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2018.8500450 · Cited by 45
Optimal motion planning by reinforcement learning in autonomous mobile vehicles
Gómez, M., González, R., Martinez-Marín, T., Meziat, D., & Sánchez, S. (2011) · Robotica · doi:10.1017/s0263574711000452 · Cited by 40
Autonomous Driving in Reality with Reinforcement Learning and Image TranslationPreprint
Xu, N., Tan, B., & Kong, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.05299 · Cited by 34
Automated Vehicle Overtaking based on a Multiple-Goal Reinforcement Learning Framework
Ngai, D. C. K., & Yung, N. H. C. (2007) · IEEE Intelligent Transportation Systems Conference (ITSC) · doi:10.1109/itsc.2007.4357682 · Cited by 32
Cooperative Lane Changing via Deep Reinforcement LearningPreprint
Wang, G., Hu, J., Li, Z., & Li, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.08662 · Cited by 32
Policy Gradient Based Reinforcement Learning Approach for Autonomous Highway Driving
Aradi, S., Bécsi, T., & Gáspár, P. (2018) · IEEE Conference on Control Technology and Applications (CCTA) · doi:10.1109/ccta.2018.8511514 · Cited by 29
Self-citationParameter Sharing Reinforcement Learning Architecture for Multi Agent Driving
Kaushik, M., Singhania, N., Phaniteja, S., & Krishna, K. M. (2019) · doi:10.1145/3352593.3352625 · Cited by 24
Schester, L., & Ortiz, L. E. (2019) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2019.8916951 · Cited by 21
Deep Multi-agent Reinforcement Learning in a Homogeneous Open Population
Rădulescu, R., Legrand, M., Efthymiadis, K., Roijers, D. M., & Nowé, A. (2019) · Communications in computer and information science · doi:10.1007/978-3-030-31978-6_8 · Cited by 20
Graph-based Multi-Vehicle Overtaking Strategy for Autonomous Vehicles
Hegedűs, T., Németh, B., & Gáspár, P. (2019) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2019.09.060 · Cited by 18
Deep Q learning for traffic simulation in autonomous driving at a highway junction
Kashihara, K. (2017) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2017.8122738 · Cited by 16
Q-learning based Reinforcement Learning Approach for Lane Keeping
Fehér, Á., Aradi, S., & Bécsi, T. (2018) · IEEE International Symposium on Computational Intelligence and Informatics (CINTI) · doi:10.1109/cinti.2018.8928230 · Cited by 15
Self-citationLubashevsky, I., & Kanemoto, S. (2010) · The European Physical Journal B · doi:10.1140/epjb/e2010-00201-8 · Cited by 11
Highway Environment Model for Reinforcement Learning
Bécsi, T., Aradi, S., Fehér, Á., Szalay, J., & Gáspár, P. (2018) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2018.11.596 · Cited by 9
Self-citationSelf Training Autonomous Driving Agent
Kotyan, S., Vargas, D. V., & Venkanna, U. (2019) · Annual Conference of the Society of Instrument and Control Engineers of Japan (SICE) · doi:10.23919/sice.2019.8859883 · Cited by 5
Hybrid Trajectory Planning for Autonomous Vehicles using Neural Networks
Hegedűs, F., Bécsi, T., Aradi, S., & Gáldi, G. (2018) · IEEE International Symposium on Computational Intelligence and Informatics (CINTI) · doi:10.1109/cinti.2018.8928220 · Cited by 5
Self-citation
Cited by
Reinforcement learning algorithms: A brief survey
Shakya, A. K., Pillai, G., & Chakrabarty, S. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120495 · Cited by 656
Gupta, A., Anpalagan, A., Guan, L., & Khwaja, A. S. (2021) · Array · doi:10.1016/j.array.2021.100057 · Cited by 565
A Review of Deep Reinforcement Learning for Smart Building Energy Management
Yu, L., Qin, S., Zhang, M., Shen, C., Jiang, T., & Guan, X. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3078462 · Cited by 476
Graph Neural Networks for Intelligent Transportation Systems: A Survey
Rahmani, S., Baghbani, A., Bouguila, N., & Patterson, Z. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3257759 · Cited by 353
Autonomous driving system: A comprehensive survey
Zhao, J., Zhao, W., Deng, B., Wang, Z., Zhang, F., Zheng, W., Cao, W., Nan, J., Lian, Y., & Burke, A. F. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122836 · Cited by 361
Metadata
- Authors
- Aradi, S.
- Venue
- IEEE Transactions on Intelligent Transportation Systems
- Published
- 2022-02
- Volume
- 23
- Issue
- 2
- Pages
- 740-759
- ISSN
- 1524-9050 (ISSN-L)
- 1558-0016
- OpenAlex
- W3004270765
- Cited by
- 639
- References
- 101
- FWCI
- 22.49
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.