The DOI matches its Crossref record; 139 of the 139 references it cites were found in a registry or an index.
A Survey of End-to-End Driving: Architectures and Training Methods
Open accessAbstract
Autonomous driving is of great interest to industry and academia alike. The use of machine learning approaches for autonomous driving has long been studied, but mostly in the context of perception. In this article, we take a deeper look on the so-called end-to-end approaches for autonomous driving, where the entire driving pipeline is replaced with a single neural network. We review the learning methods, input and output modalities, network architectures, and evaluation schemes in end-to-end driving literature. Interpretability and safety are discussed separately, as they remain challenging for this approach. Beyond providing a comprehensive overview of existing methods, we conclude the review with an architecture that combines the most promising elements of the end-to-end autonomous driving systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · arXiv · doi:10.48550/arxiv.1802.02611 · Cited by 20,063
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_49 · Cited by 20,054
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
A survey on Image Data Augmentation for Deep Learning
Shorten, C., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0197-0 · Cited by 13,203
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Explaining and Harnessing Adversarial Examples
Goodfellow, I. J., Shlens, J., & Szegedy, C. (2014) · arXiv · doi:10.48550/arxiv.1412.6572 · Cited by 10,381
Vision meets robotics: The KITTI dataset
Geiger, A., Lenz, P., Stiller, C., & Urtasun, R. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913491297 · Cited by 9,913
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
Charles, R. Q., Su, H., Kaichun, M., & Guibas, L. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.16 · Cited by 9,237
Conditional Generative Adversarial Nets
Mirza, M., & Osindero, S. (2014) · arXiv · doi:10.48550/arxiv.1411.1784 · Cited by 8,863
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
nuScenes: A Multimodal Dataset for Autonomous Driving
Caesar, H., Bankiti, V., Lang, A. H., Vora, S., Liong, V. E., Xu, Q., Krishnan, A., Pan, Y., Baldan, G., & Beijbom, O. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01164 · Cited by 7,152
Introduction to Reinforcement Learning
Sutton, R. S., & Barto, A. G. (1998) · The MIT Press eBooks · Cited by 6,855
How transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061
Adaptive Mixtures of Local Experts
Jacobs, R. A., Jordan, M. I., Nowlan, S. J., & Hinton, G. E. (1991) · Neural Computation · doi:10.1162/neco.1991.3.1.79 · Cited by 5,384
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
Adversarial Discriminative Domain Adaptation
Tzeng, E., Hoffman, J., Saenko, K., & Darrell, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.316 · Cited by 5,154
(1999) · Cited by 5,147
VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection
Zhou, Y., & Tuzel, O. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00472 · Cited by 4,813
PointPillars: Fast Encoders for Object Detection From Point Clouds
Lang, A. H., Vora, S., Caesar, H., Zhou, L., Yang, J., & Beijbom, O. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01298 · Cited by 4,673
On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation
Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., & Samek, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130140 · Cited by 4,524
CNN Features Off-the-Shelf: An Astounding Baseline for Recognition
Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.131 · Cited by 4,451
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., & Soricut, R. (2019) · arXiv · doi:10.48550/arxiv.1909.11942 · Cited by 4,308
CARLA: An open urban driving simulator
Dosovitskiy, A., Ros, G., Codevilla, F., Lopez, A., & Koltun, V. (2017) · arXiv · doi:10.48550/arxiv.1711.03938 · Cited by 3,718
Grandmaster level in StarCraft II using multi-agent reinforcement learning
Vinyals, O., Babuschkin, I., Czarnecki, W. M., Mathieu, M., Dudzik, A., Chung, J., Choi, D. H., Powell, R., Ewalds, T., Georgiev, P., et al. (2019) · Nature · doi:10.1038/s41586-019-1724-z · Cited by 3,455
Multi-view 3D Object Detection Network for Autonomous Driving
Chen, X., Ma, H., Wan, J., Li, B., & Xia, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.691 · Cited by 3,450
Scalability in Perception for Autonomous Driving: Waymo Open Dataset
Sun, P., Kretzschmar, H., Dotiwalla, X., Chouard, A., Patnaik, V., Tsui, P., Guo, J., Zhou, Y., Chai, Y., Caine, B., et al. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00252 · Cited by 3,437
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 3,416
SECOND: Sparsely Embedded Convolutional Detection
Yan, Y., Mao, Y., & Li, B. (2018) · Sensors · doi:10.3390/s18103337 · Cited by 3,352
A survey of robot learning from demonstration
Argall, B. D., Chernova, S., Veloso, M., & Browning, B. (2009) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2008.10.024 · Cited by 3,227
End to End Learning for Self-Driving Cars
Bojarski, M., Del Testa, D., Dworakowski, D., Firner, B., Flepp, B., Goyal, P., Jackel, L. D., Monfort, M., Muller, U., Zhang, J., et al. (2016) · arXiv · doi:10.48550/arxiv.1604.07316 · Cited by 3,198
Schaul, T., Quan, J., Antonoglou, I., & Silver, D. (2015) · arXiv · doi:10.48550/arxiv.1511.05952 · Cited by 3,120
PointRCNN: 3D Object Proposal Generation and Detection From Point Cloud
Shi, S., Wang, X., & Li, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00086 · Cited by 3,093
BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning
Yu, F., Chen, H., Wang, X., Xian, W., Chen, Y., Liu, F., Madhavan, V., & Darrell, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00271 · Cited by 2,641
A Survey of Motion Planning and Control Techniques for Self-Driving Urban Vehicles
Paden, B., Cap, M., Yong, S. Z., Yershov, D., & Frazzoli, E. (2016) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2016.2578706 · Cited by 2,585
Unsupervised Domain Adaptation by Backpropagation
Ganin, Y., & Lempitsky, V. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.7495 · Cited by 2,521
Torralba, A., & Efros, A. A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995347 · Cited by 2,440
Stanley: The robot that won the DARPA Grand Challenge
Thrun, S., Montemerlo, M., Dahlkamp, H., Stavens, D., Aron, A., Diebel, J., Fong, P., Gale, J., Halpenny, M., Hoffmann, G., et al. (2006) · Journal of Field Robotics · doi:10.1002/rob.20147 · Cited by 2,237
Robust physical-world attacks on deep learning visual classification
Eykholt, K., Evtimov, I., Fernandes, E., Li, B., Rahmati, A., Xiao, C., Prakash, A., Kohno, T., & Song, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00175 · Cited by 2,173
A Reduction of Imitation Learning and Structured Prediction to No-Regret Online Learning
Ross, S., Gordon, G. J., & Bagnell, J. A. (2018) · Carnegie Mellon University · doi:10.1184/r1/6550949 · Cited by 1,941
A Survey of Autonomous Driving: Common Practices and Emerging Technologies
Yurtsever, E., Lambert, J., Carballo, A., & Takeda, K. (2020) · IEEE Access · doi:10.1109/access.2020.2983149 · Cited by 1,889
DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving
Chen, C., Seff, A., Kornhauser, A., & Xiao, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.312 · Cited by 1,876
Data Assimilation Using an Ensemble Kalman Filter Technique
Houtekamer, P. L., & Mitchell, H. L. (1998) · Monthly Weather Review · doi:10.1175/1520-0493(1998)126<0796:dauaek>2.0.co;2 · Cited by 1,864
1 year, 1000 km: The Oxford RobotCar dataset
Maddern, W., Pascoe, G., Linegar, C., & Newman, P. (2017) · The International Journal of Robotics Research · doi:10.1177/0278364916679498 · Cited by 1,632
Feng, D., Haase-Schutz, C., Rosenbaum, L., Hertlein, H., Glaser, C., Timm, F., Wiesbeck, W., & Dietmayer, K. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.2972974 · Cited by 1,425
Predictive Active Steering Control for Autonomous Vehicle Systems
Falcone, P., Borrelli, F., Asgari, J., Tseng, H. E., & Hrovat, D. (2007) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2007.894653 · Cited by 1,408
Towards fully autonomous driving: Systems and algorithms
Levinson, J., Askeland, J., Becker, J., Dolson, J., Held, D., Kammel, S., Kolter, J. Z., Langer, D., Pink, O., Pratt, V., et al. (2011) · 2011 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/ivs.2011.5940562 · Cited by 1,374
ALVINN: An autonomous land vehicle in a neural network
Pomerleau, D. A. (2018) · Carnegie Mellon University · doi:10.1184/r1/6603146.v1 · Cited by 1,340
ALVINN, an autonomous land vehicle in a neural network
Pomerleau, D. (2018) · doi:10.1184/r1/6603146 · Cited by 1,338
PIXOR: Real-time 3D Object Detection from Point Clouds
Yang, B., Luo, W., & Urtasun, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00798 · Cited by 1,249
Kalra, N., & Paddock, S. M. (2016) · Transportation Research Part A: Policy and Practice · doi:10.1016/j.tra.2016.09.010 · Cited by 1,221
DeepXplore: Automated Whitebox Testing of Deep Learning Systems
Pei, K., Cao, Y., Yang, J., & Jana, S. (2017) · Proceedings of the 26th Symposium on Operating Systems Principles · doi:10.1145/3132747.3132785 · Cited by 1,217
DeepTest: automated testing of deep-neural-network-driven autonomous cars
Tian, Y., Pei, K., Jana, S., & Ray, B. (2018) · Proceedings of the 40th International Conference on Software Engineering · doi:10.1145/3180155.3180220 · Cited by 1,217
Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm
Silver, D., Hubert, T., Schrittwieser, J., Antonoglou, I., Lai, M., Guez, A., Lanctot, M., Sifre, L., Kumaran, D., Graepel, T., et al. (2017) · arXiv · doi:10.48550/arxiv.1712.01815 · Cited by 1,102
Data Mining for Imbalanced Datasets: An Overview
Chawla, N. V. (2009) · Data Mining and Knowledge Discovery Handbook · doi:10.1007/978-0-387-09823-4_45 · Cited by 1,082
Dota 2 with Large Scale Deep Reinforcement Learning
OpenAI, :, Berner, C., Brockman, G., Chan, B., Cheung, V., Dębiak, P., Dennison, C., Farhi, D., Fischer, Q., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.06680 · Cited by 1,065
Deep Reinforcement Learning framework for Autonomous Driving
Sallab, A. E., Abdou, M., Perot, E., & Yogamani, S. (2017) · Electronic Imaging · doi:10.2352/issn.2470-1173.2017.19.avm-023 · Cited by 1,045
Junior: The Stanford entry in the Urban Challenge
Montemerlo, M., Becker, J., Bhat, S., Dahlkamp, H., Dolgov, D., Ettinger, S., Haehnel, D., Hilden, T., Hoffmann, G., Huhnke, B., et al. (2008) · Journal of Field Robotics · doi:10.1002/rob.20258 · Cited by 1,027
Planning and Decision-Making for Autonomous Vehicles
Schwarting, W., Alonso-Mora, J., & Rus, D. (2018) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-060117-105157 · Cited by 972
End-to-End Learning of Driving Models from Large-Scale Video Datasets
Xu, H., Gao, Y., Yu, F., & Darrell, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.376 · Cited by 884
A new learning paradigm: Learning using privileged information
Vapnik, V., & Vashist, A. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.06.042 · Cited by 774
ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worst
Bansal, M., Krizhevsky, A., & Ogale, A. (2019) · Robotics: Science and Systems XV · doi:10.15607/rss.2019.xv.031 · Cited by 731
Kendall, A., Hawke, J., Janz, D., Mazur, P., Reda, D., Allen, J.-M., Lam, V.-D., Bewley, A., & Shah, A. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8793742 · Cited by 694
(2018) · arXiv (Cornell University) · Cited by 679
Fairness in Machine Learning: Lessons from Political Philosophy
Binns, R. (2017) · arXiv · doi:10.48550/arxiv.1712.03586 · Cited by 676
Challenges in autonomous vehicle testing and validation
Koopman, P., & Wagner, M. (2016) · SAE International Journal of Transportation Safety · doi:10.4271/2016-01-0128 · Cited by 675
SGPN: Similarity Group Proposal Network for 3D Point Cloud Instance Segmentation
Wang, W., Yu, R., Huang, Q., & Neumann, U. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00272 · Cited by 544
Safe, Multi-Agent, Reinforcement Learning for Autonomous Driving
Shalev-Shwartz, S., Shammah, S., & Shashua, A. (2016) · arXiv · doi:10.48550/arxiv.1610.03295 · Cited by 509
Exploring the Limitations of Behavior Cloning for Autonomous Driving
Codevilla, F., Santana, E., Lopez, A., & Gaidon, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00942 · Cited by 509
Autonomous Robots: From Biological Inspiration to Implementation and Control
Bekey, G. A. (2005) · Cited by 507
Learning driving styles for autonomous vehicles from demonstration
Kuderer, M., Gulati, S., & Burgard, W. (2015) · 2015 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2015.7139555 · Cited by 459
(2005) · neural information processing systems · Cited by 446
End-to-end Interpretable Neural Motion Planner
Zeng, W., Luo, W., Suo, S., Sadat, A., Yang, B., Casas, S., & Urtasun, R. (2021) · arXiv · doi:10.48550/arxiv.2101.06679 · Cited by 406
End-To-End Interpretable Neural Motion Planner
Zeng, W., Luo, W., Suo, S., Sadat, A., Yang, B., Casas, S., & Urtasun, R. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00886 · Cited by 398
High speed obstacle avoidance using monocular vision and reinforcement learning
Michels, J., Saxena, A., & Ng, A. Y. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102426 · Cited by 394
Scaling of End-To-End Governance Risk Assessments for AI Systems (Practitioner Track)
Weimer, D., Gensch, A., & Koller, K. (2025) · OASIcs : OpenAccess Series in Informatics · doi:10.4230/oasics.saia.2024.4 · Cited by 390
Interpretable Learning for Self-Driving Cars by Visualizing Causal Attention
Kim, J., & Canny, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.320 · Cited by 366
Complex-YOLO: An Euler-Region-Proposal for Real-Time 3D Object Detection on Point Clouds
Simon, M., Milz, S., Amende, K., & Gross, H.-M. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11009-3_11 · Cited by 354
The DARPA Urban Challenge: Autonomous Vehicles in City Traffic
(2009) · Springer Tracts in Advanced Robotics · doi:10.1007/978-3-642-03991-1 · Cited by 341
Textual Explanations for Self-Driving Vehicles
Kim, J., Rohrbach, A., Darrell, T., Canny, J., & Akata, Z. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01216-8_35 · Cited by 337
Virtual to Real Reinforcement Learning for Autonomous Driving
Pan, X., You, Y., Wang, Z., & Lu, C. (2017) · Procedings of the British Machine Vision Conference 2017 · doi:10.5244/c.31.11 · Cited by 326 · cited 7×
“in [9]), one might also just explicitly punish crashes by assigning a large negative reward, as was done in [26], [61], [66], [69], [70].”
BackgroundInfluentialCausal Confusion in Imitation Learning
de Haan, P., Jayaraman, D., & Levine, S. (2019) · UvA-DARE (University of Amsterdam) · doi:10.48550/arxiv.1905.11979 · Cited by 323
Multimodal end-to-end autonomous driving
Xiao, Y., Codevilla, F., Gurram, A., Urfalioglu, O., & Lopez, A. M. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3013234 · Cited by 319
Toward Driving Scene Understanding: A Dataset for Learning Driver Behavior and Causal Reasoning
Ramanishka, V., Chen, Y.-T., Misu, T., & Saenko, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00803 · Cited by 314
TORCS, The Open Racing Car Simulator
Espié, E., Guionneau, C., Wymann, B., Dimitrakakis, C., Coulom, R., & Sumner, A. J. (2005) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 313
CIRL: Controllable Imitative Reinforcement Learning for Vision-Based Self-driving
Liang, X., Wang, T., Yang, L., & Xing, E. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_36 · Cited by 285
Car that Knows Before You Do: Anticipating Maneuvers via Learning Temporal Driving Models
Jain, A., Koppula, H. S., Raghavan, B., Soh, S., & Saxena, A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.364 · Cited by 274
Car that Knows Before You Do: Anticipating Maneuvers via Learning Temporal Driving Models
Jain, A., Koppula, H. S., Raghavan, B., Soh, S., & Saxena, A. (2015) · arXiv · doi:10.48550/arxiv.1504.02789 · Cited by 274
The H3D Dataset for Full-Surround 3D Multi-Object Detection and Tracking in Crowded Urban Scenes
Patil, A., Malla, S., Gang, H., & Chen, Y.-T. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8793925 · Cited by 263
Combined longitudinal and lateral control for automated vehicle guidance
Attia, R., Orjuela, R., & Basset, M. (2014) · Vehicle System Dynamics · doi:10.1080/00423114.2013.874563 · Cited by 260
Deep learning algorithm for autonomous driving using GoogLeNet
Al-Qizwini, M., Barjasteh, I., Al-Qassab, H., & Radha, H. (2017) · 2017 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/ivs.2017.7995703 · Cited by 259
Agile Autonomous Driving using End-to-End Deep Imitation Learning
Pan, Y., Cheng, C.-A., Saigol, K., Lee, K., Yan, X., Theodorou, E., & Boots, B. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.056 · Cited by 257
A Modern Take on the Bias-Variance Tradeoff in Neural NetworksPreprint
Neal, B., Mittal, S., Baratin, A., Tantia, V., Scicluna, M., Lacoste-Julien, S., & Mitliagkas, I. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.08591 · Cited by 242
Explaining How a Deep Neural Network Trained with End-to-End Learning Steers a Car
Bojarski, M., Yeres, P., Choromanska, A., Choromański, K., Firner, B., Jackel, L. D., & Müller, U. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.07911 · Cited by 223
IntentNet: Learning to Predict Intention from Raw Sensor Data
Casas, S., Luo, W., & Urtasun, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.07907 · Cited by 218
Urban Driving with Conditional Imitation Learning
Hawke, J., Shen, R., Gurău, C., Sharma, S., Reda, D., Nikolov, N., Mazur, P., Micklethwaite, S., Griffiths, N., Shah, A., et al. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197408 · Cited by 215
BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning
Yu, F., Chen, H., Wang, X., Xian, W., Chen, Y., Liu, F., Madhavan, V., & Darrell, T. (2018) · arXiv · doi:10.48550/arxiv.1805.04687 · Cited by 204
Can Autonomous Vehicles Identify, Recover From, and Adapt to Distribution Shifts?Preprint
Filos, A., Tigas, P., McAllister, R., Rhinehart, N., Levine, S., & Gal, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.14911 · Cited by 196
End-to-End Learning of Driving Models with Surround-View Cameras and Route Planners
Hecker, S., Dai, D., & Van Gool, L. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_27 · Cited by 191
Santana, E., & Hotz, G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.01230 · Cited by 174
Driving Policy Transfer via Modularity and Abstraction
Müller, M., Dosovitskiy, A., Ghanem, B., & Koltun, V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.09364 · Cited by 166
Grounding Human-To-Vehicle Advice for Self-Driving Vehicles
Kim, J., Misu, T., Chen, Y.-T., Tawari, A., & Canny, J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01084 · Cited by 160
Learning how to drive in a real world simulation with deep Q-Networks
Wolf, P., Hubschneider, C., Weber, M., Bauer, A., Hartl, J., Dürr, F., & Zöllner, J. M. (2017) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2017.7995727 · Cited by 151
Variational End-to-End Navigation and Localization
Amini, A., Rosman, G., Karaman, S., & Rus, D. L. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793579 · Cited by 149
Bézier curve based path planning for autonomous vehicle in urban environment
Han, L., Yashiro, H., Nejad, H. T. N., Huy, Q., & Mita, S. (2010) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2010.5548085 · Cited by 144
Learning to Drive from Simulation without Real World Labels
Bewley, A., Rigley, J., Liu, Y., Hawke, J., Shen, R., Lam, V.-D., & Kendall, A. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793668 · Cited by 138
LiDAR-Video Driving Dataset: Learning Driving Policies Effectively
Chen, Y., Wang, J., Li, J., Lu, C., Luo, Z., Xue, H., & Wang, C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00615 · Cited by 131
End-to-End Driving Via Conditional Imitation Learning
Codevilla, F., Muller, M., Lopez, A., Koltun, V., & Dosovitskiy, A. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460487 · Cited by 129
Does computer vision matter for action?
Zhou, B., Krähenbühl, P., & Koltun, V. (2019) · Science Robotics · doi:10.1126/scirobotics.aaw6661 · Cited by 126
Query-Efficient Imitation Learning for End-to-End Autonomous Driving
Zhang, J., & Cho, K. (2016) · arXiv · doi:10.48550/arxiv.1605.06450 · Cited by 118
Simulation-Based Reinforcement Learning for Real-World Autonomous Driving
Osiński, B., Jakubowski, A., Ziecina, P., Milos, P., Galias, C., Homoceanu, S., & Michalewski, H. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9196730 · Cited by 118
Evolving deep unsupervised convolutional networks for vision-based reinforcement learning
Koutník, J., Schmidhuber, J., & Gomez, F. J. (2014) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2576768.2598358 · Cited by 115
VR-Goggles for Robots: Real-to-Sim Domain Adaptation for Visual Control
Zhang, J., Tai, L., Yun, P., Xiong, Y., Liu, M., Boedecker, J., & Burgard, W. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2894216 · Cited by 109 · cited 2×
“Conversely, real images can be transformed into simulationlike images via a cGAN [77].”
BackgroundMethodVisualBackProp: Efficient Visualization of CNNs for Autonomous Driving
Bojarski, M., Choromanska, A., Choromański, K., Firner, B., Ackel, L. J., Müller, U., Yeres, P., & Zieba, K. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8461053 · Cited by 104
On Offline Evaluation of Vision-Based Driving Models
Codevilla, F., López, A. M., Koltun, V., & Dosovitskiy, A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01267-0_15 · Cited by 103
MultiNet: Multi-Modal Multi-Task Learning for Autonomous Driving
Chowdhuri, S., Pankaj, T., & Zipser, K. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00164 · Cited by 101
DDD17: End-To-End DAVIS Driving Dataset
Binas, J., Neil, D., Liu, S.-C., & Delbruck, T. (2017) · arXiv · doi:10.48550/arxiv.1711.01458 · Cited by 96
Failure Prediction for Autonomous Driving
Hecker, S., Dai, D., & Gool, L. V. (2018) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2018.8500495 · Cited by 95
Wood, J. M. (2002) · Clinical and Experimental Optometry · doi:10.1111/j.1444-0938.2002.tb03040.x · Cited by 93
Learning to Drive a Real Car in 20 Minutes
Riedmiller, M., Montemerlo, M., & Dahlkamp, H. (2007) · Frontiers in Convergence of Bioscience and Information Technologies · doi:10.1109/fbit.2007.37 · Cited by 92
Efficient Black-box Assessment of Autonomous Vehicle SafetyPreprint
Norden, J. G., O’Kelly, M., & Sinha, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.03618 · Cited by 86
LIDAR-based driving path generation using fully convolutional neural networks
Caltagirone, L., Bellone, M., Svensson, L., & Wahde, M. (2017) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2017.8317618 · Cited by 77
Instance Segmentation of LiDAR Point Clouds
Zhang, F., Guan, C., Fang, J., Bai, S., Yang, R., Torr, P. H. S., & Prisacariu, V. A. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9196622 · Cited by 72
End-To-End Multi-Modal Sensors Fusion System For Urban Automated Driving
Sobh, I., Amin, L., Abdelkarim, S., Elmadawy, K., Saeed, M. S. R., Abdeltawab, O., Gamal, M., & Sallab, A. E. (2018) · Cited by 69
A Commute in Data: The comma2k19 Dataset
Schafer, H., Santana, E., Haden, A., & Biasini, R. (2018) · arXiv · doi:10.48550/arxiv.1812.05752 · Cited by 48
OIL: Observational Imitation Learning
Li, G., Mueller, M. F., Casser, V., Smith, N., Michels, D. L., & Ghanem, B. (2019) · Robotics: Science and Systems · doi:10.15607/rss.2019.xv.005 · Cited by 47
Aggressive Deep Driving: Model Predictive Control with a CNN Cost ModelPreprint
Drews, P., Williams, G., Goldfain, B., Theodorou, E. A., & Rehg, J. M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.05303 · Cited by 39
Learning Accurate, Comfortable and Human-like DrivingPreprint
Hecker, S., Dai, D., & Gool, L. V. (2019) · Lirias · doi:10.48550/arxiv.1903.10995 · Cited by 29
Robot Operating System (ROS): The Complete Reference (Volume 4)
Koubâa, A. (2019) · Studies in computational intelligence · doi:10.1007/978-3-030-20190-6 · Cited by 26
Early Failure Detection of Deep End-to-End Control Policy by Reinforcement Learning
Lee, K., Saigol, K., & Theodorou, E. A. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8794189 · Cited by 9
Towards a Robust Software Architecture for Autonomous Robot Software
(2017) · International Workshop on Computer Science and Engineering (WCSE) · doi:10.18178/wcse.2017.06.209 · Cited by 3
Cited by
End-to-End Autonomous Driving: Challenges and Frontiers
Chen, L., Wu, P., Chitta, K., Jaeger, B., Geiger, A., & Li, H. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3435937 · Cited by 610
Motion Planning for Autonomous Driving: The State of the Art and Future Perspectives
Teng, S., Hu, X., Deng, P., Li, B., Li, Y., Ai, Y., Yang, D., Li, L., Xuanyuan, Z., Zhu, F., et al. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3274536 · Cited by 590
Milestones in Autonomous Driving and Intelligent Vehicles: Survey of Surveys
Chen, L., Li, Y., Huang, C., Li, B., Xing, Y., Tian, D., Li, L., Hu, Z., Na, X., Li, Z., et al. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2022.3223131 · Cited by 511
Computing Systems for Autonomous Driving: State of the Art and Challenges
Liu, L., Lu, S., Zhong, R., Wu, B., Yao, Y., Zhang, Q., & Shi, W. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3043716 · Cited by 450
Autonomous driving system: A comprehensive survey
Zhao, J., Zhao, W., Deng, B., Wang, Z., Zhang, F., Zheng, W., Cao, W., Nan, J., Lian, Y., & Burke, A. F. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122836 · Cited by 361
Metadata
- Authors
- Tampuu, A., Matiisen, T., Semikin, M., Fishman, D., & Muhammad, N.
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2022-04
- Volume
- 33
- Issue
- 4
- Pages
- 1364-1384
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W3011462663
- Cited by
- 291
- References
- 139
- FWCI
- 10.28
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.