The DOI matches its Crossref record; 40 of the 41 references it cites were found in a registry or an index.
End-to-End Driving Via Conditional Imitation Learning
Open accessAbstract
Deep networks trained on demonstrations of human driving have learned to follow roads and avoid obstacles. However, driving policies trained via imitation learning cannot be controlled at test time. A vehicle trained end-to-end to imitate an expert cannot be guided to take a specific turn at an upcoming intersection. This limits the utility of such systems. We propose to condition imitation learning on high-level command input. At test time, the learned driving policy functions as a chauffeur that handles sensorimotor coordination but continues to respond to navigational commands. We evaluate different architectures for conditional imitation learning in vision-based driving. We conduct experiments in realistic three-dimensional simulations of urban driving and on a 1/5 scale robotic truck that is trained to drive in a residential area. Both systems drive based on visual input yet remain responsive to high-level navigational commands.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In this era, IL using real-world demonstration data has become one of the most popular and robust control algorithms in research and industry [59,60].”
From Data-Driven Robotic Manipulation of Cloth-like Deformable Objects: The Present, Challenges and Future Prospects (2023) · cites this paper as [60]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
CARLA: An open urban driving simulator
Dosovitskiy, A., Ros, G., Codevilla, F., Lopez, A., & Koltun, V. (2017) · arXiv · doi:10.48550/arxiv.1711.03938 · Cited by 3,718
Self-citationA survey of robot learning from demonstration
Argall, B. D., Chernova, S., Veloso, M., & Browning, B. (2009) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2008.10.024 · Cited by 3,227
End to End Learning for Self-Driving Cars
Bojarski, M., Del Testa, D., Dworakowski, D., Firner, B., Flepp, B., Goyal, P., Jackel, L. D., Monfort, M., Muller, U., Zhang, J., et al. (2016) · arXiv · doi:10.48550/arxiv.1604.07316 · Cited by 3,198
Reinforcement learning in robotics: A survey
Kober, J., Bagnell, J. A., & Peters, J. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913495721 · Cited by 3,160
Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning
Sutton, R. S., Precup, D., & Singh, S. (1999) · Artificial Intelligence · doi:10.1016/s0004-3702(99)00052-1 · Cited by 3,119
A Survey of Motion Planning and Control Techniques for Self-Driving Urban Vehicles
Paden, B. A., Čáp, M., Yong, S. Z., Yershov, D. S., & Frazzoli, E. (2016) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2016.2578706 · Cited by 2,724
A Reduction of Imitation Learning and Structured Prediction to No-Regret Online Learning
Ross, S., Gordon, G. J., & Bagnell, J. A. (2018) · Carnegie Mellon University · doi:10.1184/r1/6550949 · Cited by 1,941
DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving
Chen, C., Seff, A., Kornhauser, A., & Xiao, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.312 · Cited by 1,876
Maximum Entropy Inverse Reinforcement Learning
Ziebart, B. D., Maas, A. L., Bagnell, J. A., & Dey, A. K. (2018) · doi:10.1184/r1/6555512 · Cited by 1,868
Flagged first, then by citations
1 of the 41 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- laskey, 2017, Dart: Optimizing noise injection in imitation learning, Conference on Robot Learning (CoRL)
Cited by
Sorted by citations
Items 101–143 of 143
Visual Odometry for Self-Driving with Multihypothesis and Network Prediction
Chen, Y., Mei, Y., & Wan, S.-F. (2021) · Mathematical Problems in Engineering · doi:10.1155/2021/1930881 · Cited by 4
Yu, C.-H., & Wang, S. (2025) · Statistics and data science in imaging. · doi:10.1080/29979676.2025.2497555 · Cited by 3
Silva, I. J., Vilão, C. O., Costa, A. H. R., & Bianchi, R. A. C. (2021) · Journal of Control Automation and Electrical Systems · doi:10.1007/s40313-021-00719-8 · Cited by 3
Learning Mixture of Domain-Specific Experts via Disentangled Factors for Autonomous Driving
Kim, I., Lee, J., & Kim, D. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.20000 · Cited by 3
Nguyen, T. T., Perschewski, J.-O., Engel, F., Krüsemann, J., Sitzmann, J., Spehr, J., Zug, S., & Kruse, R. (2019) · Information fusion and data science · doi:10.1007/978-3-030-03643-0_18 · Cited by 3
Deep reinforcement learning with external control
Youssef, F., & Benbrahim, H. (2019) · International Conference on Smart City Applications (SCA) · doi:10.1145/3368756.3369038 · Cited by 3
Multi-modal Experts Network for Autonomous Driving
Fang, S., & Choromanska, A. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197459 · Cited by 3
3D Road Boundary Estimation using 3D LiDAR with Scanline-wise 1D Deep Feature and Particle Filtering
Nakayama, Y., & Miura, J. (2021) · European Conference on Mobile Robots · doi:10.1109/ecmr50962.2021.9568784 · Cited by 3
ISA$^2$: Intelligent Speed Adaptation from AppearancePreprint
Herranz-Perdiguero, C., & López-Sastre, R. J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.05016 · Cited by 3
Zhang, S., Wu, Y., Ogai, H., & Tateno, S. (2022) · IEEE Vehicular Technology Conference · doi:10.1109/vtc2022-fall57202.2022.10013060 · Cited by 2
USN: A Robust Imitation Learning Method against Diverse Action Noise
Yu, X., Han, B., & Tsang, I. W.-H. (2024) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.15819 · Cited by 2
Testing the Channels of Convolutional Neural Networks
Choi, K. Y., Son, D., Kim, Y., & Seo, J. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i12.26726 · Cited by 2
Oh, J., Lee, G., Park, J., Oh, W., Heo, J., Chung, H., Kim, D., Park, B., Lee, C.-G., Choi, S., et al. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981110 · Cited by 2
Kwak, J., Park, J. H., & Sung, Y. (2019) · Multimedia Tools and Applications · doi:10.1007/s11042-019-7703-4 · Cited by 2
Autonomous Vehicle Simulation Using Deep Reinforcement Learning
Kadam, R., Vidhani, V., Valecha, B., Bane, A., & Giri, N. (2020) · Lecture notes in networks and systems · doi:10.1007/978-981-15-7106-0_53 · Cited by 2
End to End Vehicle Lateral Control Using a Single Fisheye CameraPreprint
Toromanoff, M., Wirbel, É., Wilhelm, F., Vejarano, C., Perrotton, X., & Moutarde, F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.06940 · Cited by 2
Smile Like You Mean It: Driving Animatronic Robotic Face with Learned ModelsPreprint
Chen, B., Hu, Y., Li, L., Cummings, S., & Lipson, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.12724 · Cited by 2
Iterative Imitation Policy Improvement for Interactive Autonomous DrivingPreprint
Yin, Z.-H., Li, C., Sun, L., Tomizuka, M., & Zhan, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.01288 · Cited by 2
Semantic Segmentation Algorithm for Autonomous Driving using UNET Architectures: A Comparative StudyPreprint
Subhedar, J., Bachute, M. R., Koundal, D., & Kotecha, K. V. (2023) · Research Square · doi:10.21203/rs.3.rs-2928293/v1 · Cited by 2
End-to-End Learning for Autonomous Driving in Secured Smart Cities
Guo, D., Moh, M., & Moh, T.-S. (2021) · Advanced sciences and technologies for security applications · doi:10.1007/978-3-030-72139-8_11 · Cited by 1
Augmenting Imitation Experience via Equivariant Representations
Sharma, D., Kuwajerwala, A., & Shkurti, F. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9811885 · Cited by 1
Key Factors that Negatively Affect Performance of Imitation Learning for Autonomous Driving
Rijanto, E., Changgraini, N., Saputra, R. P., & Abidin, Z. (2024) · Journal of Robotics and Control (JRC) · doi:10.18196/jrc.v5i1.20371 · Cited by 2
Zhang, Z., Liu, Z., Miao, Y., & Ma, X. (2024) · Robotic Intelligence and Automation · doi:10.1108/ria-09-2023-0128 · Cited by 1
Zhang, G., Huo, C., & Yuan, J. (2019) · International Conference on Communication and Information Processing (ICCIP) · doi:10.1145/3369985.3370039 · Cited by 1
On Offline Evaluation of Vision-based Driving ModelsPreprint
Codevilla, F., López, A. M., Koltun, V., & Dosovitskiy, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.04843 · Cited by 1
Self-citationKadi, H. A., & Terzić, K. (2022) · Preprints.org · doi:10.20944/preprints202212.0305.v1 · Cited by 1
Paniego, S., Calvo-Palomino, R., & Cañas, J. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4715284 · Cited by 1
Shared Multi-Task Imitation Learning for Indoor Self-NavigationPreprint
Xu, J., Liu, Q., Guo, H., Kageza, A., AlQarni, S., & Wu, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.04503
Simulation and Learning for Urban Mobility: City-scale Traffic Reconstruction and Autonomous DrivingPreprint
Li, W. (2019) · arXiv (Cornell University) · doi:10.17615/5pyr-e388
Adaptive versus Standard Descent Methods and Robustness Against Adversarial ExamplesPreprint
Khoury, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.03784
Applying External Guidance Commands to Deep Reinforcement Learning for Autonomous Driving
Youssef, F., & Benbrahim, H. (2020) · Lecture notes in intelligent transportation and infrastructure · doi:10.1007/978-3-030-37629-1_60
Study and Generalization on an End-to-End Spatial-temporal Driving Model
Yao, T., Chen, X., Yuan, S., Wang, H., Guo, L., Tian, B., & Ai, Y. (2019) · Chinese Automation Congress · doi:10.1109/cac48633.2019.8996594
Urban Driving Based on Condition Imitation Learning and Multi-Period Information Fusion
Ge, B., Yang, B., & Wang, Q. (2020) · International Conference on Computing and Artificial Intelligence (ICCAI) · doi:10.1145/3404555.3404639
de Morais, G. A. P. (2020) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.18.2020.tde-25082020-092618
Generating Goal-conditioned Sub-goals for Hierarchical Learning
Choi, J., & Seo, S. (2022) · International Conference on Electronics, Information, and Communication (ICEIC) · doi:10.1109/iceic54506.2022.9748203
Performance monitoring of deep learning vision systems during deployment
Rahman, Q. M. (2022) · Queensland University of Technology · doi:10.5204/thesis.eprints.229733
Maniobra de rebase para vehículos autónomos usando una red neuronal convolucional
González-Miranda, Ó., Arellano-Aguilar, R. S., & Zannatha, J. M. I. (2022) · PÄDI Boletín Científico de Ciencias Básicas e Ingenierías del ICBI · doi:10.29057/icbi.v10iespecial4.9333
Optimal Path Planning for Aerial Robots Using Genetic Algorithm
Juan, A. P. I. (2023) · doi:10.33915/etd.11811
Imitation Reinforcement Learning with Vision and Navigation for Autonomous DrivingPreprint
He, L., Ba, M., Wang, Y., & Han, L. (2023) · doi:10.22541/au.169957038.84697482/v1
Dissipative imitation learning for discrete dynamic output feedback control with sparse data sets
Strong, A. K., LoCicero, E. J., & Bridgeman, L. J. (2024) · International Journal of Robust and Nonlinear Control · doi:10.1002/rnc.7398
Few-shot decision-making method for high-speed driving based on large model architecture
Yu, Y., Guan, J., Cheng, L., Li, Y., & Xu, Y. (2024) · Asia Conference on Algorithms, Computing and Machine Learning (CACML) · doi:10.1145/3654823.3654894
Zhang, Z., Nair, S., Liu, Z., Miao, Y., & Ma, X. (2024) · Robotic Intelligence and Automation · doi:10.1108/ria-08-2023-0109
Metadata
- Authors
- Codevilla, F., Muller, M., Lopez, A., Koltun, V., & Dosovitskiy, A.
- Affiliations
- Universitat Autònoma de Barcelona (ES)
- King Abdullah University of Science and Technology (SA)
- Intel (United States) (US)
- Venue
- 2018 IEEE International Conference on Robotics and Automation (ICRA)
- Publisher
- IEEE
- Published
- 2018-05
- Pages
- 4693-4700
- ISSN
- 1050-4729 (ISSN-L)
- OpenAlex
- W2760878839
- Cited by
- 129
- References
- 41
- Citations by year
- 2025: 3 · 2024: 9 · 2023: 11 · 2022: 18 · 2021: 29 · 2020: 22 · 2019: 23 · 2018: 10
- FWCI
- 21.53
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Proceedings - IEEE International Conference on Robotics and Automation/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- King Abdullah University of Science and Technology Repository (King Abdullah University of Science and Technology) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Centres de Recerca de Catalunya
- Generalitat de Catalunya
- Topics
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- end-to-end driving, vision-based driving, autonomous vehicles, sensorimotor coordination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
