The DOI matches its Crossref record; 57 of the 61 references it cites were found in a registry or an index.
MP3: A Unified Model to Map, Perceive, Predict and Plan
Open accessAbstract
High-definition maps (HD maps) are a key component of most modern self-driving systems due to their valuable semantic and geometric information. Unfortunately, building HD maps has proven hard to scale due to their cost as well as the requirements they impose in the localization system that has to work everywhere with centimeter-level accuracy. Being able to drive without an HD map would be very beneficial to scale self-driving solutions as well as to increase the failure tolerance of existing ones (e.g., if localization fails or the map is not up-to-date). Towards this goal, we propose MP3, an end-to-end approach to mapless1driving where the input is raw sensor data and a high-level command (e.g., turn left at the intersection). MP3 predicts intermediate representations in the form of an online map and the current and future state of dynamic agents, and exploits them in a novel neural motion planner to make interpretable decisions taking into account uncertainty. We show that our approach is significantly safer, more comfortable, and can follow commands better than the baselines in challenging long-term closed-loop simulations, as well as when compared to an expert driver in a large-scale real-world dataset.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These works have shown that MTL achieves better data utilization at lower computation cost.”
From Towards learning-based planning: The nuPlan benchmark for real-world autonomous driving (2024) · cites this paper as [58]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
Self-citationMulti-scale context aggregation by dilated convolutions
Yu, F., & Koltun, V. (2015) · arXiv · doi:10.48550/arxiv.1511.07122 · Cited by 7,738
Congested traffic states in empirical observations and microscopic simulations
Treiber, M., Hennecke, A., & Helbing, D. (2000) · Physical Review E · doi:10.1103/physreve.62.1805 · Cited by 4,762
PointPillars: Fast Encoders for Object Detection From Point Clouds
Lang, A. H., Vora, S., Caesar, H., Zhou, L., Yang, J., & Beijbom, O. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01298 · Cited by 4,673
End to End Learning for Self-Driving Cars
Bojarski, M., Del Testa, D., Dworakowski, D., Firner, B., Flepp, B., Goyal, P., Jackel, L. D., Monfort, M., Muller, U., Zhang, J., et al. (2016) · arXiv · doi:10.48550/arxiv.1604.07316 · Cited by 3,198
Using occupancy grids for mobile robot perception and navigation
Elfes, A. (1989) · Computer · doi:10.1109/2.30720 · Cited by 2,287
A Reduction of Imitation Learning and Structured Prediction to No-Regret Online Learning
Ross, S., Gordon, G. J., & Bagnell, J. A. (2018) · Carnegie Mellon University · doi:10.1184/r1/6550949 · Cited by 1,941
ALVINN, an autonomous land vehicle in a neural network
Pomerleau, D. (2018) · doi:10.1184/r1/6603146 · Cited by 1,369
Lift, Splat, Shoot: Encoding Images from Arbitrary Camera Rigs by Implicitly Unprojecting to 3D
Philion, J., & Fidler, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58568-6_12 · Cited by 1,271
PIXOR: Real-time 3D Object Detection from Point Clouds
Yang, B., Luo, W., & Urtasun, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00798 · Cited by 1,249
Self-citation
Flagged first, then by citations
4 of the 61 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- zhao, 2019, Multiagent tensor fusion for contextual trajectory prediction, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 12126
Cited by
Sorted by citations
Items 201–228 of 228
Enhanced and Pruned Motion Planning Based on Bird’s-Eye View
Si, G., Shi, C., & Wang, Y. (2024) · Communications in computer and information science · doi:10.1007/978-981-97-8749-4_11
MAPLE: A Modularized Framework for Learning-Based Planners to Integrate Prediction
Wen, Z., Zhou, Z., Chen, X., Wang, J., Li, Y., & Huang, Y.-K. (2025) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2025.3577923
Mannocci, E., Poggi, M., & Mattoccia, S. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11128822
Translating Images to Road Network: A Sequence-to-Sequence Perspective
Lu, J., Nie, M., Zhang, B., Peng, R., Cai, X., Xu, H., Wen, F., Zhang, W., & Zhang, L. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3612940
Enhancing Online HD Map Construction via Point-Level Spatially Consistent SD Map Encoding
Jin, J., Liu, B., Ding, Z., Gan, T., & Ling, Q. (2025) · Chinese Control Conference (CCC) · doi:10.23919/ccc64809.2025.11179545
Drive&Gen: Co-Evaluating End-to-End Driving and Video Generation Models
Wang, J., Yang, Z., Bai, Y., Li, Y., Zou, Y., Sun, B., Kundu, A., Lezama, J., Huang, L. Y., Zhu, Z., et al. (2025) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros60139.2025.11247678 · Cited by 2
Liu, K., Wang, H., Chen, S., Fu, Y., Lei, Y., & Wang, Y. (2025) · International Journal of Computational Intelligence Systems · doi:10.1007/s44196-025-01111-z
E2E-V2X-CP: An Efficient Cooperative Perception Method for End-To-End Autonomous Driving
Zhang, J., Long, F., Li, M. J., & Zhou, X. (2025) · IEEE International Conference on Smart Internet of Things (SmartIoT) · doi:10.1109/smartiot66867.2025.00044
Khan, R., & Gauch, J. M. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00481
From Static to Dynamic: A Survey of Topology-Aware Perception in Autonomous Driving
Chen, Y., Yang, R., Chen, X., He, J., Xu, D., & Yao, Y. (2025) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw69036.2025.00475
Wang, Y., Wang, T., Liu, Q., Fan, W., Jiao, J., Claudel, C., Yan, Y., Gao, B., Wang, J., & Chen, H. (2026) · Communications in Transportation Research · doi:10.26599/commtr.2026.9640012
Towards Safer End-to-End Urban Driving: A World Model-Based Approach with Enhanced Safety
Geng, J., Du, J., Li, Y., Li, S., & Huang, Y. (2025) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc60802.2025.11423547
Xiang, T., Wang, Z., Li, D., & Chen, P. (2025) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc60802.2025.11423200
Smart vehicule trajectory prediction in various autonomous driving scenarios
Gilles, T. (2023) · theses.fr (ABES) · doi:10.70675/2a784380z6b08z4daez964cz706f7921af08
Dual-Drive: A Hierarchical Fusion Framework for Dual-Model Safety-Enhanced Autonomous Driving
Wang, J., Xu, H., Zheng, X., Wang, H., Li, Z., & Liang, H. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11462833
CNDM: Customized Noise Diffusion Model for Trajectory Prediction
Chang, E., Fu, J., Gao, W., Chen, S., Xin, J., & Zheng, N. (2026) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2026.3681222
Ying, S., & He, S. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7008718
PriorEye: Geospatial Visual Priors for End-to-End Autonomous Driving
Yeon, K., Ramtoula, B., & Martini, D. D. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37016-7_36 · Cited by 1
Lemnariu, R. F., Morris, B., & Muntean, I. (2026) · IEEE International Conference on Automation, Quality and Testing, Robotics (AQTR) · doi:10.1109/aqtr70159.2026.11577855
Mei, Y., Liu, B., Li, W., & Wang, Y. (2026) · International Journal of Intelligent Transportation Systems Research · doi:10.1007/s13177-026-00692-z
PlanFlow: Local trajectory planning for autonomous driving using Flow-guided occupancy grids
Salazar-Gomez, G., Spalanzani, A., Rummelhard, L., & Laugier, C. (2026) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv66570.2026.11624088
PlanTRansformer: Unified Prediction and Planning with Goal-conditioned Transformer
Selzer, C., & Flohr, F. B. (2026) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv66570.2026.11624123
TopoMLP++: Toward Strong and Scalable Lane Topology Reasoning in Autonomous Driving
Wu, D., Han, W., Xu, C., & Shen, J. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3721163
A Liouville Equation-Based Hybrid Method for Uncertainty-Aware Vehicle Motion Prediction
Miao, M., Zhang, S., Yin, Z., Kuang, Y., Nie, L., & Yao, C. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3732894
Xin, Y. (2026) · Artificial Intelligence and Robotics Research · doi:10.12677/airr.2026.155108
Mind the Margin: Safety- and Physical-Aware Planning for End-to-End Autonomous Driving
Xiong, Q., Zhang, J., Hu, C., Chen, H., & Hu, L. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3734856
TriO: Tri-Modal Unsupervised Occupancy World Model for Anything Perception
Sykora, Q., Biswas, S., Diehl, C., Cunningham, A., Gilles, T., & Urtasun, R. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37531-5_18
Self-citationLu, Z., Liao, L., 高良鹏, Cai, S., & Wang, F. (2026) · Smart innovation, systems and technologies · doi:10.1007/978-3-032-30756-9_19
Metadata
- Authors
- Casas, S., Sadat, A., & Urtasun, R.
- Affiliations
- University of Toronto (CA)
- Venue
- 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2021-06
- Pages
- 14398-14407
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W3125926538
- Cited by
- 228
- References
- 61
- Citations by year
- 2026: 17 · 2025: 49 · 2024: 59 · 2023: 59 · 2022: 34 · 2021: 10
- FWCI
- 40.11
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Keywords
- autonomous vehicles, end-to-end driving, online maps, decision making under uncertainty, high-definition maps, closed-loop simulation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
