CommonRoad: Composable benchmarks for motion planning on roads
Open accessThe DOI matches its Crossref record; 51 of the 52 references it cites were found in a registry or an index.
Abstract
Numerical experiments for motion planning of road vehicles require numerous components: vehicle dynamics, a road network, static obstacles, dynamic obstacles and their movement over time, goal regions, a cost function, etc. Providing a description of the numerical experiment precise enough to reproduce it might require several pages of information. Thus, only key aspects are typically described in scientific publications, making it impossible to reproduce results - yet, re-producibility is an important asset of good science. Composable benchmarks for motion planning on roads (CommonRoad) are proposed so that numerical experiments are fully defined by a unique ID; all information required to reconstruct the experiment can be found on the CommonRoad website. Each benchmark is composed by a vehicle model, a cost function, and a scenario (including goals and constraints). The scenarios are partly recorded from real traffic and partly hand-crafted to create dangerous situations. We hope that CommonRoad saves researchers time since one does not have to search for realistic parameters of vehicle dynamics or realistic traffic situations, yet provides the freedom to compose a benchmark that fits one's needs.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“With the exception of nuPlan and CommonRoad [12], all datasets focus on prediction (motion forecasting).”
From Towards learning-based planning: The nuPlan benchmark for real-world autonomous driving (2024) · cites this paper as [12]
In the citing paper
“However, CommonRoad [12] does not provide a real world dataset as the basis for the simulation, instead resorting to a small number of manually crafted scenarios and tools to import other datasets, albeit without any sensor data.”
From Towards learning-based planning: The nuPlan benchmark for real-world autonomous driving (2024) · cites this paper as [12]
Citations
Cites
Vision meets robotics: The KITTI dataset
Geiger, A., Lenz, P., Stiller, C., & Urtasun, R. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913491297 · Cited by 9,913 · cited 1×
“One of the most successful automotive benchmarks is the KITTI benchmark targeting computer vision [24].”
BackgroundRajamani, R. (2012) · Mechanical Engineering Series · doi:10.1007/978-1-4614-1433-9 · Cited by 4,401
A Survey of Motion Planning and Control Techniques for Self-Driving Urban Vehicles
Paden, B., Cap, M., Yong, S. Z., Yershov, D., & Frazzoli, E. (2016) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2016.2578706 · Cited by 2,585 · cited 1×
“Tire slip is not considered, but the kinematic singletrack model can be used when the vehicle does not operate close to its physical capabilities [26], [35].”
BackgroundThe Open Motion Planning Library
Sucan, I. A., Moll, M., & Kavraki, L. E. (2012) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2012.2205651 · Cited by 1,616 · cited 1×
“…but the data has never been or is no longer publicly available, e.g. [13]–[15]. c) Motion planning libraries: One of the most successful motion planning libraries in robotics is the Open Motion Planning Library (OMPL) [16], which implements many of the most important sampling-based approaches.”
BackgroundOptimal paths for a car that goes both forwards and backwards
Reeds, J., & Shepp, L. (1990) · Pacific Journal of Mathematics · doi:10.2140/pjm.1990.145.367 · Cited by 1,447 · cited 1×
“We have not included Dubin or Reeds-Shepp cars since they require changing the steering angle infinitely fast (see e.g. [31]).”
BackgroundCHOMP: Gradient optimization techniques for efficient motion planning
Ratliff, N., Zucker, M., Bagnell, J. A., & Srinivasa, S. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152817 · Cited by 992 · cited 1×
“…techniques, there also exists the Covariant Hamiltonian Optimization for Motion Planning (CHOMP) library for gradient-based optimization techniques [23]. d) Automotive benchmarks beyond motion planning: One of the most successful automotive benchmarks is the KITTI benchmark targeting computer…”
BackgroundOptimal trajectory generation for dynamic street scenarios in a Frenét Frame
Werling, M., Ziegler, J., Kammel, S., & Thrun, S. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509799 · Cited by 801 · cited 2×
“• Acceleration : [44, Sec.”
Automated vehicle control developments in the PATH program
Shladover, S. E., Desoer, C. A., Hedrick, J. K., Tomizuka, M., Walrand, J., Zhang, W.-B., McMahon, D. H., Peng, H., Sheikholeslam, S., & McKeown, N. (1991) · IEEE Transactions on Vehicular Technology · doi:10.1109/25.69979 · Cited by 786 · cited 1×
“For adaptive cruise control in particular, numerous works already exist that realize a commanded acceleration, see e.g. [27], [28].”
BackgroundA system for learning statistical motion patterns
Hu, W., Xiao, X., Fu, Z., Xie, D., Tan, T., & Maybank, S. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.176 · Cited by 544 · cited 1×
“Another class of works provides results on recorded data, but the data has never been or is no longer publicly available, e.g. [13]–[15]. c) Motion planning libraries: One of the most successful motion planning libraries in robotics is the Open Motion Planning Library (OMPL) [16], which implements…”
BackgroundPunzo, V., Borzacchiello, M. T., & Ciuffo, B. (2011) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2010.12.007 · Cited by 484 · cited 1×
“One of the most popular datasets of recorded traffic participants is from the Next Generation Simulation (NGSIM) program [10], [11].”
BackgroundChitta, S., Sucan, I., & Cousins, S. (2012) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2011.2181749 · Cited by 466
OpenRAVE: A Planning Architecture for Autonomous Robotics
Diankov, R., & Kuffner, J. (2008) · Cited by 461
Trajectory planning for Bertha — A local, continuous method
Ziegler, J., Bender, P., Dang, T., & Stiller, C. (2014) · 2014 IEEE Intelligent Vehicles Symposium Proceedings · doi:10.1109/ivs.2014.6856581 · Cited by 443 · cited 2×
“• Yaw rate : 2 d t , where d is the distance to the lane center or a driving corridor (see [43,”
BackgroundManeuver-based motion planning for nonlinear systems with symmetries
Frazz, E., Dahleh, M. A., & Feron, E. (2005) · IEEE Transactions on Robotics · doi:10.1109/tro.2005.852260 · Cited by 440 · cited 1×
“uses motion primitives that span a search tree [22].”
MethodGoldfeder, C., Ciocarlie, M., Dang, H., & Allen, P. K. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152709 · Cited by 309 · cited 1×
“Detailed benchmarks have been developed in particular for robotic grasping [7], [8] and for robotic manipulators with a focus on indoor human environments [9].”
BackgroundModel-Based Probabilistic Collision Detection in Autonomous Driving
Althoff, M., Stursberg, O., & Buss, M. (2009) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2009.2018966 · Cited by 305 · cited 1×
“Gaussian [52], piecewise constant [53], etc.”
Self-citationDynamic motion planning of autonomous vehicles
Shiller, Z., & Gwo, Y.-R. (1991) · IEEE Transactions on Robotics and Automation · doi:10.1109/70.75906 · Cited by 286 · cited 1×
“Works that perform planning of evasive maneuvers closer to physical limits require the single-track model, see e.g. [37], [38].”
BackgroundSafe motion planning in dynamic environments
Petti, S., & Fraichard, T. (2005) · 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2005.1545549 · Cited by 264 · cited 1×
“Tire slip is not considered, but the kinematic singletrack model can be used when the vehicle does not operate close to its physical capabilities [26], [35].”
BackgroundLanelets: Efficient map representation for autonomous driving
Bender, P., Ziegler, J., & Stiller, C. (2014) · 2014 IEEE Intelligent Vehicles Symposium Proceedings · doi:10.1109/ivs.2014.6856487 · Cited by 263 · cited 2×
“For our benchmarks we use lanelets [49] as atomic, interconnected, and drivable road segments to represent the road network.”
MethodOptimal robot plant planning using the minimum-time criterion
Bobrow, J. E. (1988) · IEEE Journal on Robotics and Automation · doi:10.1109/56.811 · Cited by 256
Anderson, S. J., Peters, S. C., Pilutti, T. E., & Iagnemma, K. (2010) · International Journal of Vehicle Autonomous Systems · doi:10.1504/ijvas.2010.035796 · Cited by 255 · cited 1×
“Works that published their used weights are listed below, where the cost function ID is chosen as the initials of the first authors plus a running number: [48, eq.”
BackgroundA real-time motion planner with trajectory optimization for autonomous vehicles
Xu, W., Wei, J., Dolan, J. M., Zhao, H., & Zha, H. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6225063 · Cited by 250 · cited 2×
“• Path length : [46, Tab.”
BackgroundNeed data for driver behaviour analysis? Presenting the public UAH-DriveSet
Romera, E., Bergasa, L. M., & Arroyo, R. (2016) · 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2016.7795584 · Cited by 204 · cited 1×
“Other datasets exist, but they have not recorded all relevant vehicles in a common reference frame, see e.g. [12].”
BackgroundLearning, Modeling, and Classification of Vehicle Track Patterns from Live Video
Morris, B. T., & Trivedi, M. M. (2008) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2008.922970 · Cited by 192
Nonlinear steering and braking control for vehicle rollover avoidance
Odenthal, D., Bünte, T., & Ackermann, J. E. (1999) · European Control Conference (ECC) · doi:10.23919/ecc.1999.7099370 · Cited by 154 · cited 1×
“The lateral dynamics, however, cannot be abstracted away to the same extent using controllers, especially when constraints such as the danger of roll-over must be considered in extreme maneuvers [29], [30].”
BackgroundFast collision checking for intelligent vehicle motion planning
Ziegler, J., & Stiller, C. (2010) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2010.5547976 · Cited by 147 · cited 1×
“If motion planners depend on other representations, one has to enclose the provided shape, see e.g. [50].”
BackgroundBenchmarking Motion Planning Algorithms: An Extensible Infrastructure for Analysis and Visualization
Moll, M., Sucan, I. A., & Kavraki, L. E. (2015) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2015.2448276 · Cited by 136
Set-Based Prediction of Traffic Participants on Arbitrary Road Networks
Althoff, M., & Magdici, S. (2016) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2016.2622920 · Cited by 135 · cited 2×
“Limited engine power and braking power as detailed in [36, Sec.”
BackgroundSelf-citationAnytime computation of time-optimal off-road vehicle maneuvers using the RRT*
Jeon, J. H., Karaman, S., & Frazzoli, E. (2011) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2011.6161521 · Cited by 134 · cited 2×
“Also, the weight transfer between the front and rear axle is often neglected in single-track models (see e.g. [37]).”
BackgroundControl of Integrated Powertrain With Electronic Throttle and Automatic Transmission
Kim, D., Peng, H., Bai, S., & Maguire, J. M. (2007) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2007.894641 · Cited by 129 · cited 2×
“For adaptive cruise control in particular, numerous works already exist that realize a commanded acceleration, see e.g. [27], [28].”
BackgroundFormalising Traffic Rules for Accountability of Autonomous Vehicles
Rizaldi, A., & Althoff, M. (2015) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2015.269 · Cited by 121 · cited 1×
“A possible solution has to ensure that the occupancy of the vehicle is in the free space ( ∀ t ∈ [ t 0 , t f ] : O ( x ( t )) ∈ W S , free ( t ) ) and respects additional constraints g S ( x ( t ) , u ( t ) , t ) ≤ 0 provided by scenario S , such as speed limits or other traffic rules [25].”
BackgroundSelf-citationVideo -Based Vehicle Trajectory Data Collection
Kovvali, V. G., Alexiadis, V., & Zhang, L. (2007) · Transportation Research Board 86th Annual MeetingTransportation Research Board · Cited by 87
SPOT: A tool for set-based prediction of traffic participants
Koschi, M., & Althoff, M. (2017) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2017.7995951 · Cited by 87 · cited 1×
“For occupancy sets we only allow polygons as a representation that can be obtained from our tool SPOT [51].”
MethodSelf-citationReconfigurable control structure to prevent the rollover of heavy vehicles
Gáspár, P., Szászí, I., & Bokor, J. (2004) · Control Engineering Practice · doi:10.1016/j.conengprac.2004.06.003 · Cited by 83 · cited 1×
“The lateral dynamics, however, cannot be abstracted away to the same extent using controllers, especially when constraints such as the danger of roll-over must be considered in extreme maneuvers [29], [30].”
Backgroundreal-time motion planning for multibody systems: Real life application examples
Bertolazzi, E., Biral, F., & Lio, M. D. (2007) · Multibody System Dynamics · doi:10.1007/s11044-007-9037-7 · Cited by 82 · cited 1×
“An example of a multi-body model used for motion planning of a road vehicle can be found in [39].”
MethodFail-safe motion planning of autonomous vehicles
Magdici, S., & Althoff, M. (2016) · 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2016.7795594 · Cited by 71 · cited 3×
“• Orientation offset: JO = ∫ tf t0 (θdes(x(t)) − θ(t)) 2 dt, where θdes(x(t)) is the desired orientation for the vehicle state x (see [45]).”
BackgroundInfluentialSelf-citationToward Replicable and Measurable Robotics Research [From the Guest Editors]
Bonsignorio, F., & del Pobil, A. P. (2015) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2015.2452073 · Cited by 68
OOPS for Motion Planning: An Online, Open-source, Programming System
Plaku, E., Bekris, K. E., & Kavraki, L. E. (2007) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2007.364047 · Cited by 62 · cited 1×
“Earlier libraries for sampling-based motion planning are the Online, Open-source, Programming System for Motion Planning (OOPSMP ) [20] and the Open Robotics and Animation Virtual Environment (OpenRAVE)”
MethodAn insightful comparison between experiments in mobile robotics and in science
Francesco Amigoni, A., Reggiani, M., & Schiaffonati, V. (2009) · Autonomous Robots · doi:10.1007/s10514-009-9137-8 · Cited by 55 · cited 1×
“Reproducibility of results is a cornerstone of science [1], [2].”
BackgroundCollision Probability Assessment for Speed Control
Lambert, A., Gruyer, D., Pierre, G. S., & Ndjeng, A. N. (2008) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2008.4732692 · Cited by 55 · cited 1×
“Gaussian [52], piecewise constant [53], etc.”
Driving risk assessment using cluster analysis based on naturalistic driving data
Zheng, Y., Wang, J., Li, X., Yu, C., Kodaka, K., & Li, K. (2014) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2014.6958104 · Cited by 51 · cited 1×
“Another class of works provides results on recorded data, but the data has never been or is no longer publicly available, e.g. [13]–[15]. c) Motion planning libraries: One of the most successful motion planning libraries in robotics is the Open Motion Planning Library (OMPL) [16], which implements…”
BackgroundA generic infrastructure for benchmarking motion planners
Cohen, B. J., Sucan, I. A., & Chitta, S. (2012) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2012.6386228 · Cited by 50 · cited 1×
“Detailed benchmarks have been developed in particular for robotic grasping [7], [8] and for robotic manipulators with a focus on indoor human environments [9].”
BackgroundVehicular Trajectory Optimization for Cooperative Collision Avoidance at High Speeds
Tomas-Gabarron, J.-B., Egea-López, E., & García-Haro, J. (2013) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2013.2270009 · Cited by 46
Ulbrich, S., Kappler, D., Asfour, T., Vahrenkamp, N., Bierbaum, A., Przybylski, M., & Dillmann, R. (2011) · 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2011.6094894 · Cited by 46 · cited 1×
“Detailed benchmarks have been developed in particular for robotic grasping [7], [8] and for robotic manipulators with a focus on indoor human environments [9].”
BackgroundVehicle dynamic stability and rollover
Allen, R. W., Szostak, H. T., Klyde, D. H., Rosenthal, T. J., & Owens, K. J. (1992) · STIN · Cited by 45
Design of emergency manoeuvres for automated highway system: obstacle avoidance problem
Godbole, D. N., Hagenmeyer, V., Sengupta, R., & Swaroop, D. (2002) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.1997.649770 · Cited by 35
Benchmarks in Robotics Research
del Pobil, A. P. (2006) · Cited by 34
An Extensible Benchmarking Infrastructure for Motion Planning AlgorithmsPreprint
Moll, M., Sucan, I. A., & Kavraki, L. E. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.6673 · Cited by 21
A benchmark suite for mobile robots
Baltes, J. (2002) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2000.893166 · Cited by 19 · cited 1×
“The need of benchmarks in robotics is formulated in [3], but this early work does not provide a specific benchmark.”
BackgroundA cost-aware path planning algorithm for mobile robots
Suh, J., & Oh, S. (2012) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2012.6386237 · Cited by 12 · cited 1×
“• Terminal distance to goal : J TG = d goal ( t f ) 2 , where d goal is the distance to the goal (see [47, Sec.”
Background(2009) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings
Research works printed but not linked: 5
- dillmann, 2004, Benchmarks for robotics research, Deliverable KA 1 10 of the EU project EURON
- nowak, 2010, Benchmarks for mobile manipulation and robust obstacle avoidance and navigation, Deliverable D3 1 of EU Project Best Practice in Robotics (BRICS)
- pfeiffer, 2007, Action plan and recommendation on benchmarks for mobile manipulation and service robots, Deliverable D4 3 of the EU project Robot Standards and Reference Architectures (RoSta)
- 2011, MSC Software, 2 MacArthur Place, Santa Ana, CA 92707, Adams/Tire Help
- werling, 2010, Optimal trajectory generation for dynamic street scenarios in a frenet frame, Proc of the IEEE International Conference on Robotics and Automation, 987
Cited by
A Survey of Autonomous Driving: Common Practices and Emerging Technologies
Yurtsever, E., Lambert, J., Carballo, A., & Takeda, K. (2020) · IEEE Access · doi:10.1109/access.2020.2983149 · Cited by 1,889
“are referred to sources for details of the datasets. DDD17 [89] around 12 hours of driving data is recorded. The LiVi-Set [281] is a new dataset that has lidar, image and driving behavior. CommonRoad [294] is a new benchmark for motion-planning. Naturalistic driving data is another type of dataset that concentrates on…”
BackgroundA Review of Motion Planning for Highway Autonomous Driving
Claussmann, L., Revilloud, M., Gruyer, D., & Glaser, S. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2913998 · Cited by 670
“thanks to the open source scenario library developed by [196]”
BackgroundNuPlan: A closed-loop ML-based planning benchmark for autonomous vehiclesPreprint
Caesar, H., Kabzan, J., Tan, K. S., Fong, W. K., Wolff, E. M., Lang, A., Fletcher, L., Beijbom, O., & Omari, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.11810 · Cited by 789
Survey on Scenario-Based Safety Assessment of Automated Vehicles
Riedmaier, S., Ponn, T., Ludwig, D., Schick, B., & Diermeyer, F. (2020) · IEEE Access · doi:10.1109/access.2020.2993730 · Cited by 481
“The Commonroad Framework [44], which includes not only scenarios but also models and cost functions, seems to be a good starting point for benchmarking.”
BackgroundDawson, C., Gao, S., & Fan, C. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3232542 · Cited by 269
“We use the single-track car model from the CommonRoad benchmarks [89].”
MethodInfluential
Metadata
- Authors
- Althoff, M., Koschi, M., & Manzinger, S.
- Venue
- 2017 IEEE Intelligent Vehicles Symposium (IV)
- Publisher
- IEEE
- Published
- 2017-06
- Pages
- 719-726
- ISSN
- 1931-0587 (ISSN-L)
- OpenAlex
- W2740508249
- Cited by
- 443
- References
- 52
- Citations by year
- 2026: 29 · 2025: 87 · 2024: 86 · 2023: 60 · 2022: 47 · 2021: 49 · 2020: 38 · 2019: 18 · 2018: 23 · 2017: 6
- FWCI
- 6.80
- Type
- conference paper
- Language
- en
- Open access
- green
- mediatum.ub.tum.de
- Licence
- other-oa
- Locations
- IEEE Intelligent Vehicles Symposium (publishedVersion)
- mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) (submittedVersion, other-oa)
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Robotic Path Planning Algorithms
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Physical Sciences › Engineering › Control and Systems Engineering › Traffic control and management
- Keywords
- reproducibility, vehicle dynamics modeling, dynamic obstacles, cost function, autonomous driving
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.