CommonRoad: Composable benchmarks for motion planning on roads
Open accessThe DOI matches its Crossref record; 51 of the 52 references it cites were found in a registry or an index.
Abstract
Numerical experiments for motion planning of road vehicles require numerous components: vehicle dynamics, a road network, static obstacles, dynamic obstacles and their movement over time, goal regions, a cost function, etc. Providing a description of the numerical experiment precise enough to reproduce it might require several pages of information. Thus, only key aspects are typically described in scientific publications, making it impossible to reproduce results - yet, re-producibility is an important asset of good science. Composable benchmarks for motion planning on roads (CommonRoad) are proposed so that numerical experiments are fully defined by a unique ID; all information required to reconstruct the experiment can be found on the CommonRoad website. Each benchmark is composed by a vehicle model, a cost function, and a scenario (including goals and constraints). The scenarios are partly recorded from real traffic and partly hand-crafted to create dangerous situations. We hope that CommonRoad saves researchers time since one does not have to search for realistic parameters of vehicle dynamics or realistic traffic situations, yet provides the freedom to compose a benchmark that fits one's needs.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“With the exception of nuPlan and CommonRoad [12], all datasets focus on prediction (motion forecasting).”
From Towards learning-based planning: The nuPlan benchmark for real-world autonomous driving (2024) · cites this paper as [12]
In the citing paper
“However, CommonRoad [12] does not provide a real world dataset as the basis for the simulation, instead resorting to a small number of manually crafted scenarios and tools to import other datasets, albeit without any sensor data.”
From Towards learning-based planning: The nuPlan benchmark for real-world autonomous driving (2024) · cites this paper as [12]
Citations
Cites
Vision meets robotics: The KITTI dataset
Geiger, A., Lenz, P., Stiller, C., & Urtasun, R. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913491297 · Cited by 9,913 · cited 1×
“One of the most successful automotive benchmarks is the KITTI benchmark targeting computer vision [24].”
BackgroundRajamani, R. (2012) · Mechanical Engineering Series · doi:10.1007/978-1-4614-1433-9 · Cited by 4,401
A Survey of Motion Planning and Control Techniques for Self-Driving Urban Vehicles
Paden, B., Cap, M., Yong, S. Z., Yershov, D., & Frazzoli, E. (2016) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2016.2578706 · Cited by 2,585 · cited 1×
“Tire slip is not considered, but the kinematic singletrack model can be used when the vehicle does not operate close to its physical capabilities [26], [35].”
BackgroundThe Open Motion Planning Library
Sucan, I. A., Moll, M., & Kavraki, L. E. (2012) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2012.2205651 · Cited by 1,616 · cited 1×
“…but the data has never been or is no longer publicly available, e.g. [13]–[15]. c) Motion planning libraries: One of the most successful motion planning libraries in robotics is the Open Motion Planning Library (OMPL) [16], which implements many of the most important sampling-based approaches.”
BackgroundOptimal paths for a car that goes both forwards and backwards
Reeds, J., & Shepp, L. (1990) · Pacific Journal of Mathematics · doi:10.2140/pjm.1990.145.367 · Cited by 1,447 · cited 1×
“We have not included Dubin or Reeds-Shepp cars since they require changing the steering angle infinitely fast (see e.g. [31]).”
BackgroundCHOMP: Gradient optimization techniques for efficient motion planning
Ratliff, N., Zucker, M., Bagnell, J. A., & Srinivasa, S. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152817 · Cited by 992 · cited 1×
“…techniques, there also exists the Covariant Hamiltonian Optimization for Motion Planning (CHOMP) library for gradient-based optimization techniques [23]. d) Automotive benchmarks beyond motion planning: One of the most successful automotive benchmarks is the KITTI benchmark targeting computer…”
BackgroundOptimal trajectory generation for dynamic street scenarios in a Frenét Frame
Werling, M., Ziegler, J., Kammel, S., & Thrun, S. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509799 · Cited by 801 · cited 2×
“• Acceleration : [44, Sec.”
Automated vehicle control developments in the PATH program
Shladover, S. E., Desoer, C. A., Hedrick, J. K., Tomizuka, M., Walrand, J., Zhang, W.-B., McMahon, D. H., Peng, H., Sheikholeslam, S., & McKeown, N. (1991) · IEEE Transactions on Vehicular Technology · doi:10.1109/25.69979 · Cited by 786 · cited 1×
“For adaptive cruise control in particular, numerous works already exist that realize a commanded acceleration, see e.g. [27], [28].”
BackgroundA system for learning statistical motion patterns
Hu, W., Xiao, X., Fu, Z., Xie, D., Tan, T., & Maybank, S. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.176 · Cited by 544 · cited 1×
“Another class of works provides results on recorded data, but the data has never been or is no longer publicly available, e.g. [13]–[15]. c) Motion planning libraries: One of the most successful motion planning libraries in robotics is the Open Motion Planning Library (OMPL) [16], which implements…”
BackgroundPunzo, V., Borzacchiello, M. T., & Ciuffo, B. (2011) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2010.12.007 · Cited by 484 · cited 1×
“One of the most popular datasets of recorded traffic participants is from the Next Generation Simulation (NGSIM) program [10], [11].”
Background
Research works printed but not linked: 5
- dillmann, 2004, Benchmarks for robotics research, Deliverable KA 1 10 of the EU project EURON
- nowak, 2010, Benchmarks for mobile manipulation and robust obstacle avoidance and navigation, Deliverable D3 1 of EU Project Best Practice in Robotics (BRICS)
- pfeiffer, 2007, Action plan and recommendation on benchmarks for mobile manipulation and service robots, Deliverable D4 3 of the EU project Robot Standards and Reference Architectures (RoSta)
- 2011, MSC Software, 2 MacArthur Place, Santa Ana, CA 92707, Adams/Tire Help
- werling, 2010, Optimal trajectory generation for dynamic street scenarios in a frenet frame, Proc of the IEEE International Conference on Robotics and Automation, 987
Cited by
A Survey of Autonomous Driving: Common Practices and Emerging Technologies
Yurtsever, E., Lambert, J., Carballo, A., & Takeda, K. (2020) · IEEE Access · doi:10.1109/access.2020.2983149 · Cited by 1,889
“are referred to sources for details of the datasets. DDD17 [89] around 12 hours of driving data is recorded. The LiVi-Set [281] is a new dataset that has lidar, image and driving behavior. CommonRoad [294] is a new benchmark for motion-planning. Naturalistic driving data is another type of dataset that concentrates on…”
BackgroundA Review of Motion Planning for Highway Autonomous Driving
Claussmann, L., Revilloud, M., Gruyer, D., & Glaser, S. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2913998 · Cited by 670
“thanks to the open source scenario library developed by [196]”
BackgroundNuPlan: A closed-loop ML-based planning benchmark for autonomous vehiclesPreprint
Caesar, H., Kabzan, J., Tan, K. S., Fong, W. K., Wolff, E. M., Lang, A., Fletcher, L., Beijbom, O., & Omari, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.11810 · Cited by 789
Survey on Scenario-Based Safety Assessment of Automated Vehicles
Riedmaier, S., Ponn, T., Ludwig, D., Schick, B., & Diermeyer, F. (2020) · IEEE Access · doi:10.1109/access.2020.2993730 · Cited by 481
“The Commonroad Framework [44], which includes not only scenarios but also models and cost functions, seems to be a good starting point for benchmarking.”
BackgroundDawson, C., Gao, S., & Fan, C. (2023) · IEEE Transactions on Robotics · doi:10.1109/tro.2022.3232542 · Cited by 269
“We use the single-track car model from the CommonRoad benchmarks [89].”
MethodInfluentialMirchevska, B., Pek, C., Werling, M., Althoff, M., & Boedecker, J. (2018) · 2018 21st International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2018.8569448 · Cited by 198
“where vs is a parameterized switching velocity as described in [25] and αmax corresponds to the maximal feasible acceleration of the vehicle.”
Self-citationA Survey on Automated Driving System Testing: Landscapes and Trends
Tang, S., Zhang, Z., Zhang, Y., Zhou, J., Guo, Y. R., Liu, S., Guo, S., Li, Y., Ma, L., Xue, Y., et al. (2023) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3579642 · Cited by 218
“CommonRoad [364] XML SUMO It provides a benchmark set that contains scenarios for the study of motion planning.”
BackgroundGenerating Critical Test Scenarios for Automated Vehicles with Evolutionary Algorithms
Klischat, M., & Althoff, M. (2019) · 2019 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/ivs.2019.8814230 · Cited by 163
“The proposed approach is demonstrated by two initial scenarios from the CommonRoad benchmark collection [27].”
MethodSelf-citationAutomatic Generation of Safety-Critical Test Scenarios for Collision Avoidance of Road Vehicles
Althoff, M., & Lutz, S. (2018) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2018.8500374 · Cited by 144
“While single trajectories are obtained either from recordings or by using simulation models [36], the computation of a set of behaviors is not straightforward.”
BackgroundMethodInfluentialSelf-citationUsing Reachable Sets for Trajectory Planning of Automated Vehicles
Manzinger, S., Pek, C., & Althoff, M. (2020) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2020.3017342 · Cited by 163
“We use the CommonRoad benchmark suite to model our scenarios [68].”
MethodSelf-citationStochastic Model Predictive Control With a Safety Guarantee for Automated Driving
Brüdigam, T., Olbrich, M., Wollherr, D., & Leibold, M. (2021) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2021.3074645 · Cited by 163
An ethical trajectory planning algorithm for autonomous vehicles
Geisslinger, M., Poszler, F., & Lienkamp, M. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-022-00607-z · Cited by 140
“For our empiric evaluation, we run these three types of algorithms in 2000 simulation scenarios using CommonRoad 38 .”
MethodFormal Synthesis of Stochastic Systems via Control Barrier Certificates
Jagtap, P., Soudjani, S., & Zamani, M. (2020) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2020.3013916 · Cited by 137
Set-Based Prediction of Traffic Participants Considering Occlusions and Traffic Rules
Koschi, M., & Althoff, M. (2020) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2020.3017385 · Cited by 128
Self-citationSun, J., Zhang, H., Zhou, H., Yu, R., & Tian, Y. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3136353 · Cited by 156
“They are now available on the CommonRoad website [44].”
BackgroundTesting of autonomous driving systems: where are we and where should we go?
Lou, G., Deng, Y., Zheng, X., Zhang, M., & Zhang, T. (2022) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3540250.3549111 · Cited by 144
“The Intelligent Vehicle and Programming Language communities has proposed several higher-level DSLs to reduce the effort of modeling objects and motions in a simulation platform [3, 10, 33, 83].”
BackgroundTackling Occlusions & Limited Sensor Range with Set-based Safety Verification
Orzechowski, P. F., Meyer, A., & Lauer, M. (2018) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2018.8569332 · Cited by 126
“g. All scenarios represent or are inspired by real intersections in the city of Karlsruhe and a small town Fürstenfeldbruck. They are based on the commonroad scenarios DEU_Ffb1_1_T1 and DEU_Ffb2_1_T1 [18]. Our modified versions have been contributed to the commonroad benchmark as scenarios DEU_Ffb1_4, DEU_Ffb1_5_T1 and…”
BackgroundFail-Safe Motion Planning for Online Verification of Autonomous Vehicles Using Convex Optimization
Pek, C., & Althoff, M. (2020) · IEEE Transactions on Robotics · doi:10.1109/tro.2020.3036624 · Cited by 117
“Sincetheunderlyingmotionprimitivesare precomputedoffline,theprimitivecomputationcanincorporate complexvehiclemodels,suchasmultibodymodels[19].”
BackgroundInfluentialSelf-citationLLMScenario: Large Language Model Driven Scenario Generation
Chang, C., Wang, S., Zhang, J., Ge, J., & Li, L. (2024) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2024.3392930 · Cited by 122
“Currently, many standards and frameworks attempt to represent and describe driving scenarios in knowledge domain, such as 6-layer model [38], OpenScenario [39], MetaScenario [12], CommonRoad [40], etc.”
BackgroundFormalization of Interstate Traffic Rules in Temporal Logic
Maierhofer, S., Rettinger, A.-K., Mayer, E. C., & Althoff, M. (2020) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv47402.2020.9304549 · Cited by 124
“We evaluate formalized traffic rules for vehicles from a CommonRoad scenario2 [33] and from the highD dataset [34].”
MethodSelf-citationA Survey on Cooperative Architectures and Maneuvers for Connected and Automated Vehicles
Häfner, B., Bajpai, V. K., Ott, J., & Schmitt, G. A. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3138275 · Cited by 114
“Many open source datasets (cf. [48]) and benchmarks (e.g., CommonRoad [197]) exist for AD.”
BackgroundGeoScenario: An Open DSL for Autonomous Driving Scenario Representation
Queiroz, R., Berger, T., & Czarnecki, K. (2019) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2019.8814107 · Cited by 118
“For instance, scenarios in CommonRoad [9] were extracted from NGSIM data.”
BackgroundMethodInfluentialChoose Your Simulator Wisely: A Review on Open-Source Simulators for Autonomous Driving
Li, Y., Yuan, W., Zhang, S., Yan, W., Shen, Q., Wang, C., & Yang, M. Z. (2024) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2024.3374044 · Cited by 130
“Withanawarenessofthecomputationandtimecostof high-fidelity simulators, a trend emerged favoring only providing 2D BEV semantic information to train and verify driving policies [8], [44], [45].”
BackgroundMAVBench: Micro Aerial Vehicle Benchmarking
Boroujerdian, B., Genc, H., Krishnan, S., Cui, W., Faust, A., & Reddi, V. J. (2018) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2018.00077 · Cited by 111
“For example SLAMBench [58] and CommonRoad [59] solely focus on the perception and the planning stage respectively.”
Backgroundde Gelder, E., Paardekooper, J., Saberi, A. K., Elrofai, H., den Camp, O. O., Kraines, S. B., Ploeg, J., & Schutter, B. D. (2022) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2022.3144803 · Cited by 98
“Although the description of the static environment is not a general prerequisite of a scenario, this is often included when speaking about traffic scenarios [14, 13, 38, 19, 30].”
BackgroundMethodSPOT: A tool for set-based prediction of traffic participants
Koschi, M., & Althoff, M. (2017) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2017.7995951 · Cited by 87
“Both scenarios are taken from the CommonRoad benchmarks(4) [19] (each unique ID is mentioned later) and are based on real roads.”
BackgroundMethodSelf-citationMehdipour, N., Althoff, M., Tebbens, R. J. D., & Belta, C. A. (2023) · Automatica · doi:10.1016/j.automatica.2022.110692 · Cited by 114
“In [49], the authors encode the RSS model in STL, and perform monitoring of two RSS specifications (i.e., keeping a safe distance to front and side vehicles) on traffic scenarios from Com-monRoad [136] using S-TALIRO [137].”
MethodSelf-citationProvably-Correct and Comfortable Adaptive Cruise Control
Althoff, M., Maierhofer, S., & Pek, C. (2020) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2020.2991953 · Cited by 84
Self-citationMachine learning-based test selection for simulation-based testing of self-driving cars software
Birchler, C., Khatiri, S., Bosshard, B., Gambi, A., & Panichella, S. (2023) · Empirical Software Engineering · doi:10.1007/s10664-023-10286-y · Cited by 89
“Basic simulation models, like MATLAB and Simulink models as well as abstract driving scenarios [7], have been mainly utilized for model-in-the-loop simulations, benchmarking of trajectory planners, and Hardware/Software codesign.”
BackgroundMethodInfluentialThreat Assessment Techniques in Intelligent Vehicles: A Comparative Survey
Li, Y., Li, K., Zheng, Y., Morys, B., Pan, S., & Wang, J. (2020) · IEEE Intelligent Transportation Systems Magazine · doi:10.1109/mits.2019.2907633 · Cited by 82
Comparison of guaranteed state estimators for linear time-invariant systems
Althoff, M., & Rath, J. J. (2021) · Automatica · doi:10.1016/j.automatica.2021.109662 · Cited by 81
Self-citationFormal Certification Methods for Automated Vehicle Safety Assessment
Zhao, T., Yurtsever, E., Paulson, J. A., & Rizzoni, G. (2022) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2022.3170517 · Cited by 89
Safe Nonlinear Control Using Robust Neural Lyapunov-Barrier FunctionsPreprint
Dawson, C., Qin, Z., Gao, S., & Fan, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.06697 · Cited by 81
“The second model (the sideslip model) has state [xe, ye, δ, ve,ψe, ψ̇e,β], where β is the sideslip angle [34].”
LawBreaker: An Approach for Specifying Traffic Laws and Fuzzing Autonomous Vehicles
Sun, Y., POSKITT, C. M., Sun, J., Chen, Y., & Yang, Z. (2022) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3551349.3556897 · Cited by 109
“obstacles, pedestrians, and vehicles) as well as their dynamic behaviour, and can be described to different degrees by domain-specific languages (DSLs) such as Scenic [25], CommonRoad [7], GeoScenario [50], and AVUnit [3].”
BackgroundSpecification-based Autonomous Driving System Testing
Zhou, Y. H., Sun, Y., Tang, Y., Chen, Y., Sun, J., POSKITT, C. M., Liu, Y., & Yang, Z. (2023) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2023.3254142 · Cited by 73
Hekmatnejad, M., Yaghoubi, S., Dokhanchi, A., Amor, H. B., Shrivastava, A., Karam, L. J., & Fainekos, G. (2019) · ACM/IEEE International Conference on Formal Methods and Models for Co-Design (MEMOCODE) · doi:10.1145/3359986.3361203 · Cited by 72
“CommonRoad is a composable framework for benchmarking motion planning on roads [17].”
BackgroundMethodInfluentialFormalization of Intersection Traffic Rules in Temporal Logic
Maierhofer, S., Moosbrugger, P., & Althoff, M. (2022) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv51971.2022.9827153 · Cited by 71
“The road network is based on the CommonRoad [20] format and is an extension of the road network described in our previous work [6]; both are based on lanelets [21].”
MethodInfluentialSelf-citationThe Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Review
Hagedorn, S., Hallgarten, M., Stoll, M., & Condurache, A. P. (2024) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2024.3459071 · Cited by 89
“Prominent simulators are Carla [173], nuPlan [172], Waymax [262], Highway-Env [263], and CommonRoad [264].”
Evaluating Adversarial Attacks on Driving Safety in Vision-Based Autonomous Vehicles
Zhang, J., Lou, Y., Wang, J., Wu, K., Lu, K., & Jia, X. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3099164 · Cited by 84
“As for the motion planning module and the evaluation module, we use CommonRoad [33] as the framework and leverage the built-in A* [28] with sampled motion primitives as the motion planning method.”
Bench-MR: A Motion Planning Benchmark for Wheeled Mobile Robots
Heiden, E., Palmieri, L., Bruns, L., Arras, K. O., Sukhatme, G. S., & Koenig, S. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3068913 · Cited by 76
“Althoff et al. [11] have introduced a benchmarking framework for autonomous cars driving on roads.”
Backgroundde Gelder, E., Hof, J. P., Cator, E., Paardekooper, J., den Camp, O. O., Ploeg, J., & Schutter, B. D. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3154774 · Cited by 67
Fitness Functions for Testing Automated and Autonomous Driving Systems
Hauer, F., Pretschner, A., & Holzmüller, B. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-26601-1_5 · Cited by 63
“It can be described using the OpenScenario [1] or CommonRoad [5] formats.”
MethodRisk-aware Motion Planning for Autonomous Vehicles with Safety Specifications
Nyberg, T., Pek, C., Col, L. D., Norén, C., & Tůmová, J. (2021) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv48863.2021.9575928 · Cited by 62
Pek, C., & Althoff, M. (2018) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2018.8569425 · Cited by 74
“Our scenarios are modeled using the CommonRoad benchmark suite for motion planning [44].”
MethodSelf-citationCyber-Physical Mobility Lab: An Open-Source Platform for Networked and Autonomous Vehicles
Kloock, M., Scheffe, P., Maczijewski, J., Kampmann, A., Mokhtarian, A., Kowalewski, S., & Alrifaee, B. (2021) · European Control Conference (ECC) · doi:10.23919/ecc54610.2021.9654986 · Cited by 60
“Scenarios are defined in the CommonRoad scenario format of [25].”
BackgroundChrosniak, J., Ning, J., & Behl, M. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3388847 · Cited by 60
“Physics-based vehicle dynamics models can vary greatly in complexity, ranging from simple point-mass to single-track (bicycle) models, to complex multi-body models [9].”
BackgroundMotionBenchMaker: A Tool to Generate and Benchmark Motion Planning Datasets
Chamzas, C., Quintero-Pena, C., Kingston, Z., Orthey, A., Rakita, D., Gleicher, M., Toussaint, M., & Kavraki, L. E. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3133603 · Cited by 59
“CommonRoad [15] 2017 × X × × × × Robot@Home [16] 2017 × × × × X × Multi-Agent Path-Find Benchmark [17] 2019 × X × × × × MAVBench [18] 2020 × × × × X × BARN [19] 2020 X X X × × × Bench-MR [20] 2021 × X × × X × PathBench [21] 2021 X X X × × ×”
BackgroundRisk Quantification for Automated Driving Systems in Real-World Driving Scenarios
de Gelder, E., Elrofai, H., Saberi, A. K., Paardekooper, J., den Camp, O. O., & Schutter, B. D. (2021) · IEEE Access · doi:10.1109/access.2021.3136585 · Cited by 67
MetaScenario: A Framework for Driving Scenario Data Description, Storage and Indexing
Chang, C., Cao, D., Chen, L. F., Su, K., Su, K., Su, Y., Wang, F., Wang, J., Wang, P., Wei, J., et al. (2022) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2022.3215503 · Cited by 61
“Althoff et al. [57] propose the composable motion planning benchmark CommonRoad, which uses Lanelets to represent a road network, consisting of initial state and several target regions of ego vehicle as well as other vehicles with specific trajectory data to form a scenario layout.”
MethodSadid, H., & Antoniou, C. (2024) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2024.3406507 · Cited by 64
Set-Based Prediction of Pedestrians in Urban Environments Considering Formalized Traffic Rules
Koschi, M., Pek, C., Beikirch, M., & Althoff, M. (2018) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2018.8569434 · Cited by 56
“The scenarios presented next are available in the CommonRoad benchmark suite including all simulation parameters3 [34].”
Self-citationKochdumper, N., Krasowski, H., Wang, X., Bak, S., & Althoff, M. (2023) · IEEE Open Journal of Control Systems · doi:10.1109/ojcsys.2023.3256305 · Cited by 72
Self-citationA Survey of Trajectory Planning Methods for Autonomous Driving—Part I: Unstructured Scenarios
Guo, Y., Guo, Z., Wang, Y., Yao, D., Li, B., & Li, L. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3337318 · Cited by 64
“Examples include the CommonRoad competition organized by the Technical University of Munich [17], and the On-site competition organized by Tongji University [71].”
OmniTester: Multimodal Large Language Model Driven Scenario Testing for Autonomous Vehicles
Lu, Q., Wang, X., Jiang, Y., Zhao, G., Ma, M., & Feng, S. (2025) · Automotive Innovation · doi:10.1007/s42154-025-00364-w · Cited by 68
“[22] defines testing scenarios using vehicle models, cost functions, and scenario goals and constraints, which are partially recorded and partially hand-crafted.”
Automatic Conversion of Road Networks from OpenDRIVE to Lanelets
Althoff, M., Urban, S., & Koschi, M. (2018) · IEEE International Conference on Service Operations and Logistics, and Informatics (SOLI) · doi:10.1109/soli.2018.8476801 · Cited by 62
“Lanelets are used for many aspects of driving simulators and automated driving, such as the composable benchmarks for motion planning on roads (CommonRoad) [12], lane-level map-matching [13], deep learning [14], formalization of traffic rules [15], set-based prediction of traffic participants [16], classification of d…”
BackgroundSelf-citationEnsuring drivability of planned motions using formal methods
Schürmann, B., Hes, D., Eilbrecht, J., Stursberg, O., Köster, F., & Althoff, M. (2017) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2017.8317647 · Cited by 54
“For the simulation experiments, we use a multi-body model (MBM) with 29 states described in [40].”
MethodSelf-citationArena-Bench: A Benchmarking Suite for Obstacle Avoidance Approaches in Highly Dynamic Environments
Kästner, L., Bhuiyan, T., Lê, T. A., Treis, E., Cox, J., Meinardus, B., Kmiecik, J., Carstens, R., Pichel, D., Fatloun, B., et al. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3190086 · Cited by 57
Towards learning-based planning: The nuPlan benchmark for real-world autonomous driving
Karnchanachari, N., Geromichalos, D., Tan, K. S., Li, N., Eriksen, C., Yaghoubi, S., Mehdipour, N., Bernasconi, G., Fong, W. K., Guo, Y., et al. (2024) · 2024 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra57147.2024.10610077 · Cited by 180
“Com-monRoad [12] was the first open-source simulator focused on planning.”
BackgroundMethodInfluentialHuman-Like Decision-Making of Autonomous Vehicles in Dynamic Traffic Scenarios
Zhang, T., Zhan, J., Shi, J., Xin, J., & Zheng, N. (2023) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2023.123696 · Cited by 53
“6) Argoverse [71]: Argoverse is also a public dataset based on onboard sensors.”
BackgroundLiu, Q., Li, X., Tang, Y., Gao, X., Yang, F., & Li, Z. (2023) · Sensors · doi:10.3390/s23198229 · Cited by 53
AoI-centric Task Scheduling for Autonomous Driving Systems
Xu, C., Xu, Q., Wang, J., Wu, K., Lu, K., & Qiao, C. (2022) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom48880.2022.9796958 · Cited by 46
“To illustrate the criticalness of AoI for driving safety in ADSs, we conduct obstacle avoidance experiments on CommonRoad [10], a collection of benchmarks for motion planning”
MethodLi, X., Song, R., Fan, J., Liu, M., & Wang, F. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3297168 · Cited by 45
RetractedToward Safer Autonomous Vehicles: Occlusion-Aware Trajectory Planning to Minimize Risky Behavior
Trauth, R., Moller, K., & Betz, J. (2023) · IEEE Open Journal of Intelligent Transportation Systems · doi:10.1109/ojits.2023.3336464 · Cited by 52
“We use a 2D simulation environment to evaluate our algorithm approach in edge-case crossing pedestrian scenarios [54].”
MethodPek, C., Rusinov, V., Manzinger, S., Üste, M. C., & Althoff, M. (2020) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv47402.2020.9304544 · Cited by 54
“We use the following operations between two sets X 1 and X 2 : X 1 ∪ X 2 denotes the union of sets, X 1 ∩ X 2 is the intersection of sets, and Lanes are represented as lanelets [38], which are “atomic, interconnected, and drivable road segments” [37] (see Fig.”
BackgroundMethodSelf-citationComputation of Solution Spaces for Optimization-Based Trajectory Planning
Schäfer, L., Manzinger, S., & Althoff, M. (2021) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2021.3077702 · Cited by 51
“By applying our method to different scenarios from CommonRoad 1 [82] in Sec.”
InfluentialSelf-citationMaierhofer, S., Klischat, M., & Althoff, M. (2021) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc48978.2021.9564885 · Cited by 45
“Lanelet-based formats, such as Lanelet2 [13] and CommonRoad [14] have been widely used in research.”
BackgroundMethodSelf-citationWorst-case Analysis of the Time-To-React Using Reachable Sets
Söntges, S., Koschi, M., & Althoff, M. (2018) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2018.8500709 · Cited by 44
“We demonstrate our computation of the TTRmax and TTR≈ in three scenarios, which are included in the CommonRoad benchmarks1 [21].”
MethodSelf-citationSafe but not Overcautious Motion Planning under Occlusions and Limited Sensor Range
Naumann, M., Königshof, H., Lauer, M., & Stiller, C. (2019) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2019.8814251 · Cited by 43
“In order to evaluate our approach, we chose the scenario from [3], which represents a real world scenario with actually existing occlusions: It is a modified version of the CommonROAD [1] scenario DEU_Ffb-1_1_T-1.”
BackgroundMethodCoInCar-Sim: An Open-Source Simulation Framework for Cooperatively Interacting Automobiles
Naumann, M., Poggenhans, F., Lauer, M., & Stiller, C. (2018) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2018.8500405 · Cited by 41
“The goal of comparability and reproducibility in the field of motion planning is addressed by CommonRoad [11].”
BackgroundBARK: Open Behavior Benchmarking in Multi-Agent Environments
Bernhard, J., Esterle, K., Hart, P., & Kessler, T. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341222 · Cited by 48
“[3] as a composable benchmarking tool for motion planning on roads.”
MethodFRENETIX: A High-Performance and Modular Motion Planning Framework for Autonomous Driving
Trauth, R., Moller, K., Würsching, G., & Betz, J. (2024) · IEEE Access · doi:10.1109/access.2024.3436835 · Cited by 49
“Furthermore, only dynamically feasible trajectories T f are considered in this process, ensuring both effectiveness and safety in vehicle maneuvering.”
BackgroundMethodInfluentialSafe Stop Trajectory Planning for Highly Automated Vehicles: An Optimal Control Problem Formulation
Svensson, L., Masson, L., Mohan, N., Ward, E., Pernestål, A., Feng, L., & Törngren, M. (2018) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2018.8500536 · Cited by 39
“[7], to create trajectory planning benchmarks using optimal control terminology for facilitating reproduction and comparison of results.”
BackgroundWang, X., Krasowski, H., & Althoff, M. (2021) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc48978.2021.9564898 · Cited by 49
“The CommonRoad benchmark suite [2] offers a large number of deterministic benchmark scenarios, either constructed from real traffic or by running the traffic simulator SUMO [3], [4] in a deterministic way.”
BackgroundMethodSelf-citationHigh-Speed Autonomous Racing Using Trajectory-Aided Deep Reinforcement Learning
Evans, B., Engelbrecht, H. A., & Jordaan, H. W. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3295252 · Cited by 45
“Vehicle Model: The simulator represents the vehicle using the kinematic bicycle model [28].”
MethodSALVO: Automated Generation of Diversified Tests for Self-driving Cars from Existing Maps
Nguyen, V. A., Huber, S., & Gambi, A. (2021) · IEEE International Conference on Artificial Intelligence Testing (AITest) · doi:10.1109/aitest52744.2021.00033 · Cited by 38
Li, B., Fan, L., Ouyang, Y., Tang, S., Wang, X., Cao, D., & Wang, F. (2022) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2022.3228963 · Cited by 38
Autonomous Vehicle Motion Planning via Recurrent Spline Optimization
Xu, W., Qian, W., & Dolan, J. M. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9560867 · Cited by 37
“Two qualitative examples are shown in Fig 2 and Fig 3, which are from the CommonRoad benchmark [37].”
BackgroundData-Driven Formal Reasoning and Their Applications in Safety Analysis of Vehicle Autonomy Features
Fan, C., Qi, B., & Mitra, S. (2018) · IEEE Design and Test · doi:10.1109/mdat.2018.2799804 · Cited by 37
Data-driven verification and synthesis of stochastic systems via barrier certificates
Salamati, A., Lavaei, A., Soudjani, S., & Zamani, M. (2023) · Automatica · doi:10.1016/j.automatica.2023.111323 · Cited by 37
Sampling-Based Optimal Trajectory Generation for Autonomous Vehicles Using Reachable Sets
Würsching, G., & Althoff, M. (2021) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc48978.2021.9564801 · Cited by 47
“IV-C) from the CommonRoad [26] benchmark platform.”
MethodInfluentialSelf-citationCoupling SUMO with a Motion Planning Framework for Automated Vehicles
Klischat, M., Dragoi, O., Eissa, M., & Althoff, M. (2019) · EPiC series in computing · doi:10.29007/1p2d · Cited by 44
“1 CommonRoad CommonRoad is a Python tool for reading CommonRoad [1] benchmark files which provides basic functionalities for motion planning of automated vehicles.”
MethodSelf-citationComputationally Efficient Safety Falsification of Adaptive Cruise Control Systems
Koschi, M., Pek, C., Maierhofer, S., & Althoff, M. (2019) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2019.8917287 · Cited by 42
“The safety-critical scenarios presented next are included in the CommonRoad benchmark suite1 [3] and are visualized in the video attachment of this paper.”
BackgroundSelf-citationOverview of Tools Supporting Planning for Automated Driving
Tong, K., Ajanović, Z., & Stettinger, G. (2020) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc45102.2020.9294512 · Cited by 37
“It is a benchmark collection for motion planning of road vehicles, comprising many advantages, such as reproducibility, composability, openness etc. [107].”
BackgroundTUNERCAR: A Superoptimization Toolchain for Autonomous Racing
O'Kelly, M., Zheng, H., Jain, A., Auckley, J., Luong, K., & Mangharam, R. (2020) · 2020 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra40945.2020.9197080 · Cited by 32
“The simulator uses a lightweight 2D physics engine written in C++ which implements the single track vehicle model described in [31].”
MethodFormal Safety Net Control Using Backward Reachability Analysis
Schürmann, B., Klischat, M., Kochdumper, N., & Althoff, M. (2021) · IEEE Transactions on Automatic Control · doi:10.1109/tac.2021.3124188 · Cited by 35
“We consider the scenario with ID ZAM_Zip-1_19_T-1 from the CommonRoad database [87].”
MethodSelf-citationRACP: Risk-Aware Contingency Planning With Multi-Modal Predictions
Mustafa, K. A., Ornia, D. J., Kober, J., & Alonso–Mora, J. (2024) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2024.3411530 · Cited by 48
“The illustrated scenarios are included in the CommonRoad benchmark suite [63] for reproducibility.”
Watch-and-Learn-Net: Self-supervised Online Learning for Probabilistic Vehicle Trajectory Prediction
Geisslinger, M., Karle, P., Betz, J., & Lienkamp, M. (2021) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc52423.2021.9659079 · Cited by 41
“In this paper we use the scenarios of CommonRoad [24] to create our dataset.”
MethodReceding Horizon Control Using Graph Search for Multi-Agent Trajectory Planning
Scheffe, P., Pedrosa, M. V. A., Flaßkamp, K., & Alrifaee, B. (2022) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2022.3214718 · Cited by 34
HOPE: A Reinforcement Learning-Based Hybrid Policy Path Planner for Diverse Parking Scenarios
Jiang, M., Li, Y., Zhang, S., Chen, S., Wang, C., & Yang, M. Z. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3550417 · Cited by 51
“In practice, the transition is modeled using the single-track bicycle model, as implemented in [32], and this uncertainty is not considered in a deterministic environment.”
MethodZhao, X., Liao, X., Wang, Z., Wu, G., Barth, M., Han, K., & Tiwari, P. (2022) · SAE International Journal of Connected and Automated Vehicles · doi:10.4271/12-05-04-0025 · Cited by 32
Deolasee, S., Lin, Q., Li, J., & Dolan, J. M. (2023) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc55779.2023.10155930 · Cited by 32
“The simulations in this part are conducted on the CommonRoad platform [26], which provides an interactive simulated and non-interactive real traffic environment for validating motion planning algorithms.”
Maximum Acceptable Risk as Criterion for Decision-Making in Autonomous Vehicle Trajectory Planning
Geisslinger, M., Trauth, R., Kaljavesi, G., & Lienkamp, M. (2023) · IEEE Open Journal of Intelligent Transportation Systems · doi:10.1109/ojits.2023.3298973 · Cited by 37
CommonRoad-CriMe: A Toolbox for Criticality Measures of Autonomous Vehicles
Lin, Y., & Althoff, M. (2023) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv55152.2023.10186673 · Cited by 32
“The class Scenario [57] contains the information of a series of continuous traffic scenes (class Scene ).”
BackgroundMethodInfluentialSelf-citationBarbier, M., Renzaglia, A., Quilbeuf, J., Rummelhard, L., Paigwar, A., Laugier, C., Legay, A., Ibañez‐Guzmán, J., & Simonin, O. (2019) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2019.8813793 · Cited by 32
“In the robotic domain, benchmarks allow researchers to compare their results in the same conditions [6], [7].”
BackgroundModel- and Acceleration-based Pursuit Controller for High-Performance Autonomous Racing
Becker, J., Imholz, N., Schwarzenbach, L., Ghignone, E., Baumann, N., & Magno, M. (2023) · 2023 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48891.2023.10161472 · Cited by 31
“Figure 1: Overview of the single-track model [27] with the relevant forces and angles defined in their positive directions.”
BackgroundMethodForzaETH Race Stack—Scaled Autonomous Head‐to‐Head Racing on Fully Commercial Off‐the‐Shelf Hardware
Baumann, N., Ghignone, E., Kühne, J., Bastuck, N., Becker, J., Imholz, N., Kränzlin, T., Lim, T. Y., Loetscher, M., Schwarzenbach, L., et al. (2024) · Journal of Field Robotics · doi:10.1002/rob.22429 · Cited by 31
“The simulation model corresponds to a dynamic bicycle model, which can be selected to use either linear or Pacejka tire dynamics, as in Althoff, Koschi, and Manzinger (2017).”
PathBench: A Benchmarking Platform for Classical and Learned Path Planning Algorithms
Toma, A.-I., Hsueh, H.-Y., Jaafar, H. A., Murai, R., Kelly, P. H. J., & Sajad Saeedi, G. (2021) · Canadian Conference on Computer and Robot Vision · doi:10.1109/crv52889.2021.00019 · Cited by 31
A Formally Verified Motion Planner for Autonomous Vehicles
Rizaldi, A., Immler, F., Schürmann, B., & Althoff, M. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01090-4_5 · Cited by 31
“If we assume that the ode ( m ) has the general form of then the ode ( m ) represents a fixed system model f — such as a point-mass or as a kinematic single-track model for autonomous vehicles [3] — with a fixed input trajectory u m for manoeuvre m .”
BackgroundSelf-citationEfficient Computation of Invariably Safe States for Motion Planning of Self-Driving Vehicles
Pek, C., & Althoff, M. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593597 · Cited by 34
“2Scenario ZAM Urban-1 1 S-1 of the CommonRoad benchmark suite Version 2018a [40].”
BackgroundSelf-citationWeng, B., Capito, L., Özgüner, Ü., & Redmill, K. (2021) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2021.3117049 · Cited by 33
Metadata
- Authors
- Althoff, M., Koschi, M., & Manzinger, S.
- Venue
- 2017 IEEE Intelligent Vehicles Symposium (IV)
- Publisher
- IEEE
- Published
- 2017-06
- Pages
- 719-726
- ISSN
- 1931-0587 (ISSN-L)
- OpenAlex
- W2740508249
- Cited by
- 443
- References
- 52
- Citations by year
- 2026: 29 · 2025: 87 · 2024: 86 · 2023: 60 · 2022: 47 · 2021: 49 · 2020: 38 · 2019: 18 · 2018: 23 · 2017: 6
- FWCI
- 6.80
- Type
- conference paper
- Language
- en
- Open access
- green
- mediatum.ub.tum.de
- Licence
- other-oa
- Locations
- IEEE Intelligent Vehicles Symposium (publishedVersion)
- mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) (submittedVersion, other-oa)
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Robotic Path Planning Algorithms
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Physical Sciences › Engineering › Control and Systems Engineering › Traffic control and management
- Keywords
- reproducibility, vehicle dynamics modeling, dynamic obstacles, cost function, autonomous driving
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.