Testing Scenario Library Generation for Connected and Automated Vehicles, Part I: Methodology
Open accessThe DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Testing and evaluation is a critical step in the development and deployment of connected and automated vehicles (CAVs), and yet there is no systematic framework to generate testing scenario library. This study aims to provide a general framework for the testing scenario library generation (TSLG) problem with different operational design domains (ODDs), CAV models, and performance metrics. Given an ODD, the testing scenario library is defined as a critical set of scenarios that can be used for CAV test. Each testing scenario is evaluated by a newly proposed measure, scenario criticality, which can be computed as a combination of maneuver challenge and exposure frequency. To search for critical scenarios, an auxiliary objective function is designed, and a multi-start optimization method along with seed-filling is applied. Theoretical analysis suggests that the proposed framework can obtain accurate evaluation results with much fewer number of tests, if compared with the on-road test method. In part II of the study, three case studies are investigated to demonstrate the proposed method. Reinforcement learning based technique is applied to enhance the searching method under high-dimensional scenarios.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
End to End Learning for Self-Driving Cars
Bojarski, M., Del Testa, D., Dworakowski, D., Firner, B., Flepp, B., Goyal, P., Jackel, L. D., Monfort, M., Muller, U., Zhang, J., et al. (2016) · arXiv · doi:10.48550/arxiv.1604.07316 · Cited by 3,198
Kalra, N., & Paddock, S. M. (2016) · Transportation Research Part A: Policy and Practice · doi:10.1016/j.tra.2016.09.010 · Cited by 1,221
Cited by
Dense reinforcement learning for safety validation of autonomous vehicles
Feng, S., Sun, H., Yan, X., Zhu, H., Zou, Z., Shen, S., & Liu, H. X. (2023) · Nature · doi:10.1038/s41586-023-05732-2 · Cited by 587
Self-citationSurvey on Scenario-Based Safety Assessment of Automated Vehicles
Riedmaier, S., Ponn, T., Ludwig, D., Schick, B., & Diermeyer, F. (2020) · IEEE Access · doi:10.1109/access.2020.2993730 · Cited by 481
Feng, S., Yan, X., Sun, H., Feng, Y., & Liu, H. X. (2021) · Nature Communications · doi:10.1038/s41467-021-21007-8 · Cited by 413
“By introducing importance functions, the testing priority of critical scenarios will be improved, so does the evaluation ef fi ciency 14 – 17 .”
BackgroundSelf-citationDynamic driving environment complexity quantification method and its verification
Yu, R., Zheng, Y., & Qu, X. (2021) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2021.103051 · Cited by 50
Metadata
- Authors
- Feng, S., Feng, Y., Yu, C., Zhang, Y., & Liu, H. X.
- Venue
- IEEE Transactions on Intelligent Transportation Systems
- Published
- 2021-03
- Volume
- 22
- Issue
- 3
- Pages
- 1573-1582
- ISSN
- 1524-9050 (ISSN-L)
- 1558-0016
- OpenAlex
- W2943847575
- Cited by
- 252
- References
- 2
- FWCI
- 11.29
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.