The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
A new performance measure and evaluation benchmark for road detection algorithms
Abstract
Detecting the road area and ego-lane ahead of a vehicle is central to modern driver assistance systems. While lane-detection on well-marked roads is already available in modern vehicles, finding the boundaries of unmarked or weakly marked roads and lanes as they appear in inner-city and rural environments remains an unsolved problem due to the high variability in scene layout and illumination conditions, amongst others. While recent years have witnessed great interest in this subject, to date no commonly agreed upon benchmark exists, rendering a fair comparison amongst methods difficult. In this paper, we introduce a novel open-access dataset and benchmark for road area and ego-lane detection. Our dataset comprises 600 annotated training and test images of high variability from the KITTI autonomous driving project, capturing a broad spectrum of urban road scenes. For evaluation, we propose to use the 2D Bird's Eye View (BEV) space as vehicle control usually happens in this 2D world, requiring detection results to be represented in this very same space. Furthermore, we propose a novel, behavior-based metric which judges the utility of the extracted ego-lane area for driver assistance applications by fitting a driving corridor to the road detection results in the BEV. We believe this to be important for a meaningful evaluation as pixel-level performance is of limited value for vehicle control. State-of-the-art road detection algorithms are used to demonstrate results using classical pixel-level metrics in perspective and BEV space as well as the novel behavior-based performance measure. All data and annotations are made publicly available on the KITTI online evaluation website in order to serve as a common benchmark for road terrain detection algorithms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Summary KITTI [8,65-67] was the first large-scale dataset to tackle the important issue of multimodal data in autonomous vehicles.”
From Multimodal semantic segmentation in autonomous driving: A review of current approaches and future perspectives (2022) · cites this paper as [66]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599 · cited 1×
“Furthermore, in order to provide insights into the performance over the full recall range, the average precision (AP) as defined in [28] is computed for different recall values r:”
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
Self-citationRecovering Surface Layout from an Image
Hoiem, D., Efros, A. A., & Hebert, M. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-0031-y · Cited by 674
Automatic camera and range sensor calibration using a single shot
Geiger, A., Moosmann, F., Car, O., & Schuster, B. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6224570 · Cited by 647
Self-citationInverse perspective mapping simplifies optical flow computation and obstacle detection
Mallot, H. A., Bülthoff, H. H., Little, J. J., & Bohrer, S. (1991) · Biological Cybernetics · doi:10.1007/bf00201978 · Cited by 392
Road Scene Segmentation from a Single Image
Alvarez, J. M., Gevers, T., LeCun, Y., & Lopez, A. M. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33786-4_28 · Cited by 238
A Learning Approach Towards Detection and Tracking of Lane Markings
Gopalan, R., Hong, T., Shneier, M., & Chellappa, R. (2012) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2012.2184756 · Cited by 182
A Dynamic Conditional Random Field Model for Joint Labeling of Object and Scene Classes
Wojek, C., & Schiele, B. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-88693-8_54 · Cited by 128
Probabilistic Lane Tracking in Difficult Road Scenarios Using Stereovision
Danescu, R., & Nedevschi, S. (2009) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2009.2018328 · Cited by 127
3D Scene priors for road detection
Álvarez, J. M., Gevers, T., & López, A. M. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5540228 · Cited by 98
Research works printed but not linked: 3
- kuehnl, 2012, Spatial ray features for realtime ego-lane extraction, Proc IEEE Intelligent Transportation Systems Conf, 288
- enzweiler, 2013, Towards multicue urban curb recognition, Proc IEEE Intelligent Vehicles Symp, 902
- wojek, 2008, A dynamic cRF model for joint labeling of object and scene classes, European Conference on Computer Vision, 5305, 733
Cited by
CCNet: Criss-Cross Attention for Semantic Segmentation
Huang, Z., Wang, X., Huang, L., Huang, C., Wei, Y., & Liu, W. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00069 · Cited by 3,045
BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning
Yu, F., Chen, H., Wang, X., Xian, W., Chen, Y., Liu, F., Madhavan, V., & Darrell, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00271 · Cited by 2,641
Understanding Convolution for Semantic Segmentation
Wang, P., Chen, P., Yuan, Y., Liu, D., Huang, Z., Hou, X., & Cottrell, G. (2018) · 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2018.00163 · Cited by 1,957
Attention to Scale: Scale-Aware Semantic Image Segmentation
Chen, L.-C., Yang, Y., Wang, J., Xu, W., & Yuille, A. L. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.396 · Cited by 1,377
Spatial as Deep: Spatial CNN for Traffic Scene Understanding
Pan, X., Shi, J., Luo, P., Wang, X., & Tang, X. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12301 · Cited by 1,177
Metadata
- Authors
- Fritsch, J., Kuhnl, T., & Geiger, A.
- Affiliations
- Karlsruhe Institute of Technology (DE)
- ORCID
- Geiger, Andreas
- Venue
- 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013)
- Publisher
- IEEE
- Published
- 2013-10
- Pages
- 1693-1700
- OpenAlex
- W2167222293
- Cited by
- 690
- References
- 31
- Citations by year
- 2026: 20 · 2025: 31 · 2024: 61 · 2023: 53 · 2022: 67 · 2021: 76 · 2020: 69 · 2019: 73 · 2018: 75 · 2017: 61 · 2016: 33 · 2015: 41 · 2014: 29 · 2013: 1
- FWCI
- 44.22
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE International Conference on Intelligent Transportation Systems (ITSC) (publishedVersion)
- Topics
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Automated Road and Building Extraction
- Keywords
- road detection, driver assistance systems, benchmark dataset, bird's-eye view, urban road scenes, KITTI dataset, autonomous driving
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A new performance measure and evaluation benchmark for road detection algorithms. https://app.cochat.ai/papers/10.1109/itsc.2013.6728473
- The paper
- Fritsch, J., Kuhnl, T., & Geiger, A. (2013). A new performance measure and evaluation benchmark for road detection algorithms. 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013). https://doi.org/10.1109/itsc.2013.6728473
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.