The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
A new performance measure and evaluation benchmark for road detection algorithms
Abstract
Detecting the road area and ego-lane ahead of a vehicle is central to modern driver assistance systems. While lane-detection on well-marked roads is already available in modern vehicles, finding the boundaries of unmarked or weakly marked roads and lanes as they appear in inner-city and rural environments remains an unsolved problem due to the high variability in scene layout and illumination conditions, amongst others. While recent years have witnessed great interest in this subject, to date no commonly agreed upon benchmark exists, rendering a fair comparison amongst methods difficult. In this paper, we introduce a novel open-access dataset and benchmark for road area and ego-lane detection. Our dataset comprises 600 annotated training and test images of high variability from the KITTI autonomous driving project, capturing a broad spectrum of urban road scenes. For evaluation, we propose to use the 2D Bird's Eye View (BEV) space as vehicle control usually happens in this 2D world, requiring detection results to be represented in this very same space. Furthermore, we propose a novel, behavior-based metric which judges the utility of the extracted ego-lane area for driver assistance applications by fitting a driving corridor to the road detection results in the BEV. We believe this to be important for a meaningful evaluation as pixel-level performance is of limited value for vehicle control. State-of-the-art road detection algorithms are used to demonstrate results using classical pixel-level metrics in perspective and BEV space as well as the novel behavior-based performance measure. All data and annotations are made publicly available on the KITTI online evaluation website in order to serve as a common benchmark for road terrain detection algorithms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Summary KITTI [8,65-67] was the first large-scale dataset to tackle the important issue of multimodal data in autonomous vehicles.”
From Multimodal semantic segmentation in autonomous driving: A review of current approaches and future perspectives (2022) · cites this paper as [66]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
Self-citationRecovering Surface Layout from an Image
Hoiem, D., Efros, A. A., & Hebert, M. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-0031-y · Cited by 674
Automatic camera and range sensor calibration using a single shot
Geiger, A., Moosmann, F., Car, O., & Schuster, B. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6224570 · Cited by 647
Self-citationInverse perspective mapping simplifies optical flow computation and obstacle detection
Mallot, H. A., Bülthoff, H. H., Little, J. J., & Bohrer, S. (1991) · Biological Cybernetics · doi:10.1007/bf00201978 · Cited by 392
Road Scene Segmentation from a Single Image
Alvarez, J. M., Gevers, T., LeCun, Y., & Lopez, A. M. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33786-4_28 · Cited by 238
A Learning Approach Towards Detection and Tracking of Lane Markings
Gopalan, R., Hong, T., Shneier, M., & Chellappa, R. (2012) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2012.2184756 · Cited by 182
Probabilistic Lane Tracking in Difficult Road Scenarios Using Stereovision
Danescu, R., & Nedevschi, S. (2009) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2009.2018328 · Cited by 127
A Dynamic Conditional Random Field Model for Joint Labeling of Object and Scene Classes
Wojek, C., & Schiele, B. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-88693-8_54 · Cited by 110
3D Scene priors for road detection
Álvarez, J. M., Gevers, T., & López, A. M. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5540228 · Cited by 98
A novel multi-lane detection and tracking system
Zhao, K., Meuter, M., Nunn, C., Müller, D., Müller-Schneiders, S., & Pauli, J. (2012) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2012.6232168 · Cited by 88
Development, evaluation and introduction of a lane keeping assistance system
Ishida, S., & Gayko, J. (2004) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2004.1336512 · Cited by 88
Lane Recognition on Country Roads
Franke, U., Loose, H., & Knöppel, C. (2007) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2007.4290098 · Cited by 73
Spatial ray features for real-time ego-lane extraction
Kühnl, T., Kümmert, F., & Fritsch, J. (2012) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2012.6338740 · Cited by 72
Self-citationGuo, C., Mita, S., & McAllester, D. (2012) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2012.2187896 · Cited by 68
A generative model for 3D urban scene understanding from movable platforms
Geiger, A., Lauer, M., & Urtasun, R. (2011) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2011.5995641 · Cited by 58
Self-citationMultiband Image Segmentation and Object Recognition for Understanding Road Scenes
Kang, Y., Yamaguchi, K., Naito, T., & Ninomiya, Y. (2011) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2011.2160539 · Cited by 52
Siegemund, J., Franke, U., & Förstner, W. (2011) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2011.5940447 · Cited by 48
Monocular road segmentation using slow feature analysis
Kühnl, T., Kümmert, F., & Fritsch, J. (2011) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2011.5940416 · Cited by 47
Self-citationCamera based detection and classification of soft shoulders, curbs and guardrails
Seibert, A., Hähnel, M., Tewes, A. H. J., et al. (2013) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2013.6629573 · Cited by 46
Road course estimation in occupancy grids
Konrad, M., Szczot, M., & Dietmayer, K. (2010) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2010.5548041 · Cited by 43
Fast visual road recognition and horizon detection using multiple artificial neural networks
Shinzato, P. Y., Grassi, V., Osório, F. S., et al. (2012) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2012.6232175 · Cited by 39
Towards multi-cue urban curb recognition
Enzweiler, M., Greiner, P., Knöppel, C., & Franke, U. (2013) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2013.6629581 · Cited by 37
Fast road detection from color images
Wang, B., & Frémont, V. (2013) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2013.6629631 · Cited by 29
Learning appearance models for road detection
Álvarez, J. M., Salzmann, M., & Barnes, N. M. (2013) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2013.6629505 · Cited by 29
Novel Index for Objective Evaluation of Road Detection Algorithms
Álvarez, J. M., & López, A. M. (2008) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2008.4732651 · Cited by 23
On feature templates for Particle Filter based lane detection
Linarth, A. G., & Angelopoulou, E. (2011) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2011.6083016 · Cited by 19
Serfling, M., Schweiger, R., & Ritter, W. (2008) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2008.4621312 · Cited by 18
Guo, C., Yamabe, T., & Mita, S. (2012) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2012.6232149 · Cited by 13
Example-based clear path detection assisted by vanishing point estimation
Wu, Q., Zhang, W., & Kumar, B. V. K. V. (2011) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2011.5979617 · Cited by 13
Lane confidence fusion for visual occupancy estimation
Gumpp, T., Nienhüser, D., & Zöllner, J. M. (2011) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2011.5940497 · Cited by 4
Research works printed but not linked: 3
- kuehnl, 2012, Spatial ray features for realtime ego-lane extraction, Proc IEEE Intelligent Transportation Systems Conf, 288
- enzweiler, 2013, Towards multicue urban curb recognition, Proc IEEE Intelligent Vehicles Symp, 902
- wojek, 2008, A dynamic cRF model for joint labeling of object and scene classes, European Conference on Computer Vision, 5305, 733
Cited by
CCNet: Criss-Cross Attention for Semantic Segmentation
Huang, Z., Wang, X., Huang, L., Huang, C., Wei, Y., & Liu, W. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00069 · Cited by 3,045
BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning
Yu, F., Chen, H., Wang, X., Xian, W., Chen, Y., Liu, F., Madhavan, V., & Darrell, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00271 · Cited by 2,641
Attention to Scale: Scale-Aware Semantic Image Segmentation
Chen, L.-C., Yang, Y., Wang, J., Xu, W., & Yuille, A. L. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.396 · Cited by 1,377
CGNet: A Light-Weight Context Guided Network for Semantic Segmentation
Wu, T., Tang, S., Zhang, R., Cao, J., & Zhang, Y. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3042065 · Cited by 859
MultiNet: Real-time Joint Semantic Reasoning for Autonomous Driving
Teichmann, M., Weber, M., Zollner, M., Cipolla, R., & Urtasun, R. (2018) · 2018 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/ivs.2018.8500504 · Cited by 681
Metadata
- Authors
- Fritsch, J., Kuhnl, T., & Geiger, A.
- Affiliations
- Karlsruhe Institute of Technology (DE)
- ORCID
- Geiger, Andreas
- Venue
- 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013)
- Publisher
- IEEE
- Published
- 2013-10
- Pages
- 1693-1700
- OpenAlex
- W2167222293
- Cited by
- 690
- References
- 31
- Citations by year
- 2026: 20 · 2025: 31 · 2024: 61 · 2023: 53 · 2022: 67 · 2021: 76 · 2020: 69 · 2019: 73 · 2018: 75 · 2017: 61 · 2016: 33 · 2015: 41 · 2014: 29 · 2013: 1
- FWCI
- 44.22
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE International Conference on Intelligent Transportation Systems (ITSC) (publishedVersion)
- Topics
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Automated Road and Building Extraction
- Keywords
- road detection, driver assistance systems, benchmark dataset, bird's-eye view, urban road scenes, KITTI dataset, autonomous driving
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.