Towards End-to-End Lane Detection: an Instance Segmentation Approach
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
Modern cars are incorporating an increasing number of driver assist features, among which automatic lane keeping. The latter allows the car to properly position itself within the road lanes, which is also crucial for any subsequent lane departure or trajectory planning decision in fully autonomous cars. Traditional lane detection methods rely on a combination of highly-specialized, hand-crafted features and heuristics, usually followed by post-processing techniques, that are computationally expensive and prone to scalability due to road scene variations. More recent approaches leverage deep learning models, trained for pixel-wise lane segmentation, even when no markings are present in the image due to their big receptive field. Despite their advantages, these methods are limited to detecting a pre-defined, fixed number of lanes, e.g. ego-lanes, and can not cope with lane changes. In this paper, we go beyond the aforementioned limitations and propose to cast the lane detection problem as an instance segmentation problem - in which each lane forms its own instance - that can be trained end-to-end. To parametrize the segmented lane instances before fitting the lane, we further propose to apply a learned perspective transformation, conditioned on the image, in contrast to a fixed ”bird's-eye view” transformation. By doing so, we ensure a lane fitting which is robust against road plane changes, unlike existing approaches that rely on a fixed, predefined transformation. In summary, we propose a fast lane detection algorithm, running at 50 fps, which can handle a variable number of lanes and cope with lane changes. We verify our method on the tuSimple dataset and achieve competitive results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
Learning Deconvolution Network for Semantic Segmentation
Noh, H., Hong, S., & Han, B. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.178 · Cited by 4,422
ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation
Paszke, A., Chaurasia, A., Kim, S., & Culurciello, E. (2016) · arXiv · doi:10.48550/arxiv.1606.02147 · Cited by 1,826
Instance-aware Semantic Segmentation via Multi-task Network Cascades
Dai, J., He, K., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.04412 · Cited by 1,273
Instance-Aware Semantic Segmentation via Multi-task Network Cascades
Dai, J., He, K., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.343 · Cited by 1,244
Recent progress in road and lane detection: A survey
Bar Hillel, A., Lerner, R., Levi, D., & Raz, G. (2014) · Machine Vision and Applications · doi:10.1007/s00138-011-0404-2 · Cited by 775
Real time detection of lane markers in urban streets
Aly, M. (2008) · 2008 IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2008.4621152 · Cited by 678
Real time Detection of Lane Markers in Urban Streets
Aly, M. (2008) · Cited by 592
Robust Lane Detection and Tracking in Challenging Scenarios
Kim, Z. (2008) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2007.908582 · Cited by 586
Deep Watershed Transform for Instance Segmentation
Bai, M., & Urtasun, R. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.305 · Cited by 539
An Empirical Evaluation of Deep Learning on Highway Driving
Huval, B., Wang, T., Tandon, S., Kiske, J., Song, W., Pazhayampallil, J., Andriluka, M., Rajpurkar, P., Migimatsu, T., Cheng-Yue, R., et al. (2015) · arXiv · doi:10.48550/arxiv.1504.01716 · Cited by 537
VPGNet: Vanishing Point Guided Network for Lane and Road Marking Detection and Recognition
Lee, S., Kim, J., Yoon, J. S., Shin, S., Bailo, O., Kim, N., Lee, T.-H., Hong, H. S., Han, S.-H., & Kweon, I. S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.215 · Cited by 473
Deep Neural Network for Structural Prediction and Lane Detection in Traffic Scene
Li, J., Mei, X., Prokhorov, D., & Tao, D. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2522428 · Cited by 435
Recurrent Instance Segmentation
Romera-Paredes, B., & Torr, P. H. S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_19 · Cited by 311
Lane detection using color-based segmentation
Chiu, K.-Y., & Lin, S.-F. (2005) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2005.1505186 · Cited by 242
A Novel Lane Detection System With Efficient Ground Truth Generation
Borkar, A., Hayes, M., & Smith, M. T. (2012) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2011.2173196 · Cited by 240
A novel lane detection based on geometrical model and Gabor filter
Zhou, S., Jiang, Y., Xi, J., Gong, J., Xiong, G., & Chen, H. (2010) · 2010 IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2010.5548087 · Cited by 234
DeepLanes: End-To-End Lane Position Estimation Using Deep Neural Networks
Gurghian, A., Koduri, T., Bailur, S. V., Carey, K. J., & Murali, V. N. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.12 · Cited by 183
A Learning Approach Towards Detection and Tracking of Lane Markings
Gopalan, R., Hong, T., Shneier, M., & Chellappa, R. (2012) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2012.2184756 · Cited by 182
End-To-End Ego Lane Estimation Based on Sequential Transfer Learning for Self-Driving Cars
Kim, J., & Park, C. (2017) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.158 · Cited by 178
Robust Lane Detection Based On Convolutional Neural Network and Random Sample Consensus
Kim, J., & Lee, M. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-12637-1_57 · Cited by 174
Monocular Object Instance Segmentation and Depth Ordering with CNNs
Zhang, Z., Schwing, A. G., Fidler, S., & Urtasun, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.300 · Cited by 152
Lane-mark extraction for automobiles under complex conditions
Wu, P.-C., Chang, C.-Y., & Lin, C. H. (2014) · Pattern Recognition · doi:10.1016/j.patcog.2014.02.004 · Cited by 150
Probabilistic Lane Tracking in Difficult Road Scenarios Using Stereovision
Danescu, R., & Nedevschi, S. (2009) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2009.2018328 · Cited by 127
Combining Statistical Hough Transform and Particle Filter for robust lane detection and tracking
Liu, G., Wörgötter, F., & Markelić, I. (2010) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2010.5548021 · Cited by 114
Robust lane markings detection and road geometry computation
López, A. M., Serrat, J., Cañero, C., Lumbreras, F., & Graf, T. (2010) · International Journal of Automotive Technology · doi:10.1007/s12239-010-0049-6 · Cited by 104
Kalman Particle Filter for lane recognition on rural roads
Loose, H., Franke, U., & Stiller, C. (2009) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2009.5164253 · Cited by 97
An efficient lane detection algorithm for lane departure detection
Jung, H., Min, J., & Kim, J. (2013) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2013.6629593 · Cited by 92
A novel curve lane detection based on Improved River Flow and RANSA
Tan, H., Zhou, Y., Zhu, Y. C., Yao, D., & Li, K. (2014) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2014.6957679 · Cited by 71
Real-time lane detection by using multiple cues
Zhu, T., Kim, J., & Kang, D. (2010) · International Conference on Control, Automation and Systems (ICCAS) · doi:10.1109/iccas.2010.5669923 · Cited by 70
A random finite set approach to multiple lane detection
Deusch, H., Wiest, J., Reuter, S., Szczot, M., Konrad, M., & Dietmayer, K. (2012) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2012.6338772 · Cited by 67
Stable Road Lane Model Based on Clothoids
Gackstatter, C., Heinemann, P., Thomas, S., & Klinker, G. (2010) · Springer eBooks · doi:10.1007/978-3-642-16362-3_14 · Cited by 34
Multiple Cue Data Fusion with Particle Filters for Road Course Detection in Vision Systems
Smuda, P., Schweiger, R., Heiko Neumann, B., & Ritter, W. (2006) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2006.1689661 · Cited by 33
Cited by
Learning Lightweight Lane Detection CNNs by Self Attention Distillation
Hou, Y., Ma, Z., Liu, C., & Loy, C. C. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00110 · Cited by 780
Ultra Fast Structure-Aware Deep Lane Detection
Qin, Z., Wang, H., & Li, X. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58586-0_17 · Cited by 554
YOLOP: You Only Look Once for Panoptic Driving Perception
Wu, D., Liao, M.-W., Zhang, W.-T., Wang, X.-G., Bai, X., Cheng, W.-Q., & Liu, W.-Y. (2022) · Machine Intelligence Research · doi:10.1007/s11633-022-1339-y · Cited by 466
Computing Systems for Autonomous Driving: State of the Art and Challenges
Liu, L., Lu, S., Zhong, R., Wu, B., Yao, Y., Zhang, Q., & Shi, W. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3043716 · Cited by 450
Research Advances and Challenges of Autonomous and Connected Ground Vehicles
Eskandarian, A., Wu, C., & Sun, C. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2958352 · Cited by 381
Metadata
- Authors
- Neven, D., Brabandere, B. D., Georgoulis, S., Proesmans, M., & Gool, L. V.
- Venue
- 2018 IEEE Intelligent Vehicles Symposium (IV)
- Publisher
- IEEE
- Published
- 2018-06
- Pages
- 286-291
- ISSN
- 1931-0587 (ISSN-L)
- OpenAlex
- W2785872028
- Cited by
- 849
- References
- 37
- FWCI
- 67.60
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.