The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Learning Lightweight Lane Detection CNNs by Self Attention Distillation
Open accessAbstract
Training deep models for lane detection is challenging due to the very subtle and sparse supervisory signals inherent in lane annotations. Without learning from much richer context, these models often fail in challenging scenarios, e.g., severe occlusion, ambiguous lanes, and poor lighting conditions. In this paper, we present a novel knowledge distillation approach, i.e., Self Attention Distillation (SAD), which allows a model to learn from itself and gains substantial improvement without any additional supervision or labels. Specifically, we observe that attention maps extracted from a model trained to a reasonable level would encode rich contextual information. The valuable contextual information can be used as a form of `free' supervision for further representation learning through performing top- down and layer-wise attention distillation within the net- work itself. SAD can be easily incorporated in any feed- forward convolutional neural networks (CNN) and does not increase the inference time. We validate SAD on three popular lane detection benchmarks (TuSimple, CULane and BDD100K) using lightweight models such as ENet, ResNet- 18 and ResNet-34. The lightest model, ENet-SAD, performs comparatively or even surpasses existing algorithms. Notably, ENet-SAD has 20 × fewer parameters and runs 10 × faster compared to the state-of-the-art SCNN, while still achieving compelling performance in all benchmarks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
Multi-scale context aggregation by dilated convolutions
Yu, F., & Koltun, V. (2015) · arXiv · doi:10.48550/arxiv.1511.07122 · Cited by 7,738 · cited 1×
“Dilated convolution [22] is added to replace the original convolution layers in the lane existence prediction branch to increase the receptive field of the network without increasing the number of parameters.”
MethodLarge-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2010) · Proceedings of COMPSTAT'2010 · doi:10.1007/978-3-7908-2604-3_16 · Cited by 5,795
Residual Attention Network for Image Classification
Wang, F., Jiang, M., Qian, C., Yang, S., Li, C., Zhang, H., Wang, X., & Tang, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.683 · Cited by 4,073
Holistically-Nested Edge Detection
Xie, S., & Tu, Z. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.164 · Cited by 3,096
Zagoruyko, S., & Komodakis, N. (2016) · arXiv · doi:10.48550/arxiv.1612.03928 · Cited by 2,027
ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation
Paszke, A., Chaurasia, A., Kim, S., & Culurciello, E. (2016) · arXiv · doi:10.48550/arxiv.1606.02147 · Cited by 1,826 · cited 5×
“We further present several architectural reformulations to ENet [17] for improved performance.”
BackgroundMethodInfluentialA Gift from Knowledge Distillation: Fast Optimization, Network Minimization and Transfer Learning
Yim, J., Joo, D., Bae, J., & Kim, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.754 · Cited by 1,570
Attention to Scale: Scale-Aware Semantic Image Segmentation
Chen, L.-C., Yang, Y., Wang, J., Xu, W., & Yuille, A. L. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.396 · Cited by 1,377
Spatial as Deep: Spatial CNN for Traffic Scene Understanding
Pan, X., Shi, J., Luo, P., Wang, X., & Tang, X. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12301 · Cited by 1,177
GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection
Bertozzi, M., & Broggi, A. (1998) · IEEE Transactions on Image Processing · doi:10.1109/83.650851 · Cited by 1,010
Towards End-to-End Lane Detection: an Instance Segmentation Approach
Neven, D., Brabandere, B. D., Georgoulis, S., Proesmans, M., & Gool, L. V. (2018) · 2018 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/ivs.2018.8500547 · Cited by 849
(2018) · arXiv (Cornell University) · Cited by 679
VPGNet: Vanishing Point Guided Network for Lane and Road Marking Detection and Recognition
Lee, S., Kim, J., Yoon, J. S., Shin, S., Bailo, O., Kim, N., Lee, T.-H., Hong, H. S., Han, S.-H., & Kweon, I. S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.215 · Cited by 473
Furlanello, T., Lipton, Z. C., Tschannen, M., Itti, L., & Anandkumar, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.04770 · Cited by 407
A Novel Lane Detection System With Efficient Ground Truth Generation
Borkar, A., Hayes, M., & Smith, M. T. (2012) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2011.2173196 · Cited by 240
EL-GAN: Embedding Loss Driven Generative Adversarial Networks for Lane Detection
Ghafoorian, M., Nugteren, C., Baka, N., Booij, O., & Hofmann, M. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11009-3_15 · Cited by 222
RBNet: A Deep Neural Network for Unified Road and Road Boundary Detection
Chen, Z., & Chen, Z. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-70087-8_70 · Cited by 159
Accurate and robust lane detection based on Dual-View Convolutional Neutral Network
He, B., Ai, R., Yang, Y. X., & Lang, X. (2016) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2016.7535517 · Cited by 135
Geometric Constrained Joint Lane Segmentation and Lane Boundary Detection
Zhang, J., Xu, Y. X., Ni, B., & Duan, Z. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01246-5_30 · Cited by 76
Learning to Steer by Mimicking Features from Heterogeneous Auxiliary Networks
Hou, Y., Ma, Z., Liu, C., & Loy, C. C. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018433 · Cited by 76
Self-citationA random finite set approach to multiple lane detection
Deusch, H., Wiest, J., Reuter, S., Szczot, M., Konrad, M., & Dietmayer, K. (2012) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2012.6338772 · Cited by 67
Cited by
Knowledge Distillation: A Survey
Gou, J., Yu, B., Maybank, S. J., & Tao, D. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01453-z · Cited by 3,931
Ultra Fast Structure-Aware Deep Lane Detection
Qin, Z., Wang, H., & Li, X. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58586-0_17 · Cited by 554
Keep your Eyes on the Lane: Real-time Attention-guided Lane Detection
Tabelini, L., Berriel, R., Paixao, T. M., Badue, C., De Souza, A. F., & Oliveira-Santos, T. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00036 · Cited by 478
YOLOP: You Only Look Once for Panoptic Driving Perception
Wu, D., Liao, M.-W., Zhang, W.-T., Wang, X.-G., Bai, X., Cheng, W.-Q., & Liu, W.-Y. (2022) · Machine Intelligence Research · doi:10.1007/s11633-022-1339-y · Cited by 466
Computing Systems for Autonomous Driving: State of the Art and Challenges
Liu, L., Lu, S., Zhong, R., Wu, B., Yao, Y., Zhang, Q., & Shi, W. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3043716 · Cited by 450
Metadata
- Authors
- Hou, Y., Ma, Z., Liu, C., & Loy, C. C.
- Venue
- 2019 IEEE/CVF International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2019-10
- Pages
- 1013-1021
- OpenAlex
- W2981441441
- Cited by
- 780
- References
- 23
- FWCI
- 25.55
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.