The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
L3-Net: Towards Learning Based LiDAR Localization for Autonomous Driving
Abstract
We present L3-Net - a novel learning-based LiDAR localization system that achieves centimeter-level localization accuracy, comparable to prior state-of-the-art systems with hand-crafted pipelines. Rather than relying on these hand-crafted modules, we innovatively implement the use of various deep neural network structures to establish a learning-based approach. L3-Net learns local descriptors specifically optimized for matching in different real-world driving scenarios. 3D convolutions over a cost volume built in the solution space significantly boosts the localization accuracy. RNNs are demonstrated to be effective in modeling the vehicle's dynamics, yielding better temporal smoothness and accuracy. We comprehensively validate the effectiveness of our approach using freshly collected datasets. Multiple trials of repetitive data collection over the same road and areas make our dataset ideal for testing localization systems. The SunnyvaleBigLoop sequences, with a year's time interval between the collected mapping and testing data, made it quite challenging, but the low localization error of our method in these datasets demonstrates its maturity for real industrial implementation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A method for registration of 3-D shapes
Besl, P. J., & McKay, N. D. (1992) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.121791 · Cited by 18,103
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
Charles, R. Q., Su, H., Kaichun, M., & Guibas, L. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.16 · Cited by 9,237
PoseNet: A Convolutional Network for Real-Time 6-DOF Camera Relocalization
Kendall, A., Grimes, M., & Cipolla, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.336 · Cited by 2,489
1 year, 1000 km: The Oxford RobotCar dataset
Maddern, W., Pascoe, G., Linegar, C., & Newman, P. (2017) · The International Journal of Robotics Research · doi:10.1177/0278364916679498 · Cited by 1,632
The normal distributions transform: a new approach to laser scan matching
Biber, P., & Strasser, W. (2004) · Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453) · doi:10.1109/iros.2003.1249285 · Cited by 1,554
Long-Term Recurrent Convolutional Networks for Visual Recognition and Description
Donahue, J., Hendricks, L. A., Rohrbach, M., Venugopalan, S., Guadarrama, S., Saenko, K., & Darrell, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2599174 · Cited by 1,547
Segal, A., Haehnel, D., & Thrun, S. (2009) · Robotics: Science and Systems V · doi:10.15607/rss.2009.v.021 · Cited by 1,526
End-to-End Learning of Geometry and Context for Deep Stereo Regression
Kendall, A., Martirosyan, H., Dasgupta, S., Henry, P., Kennedy, R., Bachrach, A., & Bry, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.17 · Cited by 1,470
MVSNet: Depth Inference for Unstructured Multi-view Stereo
Yao, Y., Luo, Z., Li, S., Fang, T., & Quan, L. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01237-3_47 · Cited by 1,455
3DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructions
Zeng, A., Song, S., Niessner, M., Fisher, M., Xiao, J., & Funkhouser, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.29 · Cited by 1,128
Self-citationGeometric Loss Functions for Camera Pose Regression with Deep Learning
Kendall, A., & Cipolla, R. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.694 · Cited by 803
Efficient Deep Learning for Stereo Matching
Luo, W., Schwing, A. G., & Urtasun, R. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.614 · Cited by 741
Weinmann, M., Jutzi, B., Hinz, S., & Mallet, C. (2015) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2015.01.016 · Cited by 709
PPFNet: Global Context Aware Local Features for Robust 3D Point Matching
Deng, H., Birdal, T., & Ilic, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00028 · Cited by 631
Robust vehicle localization in urban environments using probabilistic maps
Levinson, J., & Thrun, S. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509700 · Cited by 581
Deep Stereo: Learning to Predict New Views from the World's Imagery
Flynn, J., Neulander, I., Philbin, J., & Snavely, N. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.595 · Cited by 574
An Open Approach to Autonomous Vehicles
Kato, S., Takeuchi, E., Ishiguro, Y., Ninomiya, Y., Takeda, K., & Hamada, T. (2015) · IEEE Micro · doi:10.1109/mm.2015.133 · Cited by 564
Image-Based Localization Using LSTMs for Structured Feature Correlation
Walch, F., Hazirbas, C., Leal-Taixe, L., Sattler, T., Hilsenbeck, S., & Cremers, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.75 · Cited by 521
Map-Based Precision Vehicle Localization in Urban Environments
Levinson, J., Montemerlo, M., & Thrun, S. (2007) · Robotics: Science and Systems III · doi:10.15607/rss.2007.iii.016 · Cited by 477
Geometry-Aware Learning of Maps for Camera Localization
Brahmbhatt, S., Gu, J., Kim, K., Hays, J., & Kautz, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00277 · Cited by 417
Ford Campus vision and lidar data set
Pandey, G., McBride, J. R., & Eustice, R. M. (2011) · The International Journal of Robotics Research · doi:10.1177/0278364911400640 · Cited by 360
Robust and Precise Vehicle Localization Based on Multi-Sensor Fusion in Diverse City Scenes
Wan, G., Yang, X., Cai, R., Li, H., Zhou, Y., Wang, H., & Song, S. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8461224 · Cited by 299
Self-citationVidLoc: A Deep Spatio-Temporal Model for 6-DoF Video-Clip Relocalization
Clark, R., Wang, S., Markham, A., Trigoni, N., & Wen, H. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.284 · Cited by 249
3D Point Cloud Registration for Localization Using a Deep Neural Network Auto-Encoder
Elbaz, G., Avraham, T., & Fischer, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.265 · Cited by 241
Image-Based Localization Using Hourglass Networks
Melekhov, I., Ylioinas, J., Kannala, J., & Rahtu, E. (2017) · 2017 IEEE International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw.2017.107 · Cited by 197
Fast LIDAR localization using multiresolution Gaussian mixture maps
Wolcott, R. W., & Eustice, R. M. (2015) · 2015 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2015.7139582 · Cited by 188
Robust LIDAR localization using multiresolution Gaussian mixture maps for autonomous driving
Wolcott, R. W., & Eustice, R. M. (2017) · The International Journal of Robotics Research · doi:10.1177/0278364917696568 · Cited by 169
Synthetic 2D LIDAR for precise vehicle localization in 3D urban environment
Chong, Z. J., Qin, B., Bandyopadhyay, T., Ang, M. H., Frazzoli, E., & Rus, D. L. (2013) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2013.6630777 · Cited by 109
Autonomous driving in a multi-level parking structure
Kummerle, R., Hähnel, D., Dolgov, D., Thrun, S., & Burgard, W. (2009) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2009.5152365 · Cited by 103
LocNet: Global Localization in 3D Point Clouds for Mobile Vehicles
Yin, H., Tang, L., Ding, X., Wang, Y., & Xiong, R. (2018) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2018.8500682 · Cited by 103
Lidar scan feature for localization with highly precise 3-D map
Yoneda, K., Tehrani, H., Ogawa, T., Hukuyama, N., & Mita, S. (2014) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2014.6856596 · Cited by 94
Learning to Localize Using a LiDAR Intensity MapPreprint
Bârsan, I. A., Wang, S., Pokrovsky, A., & Urtasun, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.10902 · Cited by 92
Kim, H., Liu, B., Goh, C. Y., Lee, S., & Myung, H. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2017.2673868 · Cited by 89
DeLS-3D: Deep Localization and Segmentation with a 3D Semantic Map
Wang, P., Yang, R., Cao, B., Xu, W., & Lin, Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00614 · Cited by 67
Incremental-Segment-Based Localization in 3-D Point Clouds
Dubé, R., Gollub, M. G., Sommer, H., et al. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2803213 · Cited by 61
Leveraging experience for large-scale LIDAR localisation in changing cities
Maddern, W., Pascoe, G., & Newman, P. M. (2015) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2015.7139414 · Cited by 57
Map-relative localization in lane-level maps for ADAS and autonomous driving
Matthaei, R., Bagschik, G., & Maurer, M. (2014) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2014.6856428 · Cited by 50
Localization using automotive laser scanners and local pattern matching
Schlichting, A., & Claus Brenner, A. (2014) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2014.6856460 · Cited by 44
Localization based on region descriptors in grid maps
Wiest, J., Deusch, H., Nuß, D., Reuter, S., Fritzsche, M., & Dietmayer, K. (2014) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2014.6856507 · Cited by 21
Cited by
A Survey of Deep Learning-Based Object Detection
Jiao, L., Zhang, F., Liu, F., Yang, S., Li, L., Feng, Z., & Qu, R. (2019) · IEEE Access · doi:10.1109/access.2019.2939201 · Cited by 1,323
Deep Learning Sensor Fusion for Autonomous Vehicle Perception and Localization: A Review
Fayyad, J., Jaradat, M. A., Gruyer, D., & Najjaran, H. (2020) · Sensors · doi:10.3390/s20154220 · Cited by 498
Deep learning in multi-object detection and tracking: state of the art
Pal, S. K., Pramanik, A., Maiti, J., & Mitra, P. (2021) · Applied Intelligence · doi:10.1007/s10489-021-02293-7 · Cited by 298
Metadata
- Authors
- Lu, W., Zhou, Y., Wan, G., Hou, S., & Song, S.
- Venue
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2019-06
- Pages
- 6382-6391
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2955544543
- Cited by
- 311
- References
- 40
- FWCI
- 65.35
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.