The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
LCDNet: Deep Loop Closure Detection and Point Cloud Registration for LiDAR SLAM
Open accessAbstract
Loop closure detection is an essential component of simultaneous localization and mapping (SLAM) systems, which reduces the drift accumulated over time. Over the years, several deep learning approaches have been proposed to address this task; however, their performance has been subpar compared to handcrafted techniques, especially while dealing with reverse loops. In this article, we introduce the novel loop closure detection network (LCDNet) that effectively detects loop closures in light detection and ranging (LiDAR) point clouds by simultaneously identifying previously visited places and estimating the six degrees of freedom relative transformation between the current scan and the map. LCDNet is composed of a shared encoder, a place recognition head that extracts global descriptors, and a relative pose head that estimates the transformation between two point clouds. We introduce a novel relative pose head based on the unbalanced optimal transport theory that we implement in a differentiable manner to allow for end-to-end training. Extensive evaluations of LCDNet on multiple real-world autonomous driving datasets show that our approach outperforms state-of-the-art loop closure detection and point cloud registration techniques by a large margin, especially while dealing with reverse loops. Moreover, we integrate our proposed loop closure detection approach into a LiDAR SLAM library to provide a complete mapping system and demonstrate the generalization ability using different sensor setup in an unseen city.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Fischler, M. A., & Bolles, R. C. (1981) · Communications of the ACM · doi:10.1145/358669.358692 · Cited by 25,893
FaceNet: A unified embedding for face recognition and clustering
Schroff, F., Kalenichenko, D., & Philbin, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298682 · Cited by 15,267
SURF: Speeded Up Robust Features
Bay, H., Tuytelaars, T., & Van Gool, L. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_32 · Cited by 14,955
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
(1981) · Cited by 11,963
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
Charles, R. Q., Su, H., Kaichun, M., & Guibas, L. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.16 · Cited by 9,237
Dynamic Graph CNN for Learning on Point Clouds
Wang, Y., Sun, Y., Liu, Z., Sarma, S. E., Bronstein, M. M., & Solomon, J. M. (2019) · ACM Transactions on Graphics · doi:10.1145/3326362 · Cited by 7,199
ORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2463671 · Cited by 6,778
Billion-scale similarity search with GPUs
Johnson, J., Douze, M., & Jegou, H. (2021) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2019.2921572 · Cited by 4,228
Billion-scale similarity search with GPUs
Johnson, J., Douze, M., & Jégou, H. (2017) · arXiv · doi:10.48550/arxiv.1702.08734 · Cited by 4,140
Fast Point Feature Histograms (FPFH) for 3D registration
Rusu, R. B., Blodow, N., & Beetz, M. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152473 · Cited by 3,878
ORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · Zaguan (Universidad de Zaragoza) · Cited by 3,153
SuperGlue: Learning Feature Matching With Graph Neural Networks
Sarlin, P.-E., DeTone, D., Malisiewicz, T., & Rabinovich, A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00499 · Cited by 2,830
Aggregating local descriptors into a compact image representation
Jegou, H., Douze, M., Schmid, C., & Perez, P. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540039 · Cited by 2,692
NetVLAD: CNN Architecture for Weakly Supervised Place Recognition
Arandjelovic, R., Gronat, P., Torii, A., Pajdla, T., & Sivic, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.572 · Cited by 2,584
Method for registration of 3-D shapes:
Besl, P. J., & McKay, N. D. (1992) · SPIE Proceedings · doi:10.1117/12.57955 · Cited by 2,413
Iterative point matching for registration of free-form curves and surfaces
Zhang, Z. (1994) · International Journal of Computer Vision · doi:10.1007/bf01427149 · Cited by 2,402
PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detection
Shi, S., Guo, C., Jiang, L., Wang, Z., Shi, J., Wang, X., & Li, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01054 · Cited by 2,341
SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR Sequences
Behley, J., Garbade, M., Milioto, A., Quenzel, J., Behnke, S., Stachniss, C., & Gall, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00939 · Cited by 2,294
RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Clouds
Hu, Q., Yang, B., Xie, L., Rosa, S., Guo, Y., Wang, Z., Trigoni, N., & Markham, A. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01112 · Cited by 2,275
LIO-SAM: Tightly-coupled Lidar Inertial Odometry via Smoothing and Mapping
Shan, T., Englot, B., Meyers, D., Wang, W., Ratti, C., & Rus, D. (2020) · 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341176 · Cited by 2,199
NetVLAD: CNN architecture for weakly supervised place recognitionPreprint
Arandjelović, R., Gronát, P., Torii, A., Pajdla, T., & Šivic, J. (2015) · arXiv (Cornell University) · Cited by 1,790
Clustering to minimize the maximum intercluster distance
Gonzalez, T. F. (1985) · Theoretical Computer Science · doi:10.1016/0304-3975(85)90224-5 · Cited by 1,717
A 3-dimensional sift descriptor and its application to action recognition
Scovanner, P., Ali, S., & Shah, M. (2007) · Proceedings of the 15th ACM international conference on Multimedia · doi:10.1145/1291233.1291311 · Cited by 1,596
Segal, A., Haehnel, D., & Thrun, S. (2009) · Robotics: Science and Systems V · doi:10.15607/rss.2009.v.021 · Cited by 1,526
FAB-MAP: Probabilistic Localization and Mapping in the Space of Appearance
Cummins, M., & Newman, P. (2008) · The International Journal of Robotics Research · doi:10.1177/0278364908090961 · Cited by 1,472
Go-ICP: A Globally Optimal Solution to 3D ICP Point-Set Registration
Yang, J., Li, H., Campbell, D., & Jia, Y. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2513405 · Cited by 1,170
Deep Closest Point: Learning Representations for Point Cloud Registration
Wang, Y., & Solomon, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00362 · Cited by 1,112
A Relationship Between Arbitrary Positive Matrices and Doubly Stochastic Matrices
Sinkhorn, R. (1964) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177703591 · Cited by 1,032
Zhou, Q.-Y., Park, J., & Koltun, V. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_47 · Cited by 1,028
Scan Context: Egocentric Spatial Descriptor for Place Recognition Within 3D Point Cloud Map
Kim, G., & Kim, A. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593953 · Cited by 904
PointNetLK: Robust & Efficient Point Cloud Registration Using PointNet
Aoki, Y., Goforth, H., Srivatsan, R. A., & Lucey, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00733 · Cited by 896
TEASER: Fast and Certifiable Point Cloud Registration
Yang, H., Shi, J., & Carlone, L. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2020.3033695 · Cited by 895
Intrinsic shape signatures: A shape descriptor for 3D object recognition
Zhong, Y. (2009) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2009.5457637 · Cited by 823
Comparing ICP variants on real-world data sets: Open-source library and experimental protocol
Pomerleau, F., Colas, F., Siegwart, R., & Magnenat, S. (2013) · Autonomous Robots · doi:10.1007/s10514-013-9327-2 · Cited by 760
Fully Convolutional Geometric Features
Choy, C., Park, J., & Koltun, V. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00905 · Cited by 759
PointNetVLAD: Deep Point Cloud Based Retrieval for Large-Scale Place Recognition
Uy, M. A., & Lee, G. H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00470 · Cited by 670
The Trimmed Iterative Closest Point algorithm
Chetverikov, D., Svirko, D., Stepanov, D., & Krsek, P. (2003) · Object recognition supported by user interaction for service robots · doi:10.1109/icpr.2002.1047997 · Cited by 617
RPM-Net: Robust Point Matching Using Learned Features
Yew, Z. J., & Lee, G. H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01184 · Cited by 615
Choy, C., Dong, W., & Koltun, V. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00259 · Cited by 548
Gelfand, N., Mitra, N. J., Guibas, L., & Pottmann, H. (2005) · doi:10.2312/sgp/sgp05/197-206 · Cited by 514
M2DP: A novel 3D point cloud descriptor and its application in loop closure detection
He, L., Wang, X., & Zhang, H. (2016) · 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759060 · Cited by 395
Scaling algorithms for unbalanced optimal transport problems
Chizat, L., Peyré, G., Schmitzer, B., & Vialard, F.-X. (2018) · Mathematics of Computation · doi:10.1090/mcom/3303 · Cited by 336
PCRNet: Point Cloud Registration Network using PointNet EncodingPreprint
Sarode, V., Li, X.-Q., Goforth, H., Aoki, Y., Srivatsan, R. A., Lucey, S., & Choset, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.07906 · Cited by 334
Hough Transform and 3D SURF for Robust Three Dimensional Classification
Knopp, J., Prasad, M., Willems, G., Timofte, R., & Van Gool, L. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15567-3_43 · Cited by 326
Kim, G., Choi, S., & Kim, A. (2022) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3116424 · Cited by 319
Intensity Scan Context: Coding Intensity and Geometry Relations for Loop Closure Detection
Wang, H., Wang, C., & Xie, L. (2020) · 2020 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra40945.2020.9196764 · Cited by 308
One Point Isometric Matching with the Heat Kernel
Ovsjanikov, M., Mérigot, Q., Mémoli, F., & Guibas, L. (2010) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2010.01764.x · Cited by 301
MulRan: Multimodal Range Dataset for Urban Place Recognition
Kim, G., Park, Y. S., Cho, Y., Jeong, J., & Kim, A. (2020) · 2020 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra40945.2020.9197298 · Cited by 301
Style Transfer by Relaxed Optimal Transport and Self-Similarity
Kolkin, N., Salavon, J., & Shakhnarovich, G. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01029 · Cited by 281
LiDAR Iris for Loop-Closure Detection
Wang, Y., Sun, Z., Xu, C.-Z., Sarma, S. E., Yang, J., & Kong, H. (2020) · 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341010 · Cited by 272
Intensity Scan Context: Coding Intensity and Geometry Relations for Loop Closure Detection
Wang, H., Chen, W., & Xie, L. (2020) · IEEE Conference Proceedings · Cited by 222
Learnable pooling with Context Gating for video classification
Miech, A., Ivan Laptev, A., & Šivic, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.06905 · Cited by 218
FLOT: Scene Flow on Point Clouds Guided by Optimal Transport
Puy, G., Boulch, A., & Marlet, R. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58604-1_32 · Cited by 200
SegMap: 3D Segment Mapping using Data-Driven Descriptors
Dubé, R., Cramariuc, A., Dugas, D., Nieto, J., Siegwart, R., & Cadena, C. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.003 · Cited by 186
Chen, X., Läbe, T., Milioto, A., Röhling, T., Behley, J., & Stachniss, C. (2021) · Autonomous Robots · doi:10.1007/s10514-021-09999-0 · Cited by 178
Place recognition using keypoint voting in large 3D lidar datasets
Bosse, M., & Zlot, R. (2013) · 2013 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2013.6630945 · Cited by 171
Semantic Instance Annotation of Street Scenes by 3D to 2D Label Transfer
Xie, J., Kiefel, M., Sun, M.-T., & Geiger, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.401 · Cited by 167
Data association for mobile robot navigation: a graph theoretic approach
Bailey, T., Nebot, E. M., Rosenblatt, J. K., & Durrant-Whyte, H. F. (2002) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2000.846406 · Cited by 141
Semantic Graph Based Place Recognition for 3D Point Clouds
Kong, X., Yang, X., Zhai, G., Zhao, X., Zeng, X., Wang, M., Liu, Y., Li, W., & Wen, F. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341060 · Cited by 140
Steder, B., Ruhnke, M., Grzonka, S., & Burgard, W. (2011) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2011.6094638 · Cited by 116
GOSMatch: Graph-of-Semantics Matching for Detecting Loop Closures in 3D LiDAR data
Zhu, Y., Ma, Y., Chen, L. F., Liu, C., Ye, M., & Li, L. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341299 · Cited by 82
Vision-Based Autonomous UAV Navigation and Landing for Urban Search and Rescue
Mittal, M., Mohan, R., Burgard, W., & Valada, A. (2022) · Springer proceedings in advanced robotics · doi:10.1007/978-3-030-95459-8_35 · Cited by 75
Self-citationLoop closure detection for visual SLAM systems using convolutional neural network
Zhang, X., Su, Y. L., & Zhu, X. (2017) · International Conference on Automation and Computing (ICAC) · doi:10.23919/iconac.2017.8082072 · Cited by 74
PCAM: Product of Cross-Attention Matrices for Rigid Registration of Point Clouds
Cao, A.-Q., Puy, G., Boulch, A., & Marlet, R. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01298 · Cited by 70
Point Clouds Registration with Probabilistic Data Association
Agamennoni, G., Fontana, S., Siegwart, R., & Sorrenti, D. G. (2016) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759602 · Cited by 69
OREOS: Oriented Recognition of 3D Point Clouds in Outdoor Scenarios
Schaupp, L., Bürki, M., Dubé, R., Siegwart, R., & Cadena, C. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968094 · Cited by 65
A Smooth Representation of Belief over SO(3) for Deep Rotation Learning with Uncertainty
Peretroukhin, V., Giamou, M., Nicholas Greene, W., Rosen, D., Kelly, J., & Roy, N. (2020) · Robotics: Science and Systems XVI · doi:10.15607/rss.2020.xvi.007 · Cited by 41
A Smooth Representation of Belief over SO(3) for Deep Rotation Learning with UncertaintyPreprint
Peretroukhin, V., Giamou, M., Rosen, D. M., Greene, W. N., Roy, N., & Kelly, J. W. (2019) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 39
CMRNet++: Map and Camera Agnostic Monocular Visual Localization in LiDAR MapsPreprint
Cattaneo, D., Sorrenti, D. G., & Valada, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.13795 · Cited by 29
Self-citationVoxel-Based Representation Learning for Place Recognition Based on 3D Point Clouds
Siva, S., Nahman, Z., & Zhang, H. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9340992 · Cited by 25
Loop closure detection using CNN words
Liu, Q., & Duan, F. (2019) · Intelligent Service Robotics · doi:10.1007/s11370-019-00284-9 · Cited by 15
Cited by
A review of research on slam technology based on the fusion of lidar and vision
Chen, P., Zhao, X., Zeng, L., Liu, L., Liu, S., Sun, L., Li, Z., Chen, H., Liu, G., Qiao, Z., et al. (2025) · Sensors · doi:10.3390/s25051447 · Cited by 46
Schmalstieg, F., Honerkamp, D., Welschehold, T., & Valada, A. (2023) · Springer Proceedings in Advanced Robotics · doi:10.1007/978-3-031-25555-7_5 · Cited by 16
Self-citation
Metadata
- Authors
- Cattaneo, D., Vaghi, M., & Valada, A.
- Venue
- IEEE Transactions on Robotics
- Published
- 2022-08
- Volume
- 38
- Issue
- 4
- Pages
- 2074-2093
- ISSN
- 1552-3098 (ISSN-L)
- 1941-0468
- OpenAlex
- W3168086592
- Cited by
- 258
- References
- 73
- FWCI
- 23.40
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.