Automatic Extrinsic Calibration of a Camera and a 3D LiDAR Using Line and Plane Correspondences
The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
In this paper, we address the problem of extrinsic calibration of a camera and a 3D Light Detection and Ranging (LiDAR) sensor using a checkerboard. Unlike previous works which require at least three checkerboard poses, our algorithm reduces the minimal number of poses to one by combining 3D line and plane correspondences. Besides, we prove that parallel planar targets with parallel boundaries provide the same constraints in our algorithm. This allows us to place the checkerboard close to the LiDAR so that the laser points better approximate the target boundary without loss of generality. Moreover, we present an algorithm to estimate the similarity transformation between the LiDAR and the camera for the applications where only the correspondences between laser points and pixels are concerned. Using a similarity transformation can simplify the calibration process since the physical size of the checkerboard is not needed. Meanwhile, estimating the scale can yield a more accurate result due to the inevitable measurement errors of the checkerboard size and the LiDAR intrinsic scale factor that transforms the LiDAR measurement to the metric measurement. Our algorithm is validated through simulations and experiments. Compared to the plane-only algorithms, our algorithm can obtain more accurate result by fewer number of poses. This is beneficial to the large-scale commercial application.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fischler, M. A., & Bolles, R. C. (1981) · Communications of the ACM · doi:10.1145/358669.358692 · Cited by 25,893
A flexible new technique for camera calibration
Zhang, Z. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.888718 · Cited by 15,004
SURF: Speeded Up Robust Features
Bay, H., Tuytelaars, T., & Van Gool, L. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_32 · Cited by 14,955 · cited 1×
“In [30], they solve the extrinsic calibration problem by minimizing the SURF descriptor [31] error of the projection of the laser points among different frames.”
The Levenberg-Marquardt algorithm: Implementation and theory
Moré, J. J. (1978) · Lecture Notes in Mathematics · doi:10.1007/bfb0067700 · Cited by 5,773
Least-Squares Fitting of Two 3-D Point Sets
Arun, K. S., Huang, T. S., & Blostein, S. D. (1987) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1987.4767965 · Cited by 3,952 · cited 3×
“(5) This problem has a closed-form solution [37].”
BackgroundMethodInfluentialFischler, M. A., & Bolles, R. C. (1987) · Readings in Computer Vision · doi:10.1016/b978-0-08-051581-6.50070-2 · Cited by 2,122
LSD: A Fast Line Segment Detector with a False Detection Control
von Gioi, R. G., Jakubowicz, J., Morel, J.-M., & Randall, G. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.300 · Cited by 1,946
Extrinsic calibration of a camera and laser range finder (improves camera calibration)
Zhang, Q., & Pless, R. (2005) · 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566) · doi:10.1109/iros.2004.1389752 · Cited by 681
Automatic camera and range sensor calibration using a single shot
Geiger, A., Moosmann, F., Car, O., & Schuster, B. (2012) · 2012 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2012.6224570 · Cited by 647
Joint Depth and Color Camera Calibration with Distortion Correction
Herrera C., D., Kannala, J., & Heikkila, J. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.125 · Cited by 453
OpenCV: Open Source Computer Vision Library
Uranishi, Y. (2018) · The Journal of The Institute of Image Information and Television Engineers · doi:10.3169/itej.72.736 · Cited by 372
Revisiting the PnP Problem: A Fast, General and Optimal Solution
Zheng, Y., Kuang, Y., Sugimoto, S., Astrom, K., & Okutomi, M. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.291 · Cited by 358
RegNet: Multimodal sensor registration using deep neural networks
Schneider, N., Piewak, F., Stiller, C., & Franke, U. (2017) · 2017 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/ivs.2017.7995968 · Cited by 283
Automatic Extrinsic Calibration of Vision and Lidar by Maximizing Mutual Information
Pandey, G., McBride, J. R., Savarese, S., & Eustice, R. M. (2015) · Journal of Field Robotics · doi:10.1002/rob.21542 · Cited by 243
Extrinsic self calibration of a camera and a 3D laser range finder from natural scenes
Scaramuzza, D., Harati, A., & Siegwart, R. (2007) · 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2007.4399276 · Cited by 241
Extrinsic self calibration of a camera and a 3D laser range finder from natural scenes
Scaramuzza, D., Harati, A., & Siegwart, R. (2007) · doi:10.3929/ethz-a-005705138 · Cited by 186
Fast Extrinsic Calibration of a Laser Rangefinder to a Camera
Unnikrishnan, R., & Hebert, M. (2018) · Figshare · doi:10.1184/r1/6554870 · Cited by 184
A Minimal Solution for the Extrinsic Calibration of a Camera and a Laser-Rangefinder
Vasconcelos, F., Barreto, J. P., & Nunes, U. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.18 · Cited by 167
Mirzaei, F. M., Kottas, D. G., & Roumeliotis, S. I. (2012) · The International Journal of Robotics Research · doi:10.1177/0278364911435689 · Cited by 160
3D LIDAR-Camera Extrinsic Calibration Using an Arbitrary Trihedron
Gong, X., Lin, Y., & Liu, J. (2013) · Sensors · doi:10.3390/s130201902 · Cited by 158
Extrinsic Calibration of a 3D Laser Scanner and an Omnidirectional Camera
Pandey, G., McBride, J., Savarese, S., & Eustice, R. M. (2010) · IFAC Proceedings Volumes · doi:10.3182/20100906-3-it-2019.00059 · Cited by 145
Fusing LIDAR and images for pedestrian detection using convolutional neural networks
Schlosser, J., Chow, C. K., & Kira, Z. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487370 · Cited by 136
Extrinsic calibration of a single line scanning lidar and a camera
Kwak, K., Huber, D. F., Badino, H., & Takeo Kanade, A. (2011) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2011.6094490 · Cited by 94
Zhou, L. (2013) · IEEE Sensors Journal · doi:10.1109/jsen.2013.2284789 · Cited by 81
Self-citationEfficient Intersection of Three Quadrics and Applications in Computer Vision
Kúkelová, Z., Heller, J., & Fitzgibbon, A. W. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.199 · Cited by 72
Extrinsic calibration of a camera and a lidar based on decoupling the rotation from the translation
Zhou, L., & Deng, Z. (2012) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2012.6232233 · Cited by 68
Self-citationHuang, L., & Barth, M. (2009) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2009.5164263 · Cited by 59
Automatic registration of mobile LiDAR and spherical panoramas
Wang, R., Ferrie, F. P., & Macfarlane, J. F. (2012) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2012.6238912 · Cited by 51
Accurate extrinsic calibration between monocular camera and sparse 3D Lidar points without markers
Xiao, Z., Li, H., Zhou, D., Dai, Y., & Dai, B. (2017) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2017.7995755 · Cited by 17
2D/3D Sensor Exploitation and Fusion for Enhanced Object Detection
Xu, J., Kim, K., Zhang, Z., Chen, H., & Owechko, Y. (2014) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2014.119 · Cited by 15
Cited by
Yuan, C., Liu, X., Hong, X., & Zhang, F. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3098923 · Cited by 354
Emerging trends in autonomous vehicle perception: Multimodal fusion for 3D object detection
Alaba, S. Y., Gurbuz, A. C., & Ball, J. E. (2024) · World Electric Vehicle Journal · doi:10.3390/wevj15010020 · Cited by 82
“Zhou et al. put forth an extrinsic calibration [26] technique using line and plane correspondences.”
Method
Metadata
- Authors
- Zhou, L., Li, Z., & Kaess, M.
- Venue
- 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
- Publisher
- IEEE
- Published
- 2018-10
- Pages
- 5562-5569
- OpenAlex
- W2909816247
- Cited by
- 308
- References
- 30
- FWCI
- 28.54
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.