Visual localization within LIDAR maps for automated urban driving
The DOI matches its Crossref record; 22 of the 24 references it cites were found in a registry or an index.
Abstract
This paper reports on the problem of map-based visual localization in urban environments for autonomous vehicles. Self-driving cars have become a reality on roadways and are going to be a consumer product in the near future. One of the most significant road-blocks to autonomous vehicles is the prohibitive cost of the sensor suites necessary for localization. The most common sensor on these platforms, a three-dimensional (3D) light detection and ranging (LIDAR) scanner, generates dense point clouds with measures of surface reflectivity-which other state-of-the-art localization methods have shown are capable of centimeter-level accuracy. Alternatively, we seek to obtain comparable localization accuracy with significantly cheaper, commodity cameras. We propose to localize a single monocular camera within a 3D prior ground-map, generated by a survey vehicle equipped with 3D LIDAR scanners. To do so, we exploit a graphics processing unit to generate several synthetic views of our belief environment. We then seek to maximize the normalized mutual information between our real camera measurements and these synthetic views. Results are shown for two different datasets, a 3.0 km and a 1.5 km trajectory, where we also compare against the state-of-the-art in LIDAR map-based localization.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multimodality image registration by maximization of mutual information
Maes, F., Collignon, A., Vandermeulen, D., Marchal, G., & Suetens, P. (1997) · IEEE Transactions on Medical Imaging · doi:10.1109/42.563664 · Cited by 4,547 · cited 1×
“The use of mutual information for multi-modal image registration has been widely used in the medical imaging domain for several decades [13], [14].”
BackgroundMonoSLAM: Real-time single camera SLAM
Davison, A. J., Reid, I. D., Molton, N. D., & Stasse, O. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1049 · Cited by 3,959 · cited 4×
“EKF localization framework (see also the accompanying video attachment).”
MethodInfluentialMutual-information-based registration of medical images: a survey
Pluim, J. P. W., Maintz, J. B. A., & Viergever, M. A. (2003) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2003.815867 · Cited by 2,890 · cited 1×
“To move this into real-time localization, we propose using a GPU to generate synthetic views, which we can then use a normalized measure of mutual information to optimize over our vehicle’s pose.”
MethodLearning openCV: computer vision with the openCV library
Bradski, G. R., & Kaehler, A. (2008) · CERN Document Server (European Organization for Nuclear Research) · Cited by 2,468
An overlap invariant entropy measure of 3D medical image alignment
Studholme, C., Hill, D. L. G., & Hawkes, D. J. (1999) · Pattern Recognition · doi:10.1016/s0031-3203(98)00091-0 · Cited by 2,180 · cited 1×
“The amount of overlap between two candidate images can bias the standard mutual information measure toward lower overlap image pairs [22].”
BackgroundiSAM: Incremental Smoothing and Mapping
Kaess, M., Ranganathan, A., & Dellaert, F. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.2006706 · Cited by 1,076 · cited 1×
“These constraints are modeled as Gaussian random variables; resulting in a nonlinear least-squares optimization problem that we solve with the incremental smoothing and mapping (iSAM) algorithm [20].”
BackgroundRobust vehicle localization in urban environments using probabilistic maps
Levinson, J., & Thrun, S. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509700 · Cited by 581 · cited 1×
“State-of-the-art methods [2], [3] use reflectivity measurements from 3D LIDAR scanners to create an orthographic map of ground-plane reflectivities.”
Map-Based Precision Vehicle Localization in Urban Environments
Levinson, J., Montemerlo, M., & Thrun, S. (2007) · Robotics: Science and Systems III · doi:10.15607/rss.2007.iii.016 · Cited by 477 · cited 1×
“State-of-the-art methods [2], [3] use reflectivity measurements from 3D LIDAR scanners to create an orthographic map of ground-plane reflectivities.”
Eade, E., & Drummond, T. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.263 · Cited by 396
Real-time correlative scan matching
Olson, E. B. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152375 · Cited by 361 · cited 1×
“The measurement zk is exactly the output of our image registration in (10) and Rk is estimated by fitting a covariance to the explored cost surface, as is done in [23].”
Method
Research works printed but not linked: 3
- segal, 2009, Generalized-ICP, Proc Robot Sci &Syst Conf
- markoff, 2010, Google Cars Drive Themselves
- carlevaris-bianco, 2012, Learning temporal coobservability relationships for lifelong robotic mapping, IROS Workshop on Lifelong Learning for Mobile Robotics Applications
Cited by
Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I., & Leonard, J. J. (2016) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2624754 · Cited by 3,596
“[260] is an initial step in this direction.”
Past, present, and future of simultaneous localization and mapping: Toward the robust-perception age
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I. D., & Leonard, J. J. (2016) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-138892 · Cited by 3,048
A Survey of Autonomous Driving: Common Practices and Emerging Technologies
Yurtsever, E., Lambert, J., Carballo, A., & Takeda, K. (2020) · IEEE Access · doi:10.1109/access.2020.2983149 · Cited by 1,889
“A monocular camera was used to localize the vehicle in a point cloud map in [121].”
MethodSimultaneous Localization and Mapping: A Survey of Current Trends in Autonomous Driving
Bresson, G., Alsayed, Z., Yu, L., & Glaser, S. (2017) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2017.2749181 · Cited by 885
“in that sense is multi-modality where a map could be built by an expensive 3D laser but then exploited by a simple camera as proposed in [273].”
Kuutti, S., Fallah, S., Katsaros, K., Dianati, M., Mccullough, F., & Mouzakitis, A. (2018) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2812300 · Cited by 801
“On the other hand, addressing the high implementation cost of LiDAR techniques, Wolcott and Eustice [40] investigated the use of camera-based localization within pre-existing LiDAR maps.”
BackgroundMethodInfluential
Metadata
- Authors
- Wolcott, R. W., & Eustice, R. M.
- Affiliations
- University of Michigan (US)
- ORCID
- Eustice, Ryan M.
- Venue
- 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems
- Publisher
- IEEE
- Published
- 2014-09
- Pages
- 176-183
- ISSN
- 2153-0858 (ISSN-L)
- OpenAlex
- W2054969198
- Cited by
- 374
- References
- 24
- Citations by year
- 2026: 6 · 2025: 20 · 2024: 24 · 2023: 29 · 2022: 24 · 2021: 49 · 2020: 53 · 2019: 55 · 2018: 34 · 2017: 39 · 2016: 26 · 2015: 15
- FWCI
- 44.91
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
- Keywords
- visual localization, map-based localization, autonomous vehicles, monocular camera, normalized mutual information, GPU rendering, urban driving, sensor cost reduction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Visual localization within LIDAR maps for automated urban driving. https://app.cochat.ai/papers/10.1109/iros.2014.6942558
- The paper
- Wolcott, R. W., & Eustice, R. M. (2014). Visual localization within LIDAR maps for automated urban driving. 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems. https://doi.org/10.1109/iros.2014.6942558
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.