DTAM: Dense tracking and mapping in real-time
The DOI matches its Crossref record; 16 of the 17 references it cites were found in a registry or an index.
Abstract
DTAM is a system for real-time camera tracking and reconstruction which relies not on feature extraction but dense, every pixel methods. As a single hand-held RGB camera flies over a static scene, we estimate detailed textured depth maps at selected keyframes to produce a surface patchwork with millions of vertices. We use the hundreds of images available in a video stream to improve the quality of a simple photometric data term, and minimise a global spatially regularised energy functional in a novel non-convex optimisation framework. Interleaved, we track the camera's 6DOF motion precisely by frame-rate whole image alignment against the entire dense model. Our algorithms are highly parallelisable throughout and DTAM achieves real-time performance using current commodity GPU hardware. We demonstrate that a dense model permits superior tracking performance under rapid motion compared to a state of the art method using features; and also show the additional usefulness of the dense model for real-time scene interaction in a physics-enhanced augmented reality application.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, in our network, multi-scale projections not only help to overcome gradient locality during training (see [33], [47] for a broader discussion of this well-known issue), but also aid in online error correction at runtime.”
From Unsupervised Deep Visual-Inertial Odometry with Online Error Correction for RGB-D Imagery (2020) · cites this paper as [33]
In the citing paper
“SFMLearner [33] demonstrated the unsupervised learning of unscaled egomotion and depth from RGB imagery.”
From Unsupervised Deep Visual-Inertial Odometry with Online Error Correction for RGB-D Imagery (2020) · cites this paper as [33]
In the citing paper
“For KITTI, VIOLearner RGB outperforms approaches SFMLearner [33] and the network of Zhan et al. [30].”
From Unsupervised Deep Visual-Inertial Odometry with Online Error Correction for RGB-D Imagery (2020) · cites this paper as [33]
In the citing paper
“For AirSim, VIOLearner (no IMU) outperforms approaches SFMLearner [33] and ORB-SLAM2-S in translation error.”
From Unsupervised Deep Visual-Inertial Odometry with Online Error Correction for RGB-D Imagery (2020) · cites this paper as [33]
In the citing paper
“Compared to other vision-only approaches, for KITTI, VIOLearner (no IMU) outperforms approaches SFMLearner [33] and the network of Zhan et al. [30] and yet is outperformed by ORB-SLAM-2 which uses full bundle adjustment.”
From Unsupervised Deep Visual-Inertial Odometry with Online Error Correction for RGB-D Imagery (2020) · cites this paper as [33]
Citations
Cites
Nonlinear total variation based noise removal algorithms
Rudin, L. I., Osher, S., & Fatemi, E. (1992) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(92)90242-f · Cited by 15,704
Parallel Tracking and Mapping for Small AR Workspaces
Klein, G., & Murray, D. (2007) · 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2007.4538852 · Cited by 4,346
A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging
Chambolle, A., & Pock, T. (2011) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-010-0251-1 · Cited by 4,336
Lucas-Kanade 20 Years On: A Unifying Framework
Baker, S., & Matthews, I. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000011205.11775.fd · Cited by 3,155
Fast cost-volume filtering for visual correspondence and beyond
Rhemann, C., Hosni, A., Bleyer, M., Rother, C., & Gelautz, M. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995372 · Cited by 485
Live dense reconstruction with a single moving camera
Newcombe, R. A., & Davison, A. J. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539794 · Cited by 366
Self-citationImproving the Agility of Keyframe-Based SLAM
Klein, G., & Murray, D. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88688-4_59 · Cited by 335
Robust multi-sensor image alignment
Irani, M., & Anandan, P. (2002) · Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271) · doi:10.1109/iccv.1998.710832 · Cited by 220
Real-Time Dense Geometry from a Handheld Camera
Stühmer, J., Gumhold, S., & Cremers, D. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15986-2_2 · Cited by 205
Some First-Order Algorithms for Total Variation Based Image Restoration
Aujol, J. (2009) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-009-0149-y · Cited by 151
Large displacement optical flow computation withoutwarping
Steinbrücker, F., Pock, T., & Cremers, D. (2009) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2009.5459364 · Cited by 137
Fast and High Quality Fusion of Depth Maps
Zach, C. (2008) · Cited by 120
Sampling the disparity space image
Szeliski, R., & Scharstein, D. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.1262341 · Cited by 83
Real-Time Spherical Mosaicing Using Whole Image Alignment
Lovegrove, S. J., & Davison, A. J. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15558-1_6 · Cited by 72
Self-citation3D Reconstruction Using an n-Layer Heightmap
Gallup, D., Pollefeys, M., & Frahm, J. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15986-2_1 · Cited by 63
Fast numerical algorithms for total variation based image restoration
Chan, T. F.-C., & Zhu, M. (2008) · Cited by 28
Cited by
ORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2463671 · Cited by 6,778
“Finally, because direct methods are, in general, very computationally demanding, the map is just incrementally expanded as in DTAM, or map optimization is reduced to a pose graph, discarding all sensor measurements as in LSD-SLAM.”
MethodKinectFusion: Real-time dense surface mapping and tracking
Newcombe, R. A., Fitzgibbon, A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A. J., Kohi, P., Shotton, J., & Hodges, S. (2011) · 2011 10th IEEE International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2011.6092378 · Cited by 4,008
Self-citationLSD-SLAM: Large-scale direct monocular SLAM
Engel, J., Schöps, T., & Cremers, D. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_54 · Cited by 3,851
“While direct image alignment is well-established for RGB-D or stereo sensors [14,4], only recently monocular direct VO algorithms have been proposed: In [24,20,21], accurate and fully dense depth maps are computed using a variational formulation, which however is computationally demanding and requires”
MethodPast, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I., & Leonard, J. J. (2016) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2624754 · Cited by 3,596
“Right: dense map of a desktop produced by DTAM [184].”
InfluentialORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · Zaguan (Universidad de Zaragoza) · Cited by 3,153
Metadata
- Authors
- Newcombe, R. A., Lovegrove, S. J., & Davison, A. J.
- Affiliations
- Imperial College London (GB)
- ORCID
- Davison, Andrew J.
- Venue
- 2011 International Conference on Computer Vision
- Publisher
- IEEE
- Published
- 2011-11
- Pages
- 2320-2327
- OpenAlex
- W2108134361
- Cited by
- 2,078
- References
- 17
- Citations by year
- 2026: 49 · 2025: 144 · 2024: 163 · 2023: 140 · 2022: 141 · 2021: 166 · 2020: 179 · 2019: 199 · 2018: 183 · 2017: 176 · 2016: 136 · 2015: 151 · 2014: 102 · 2013: 92 · 2012: 51
- FWCI
- 154.56
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE/CVF International Conference on Computer Vision (ICCV) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Vision and Imaging
- Physical Sciences › Earth and Planetary Sciences › Geology › 3D Surveying and Cultural Heritage
- Keywords
- dense 3D reconstruction, real-time mapping, depth images, non-convex optimization, energy minimization, image registration, GPU parallelization, augmented reality, handheld camera
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.