The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Tanks and temples: benchmarking large-scale scene reconstruction
Abstract
We present a benchmark for image-based 3D reconstruction. The benchmark sequences were acquired outside the lab, in realistic conditions. Ground-truth data was captured using an industrial laser scanner. The benchmark includes both outdoor scenes and indoor environments. High-resolution video sequences are provided as input, supporting the development of novel pipelines that take advantage of video input to increase reconstruction fidelity. We report the performance of many image-based 3D reconstruction pipelines on the new benchmark. The results point to exciting challenges and opportunities for future work.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
Vision meets robotics: The KITTI dataset
Geiger, A., Lenz, P., Stiller, C., & Urtasun, R. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913491297 · Cited by 9,913 · cited 1×
“There are also benchmarks for related problems, such as mesh reconstruction from point clouds [Berger et al. 2013], visual odometry [Burri et al. 2016; Geiger et al. 2013], and RGB-D reconstruction [Choi et al. 2015; Handa et al. 2014; Sturm et al. 2012].”
BackgroundStructure-from-Motion Revisited
Schonberger, J. L., & Frahm, J.-M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.445 · Cited by 6,433
Bundle Adjustment — A Modern Synthesis
Triggs, B., McLauchlan, P. F., Hartley, R. I., & Fitzgibbon, A. W. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-44480-7_21 · Cited by 3,988
A benchmark for the evaluation of RGB-D SLAM systems
Sturm, J., Engelhard, N., Endres, F., Burgard, W., & Cremers, D. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6385773 · Cited by 3,976
LSD-SLAM: Large-scale direct monocular SLAM
Engel, J., Schöps, T., & Cremers, D. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10605-2_54 · Cited by 3,851 · cited 1×
“Direct methods have demonstrated that the camera can be localized and a dense or semi-dense 3D model can be created without sparse feature matching [Engel et al. 2017, 2014; Newcombe et al. 2011].”
MethodMultiple View Geometry in Computer Vision
(2001) · Kybernetes · doi:10.1108/k.2001.30.9_10.1333.2 · Cited by 3,336
Accurate, Dense, and Robust Multiview Stereopsis
Furukawa, Y., & Ponce, J. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.161 · Cited by 3,019
Engel, J., Koltun, V., & Cremers, D. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2658577 · Cited by 2,924
Self-citationA Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms
Seitz, S. M., Curless, B., Diebel, J., Scharstein, D., & Szeliski, R. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.19 · Cited by 2,457
Least-squares estimation of transformation parameters between two point patterns
Umeyama, S. (1991) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.88573 · Cited by 2,420
Pixelwise View Selection for Unstructured Multi-View Stereo
Schönberger, J. L., Zheng, E., Frahm, J.-M., & Pollefeys, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_31 · Cited by 2,315
Modeling the World from Internet Photo Collections
Snavely, N., Seitz, S. M., & Szeliski, R. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0107-3 · Cited by 2,155
DTAM: Dense tracking and mapping in real-time
Newcombe, R. A., Lovegrove, S. J., & Davison, A. J. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126513 · Cited by 2,078 · cited 1×
“Direct methods have demonstrated that the camera can be localized and a dense or semi-dense 3D model can be created without sparse feature matching [Engel et al. 2017, 2014; Newcombe et al. 2011].”
MethodThe EuRoC micro aerial vehicle datasets
Burri, M., Nikolic, J., Gohl, P., Schneider, T., Rehder, J., Omari, S., Achtelik, M. W., & Siegwart, R. (2016) · The International Journal of Robotics Research · doi:10.1177/0278364915620033 · Cited by 2,066
Towards Linear-Time Incremental Structure from Motion
Wu, C. (2013) · 2013 International Conference on 3D Vision · doi:10.1109/3dv.2013.25 · Cited by 1,235
Agarwal, S., Furukawa, Y., Snavely, N., Simon, I., Curless, B., Seitz, S. M., & Szeliski, R. (2011) · Communications of the ACM · doi:10.1145/2001269.2001293 · Cited by 1,072
A Multi-view Stereo Benchmark with High-Resolution Images and Multi-camera Videos
Schops, T., Schonberger, J. L., Galliani, S., Sattler, T., Schindler, K., Pollefeys, M., & Geiger, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.272 · Cited by 915
A benchmark for RGB-D visual odometry, 3D reconstruction and SLAM
Handa, A., Whelan, T., McDonald, J., & Davison, A. J. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6907054 · Cited by 906
On benchmarking camera calibration and multi-view stereo for high resolution imagery
Strecha, C., von Hansen, W., Van Gool, L., Fua, P., & Thoennessen, U. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587706 · Cited by 814
Wu, C., Agarwal, S., Curless, B., & Seitz, S. M. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995552 · Cited by 807
Towards Internet-scale multi-view stereo
Furukawa, Y., Curless, B., Seitz, S. M., & Szeliski, R. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539802 · Cited by 751
Detailed Real-Time Urban 3D Reconstruction from Video
Pollefeys, M., Nistér, D., Frahm, J.-M., Akbarzadeh, A., Mordohai, P., Clipp, B., Engels, C., Gallup, D., Kim, S.-J., Merrell, P., et al. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0086-4 · Cited by 717
Multi-View Stereo for Community Photo Collections
Goesele, M., Snavely, N., Curless, B., Hoppe, H., & Seitz, S. M. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408933 · Cited by 717
VisualSFM:A visual structure from motion system,
Wu, C. (2011) · Medical Entomology and Zoology · Cited by 698
Large-Scale Data for Multiple-View Stereopsis
Aanæs, H., Jensen, R. R., Vogiatzis, G., Tola, E., & Dahl, A. B. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-016-0902-9 · Cited by 672
Furukawa, Y., & Hernández, C. (2015) · Foundations and Trends in Computer Graphics and Vision · doi:10.1561/0600000052 · Cited by 598
Robust reconstruction of indoor scenes
Choi, S., Zhou, Q.-Y., & Koltun, V. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299195 · Cited by 555
Self-citationBundle Adjustment in the Large
Agarwal, S., Snavely, N., Seitz, S. M., & Szeliski, R. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15552-9_3 · Cited by 462
Multi-view reconstruction preserving weakly-supported surfaces
Jancosek, M., & Pajdla, T. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995693 · Cited by 370
OpenMVG: Open Multiple View Geometry
Moulon, P., Monasse, P., Perrot, R., & Marlet, R. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-56414-2_5 · Cited by 361
Efficient large-scale multi-view stereo for ultra high-resolution image sets
Tola, E., Strecha, C., & Fua, P. (2012) · Machine Vision and Applications · doi:10.1007/s00138-011-0346-8 · Cited by 328
Reconstructing building interiors from images
Furukawa, Y., Curless, B., Seitz, S. M., & Szeliski, R. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459145 · Cited by 315
Modeling and Recognition of Landmark Image Collections Using Iconic Scene Graphs
Li, X., Wu, C., Zach, C., Lazebnik, S., & Frahm, J.-M. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88682-2_33 · Cited by 294
High Accuracy and Visibility-Consistent Dense Multiview Stereo
Vu, H.-H., Labatut, P., Pons, J.-P., & Keriven, R. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.172 · Cited by 284
Dense scene reconstruction with points of interest
Zhou, Q.-Y., & Koltun, V. (2013) · ACM Transactions on Graphics · doi:10.1145/2461912.2461919 · Cited by 229
Self-citationA benchmark for surface reconstruction
Berger, M., Levine, J. A., Nonato, L. G., Taubin, G., & Silva, C. T. (2013) · ACM Transactions on Graphics · doi:10.1145/2451236.2451246 · Cited by 205
Live Metric 3D Reconstruction on Mobile Phones
Tanskanen, P., Kolev, K., Meier, L., Camposeco, F., Saurer, O., & Pollefeys, M. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.15 · Cited by 201
Reconstructing the World in Six Days
Heinly, J., Schönberger, J. L., Dunn, E., & Frahm, J. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298949 · Cited by 184
Reconstructing the World’s Museums
Xiao, J., & Furukawa, Y. (2014) · International Journal of Computer Vision · doi:10.1007/s11263-014-0711-y · Cited by 183
Automatic registration of LIDAR and optical images of urban scenes
Mastin, A., Kepner, J., & Fisher, J. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206539 · Cited by 166
Ikehata, S., Yang, H., & Furukawa, Y. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.156 · Cited by 160
Video-based, real-time multi-view stereo
Vogiatzis, G., & Hernández, C. (2011) · Image and Vision Computing · doi:10.1016/j.imavis.2011.01.006 · Cited by 154
Dense reconstruction on-the-fly
Wendel, A., Maurer, M., Graber, G., Pock, T., & Bischof, H. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247833 · Cited by 121
3D Modeling on the Go: Interactive 3D Reconstruction of Large-Scale Scenes on Mobile Devices
Schöps, T., Sattler, T., Häne, C., & Pollefeys, M. (2015) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2015.40 · Cited by 114
MVE—An image-based reconstruction environment
Fuhrmann, S., Langguth, F., Moehrle, N., Waechter, M., & Goesele, M. (2015) · Computers & Graphics · doi:10.1016/j.cag.2015.09.003 · Cited by 114
The Visual Turing Test for Scene Reconstruction
Shan, Q., Adams, R., Curless, B., Furukawa, Y., & Seitz, S. M. (2013) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2013.12 · Cited by 105
Turning Mobile Phones into 3D Scanners
Kolev, K., Tanskanen, P., Speciale, P., & Pollefeys, M. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.504 · Cited by 101
Shading-Aware Multi-view Stereo
Langguth, F., Sunkavalli, K., Hadap, S., & Goesele, M. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46487-9_29 · Cited by 89
Fast robust large-scale mapping from video and internet photo collections
Frahm, J., Pollefeys, M., Lazebnik, S., Gallup, D., Clipp, B., Raguram, R., Wu, C., Zach, C., & Johnson, T. (2010) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2010.08.009 · Cited by 43
Virtual Rephotography: Novel View Prediction Error for 3D Reconstruction
Waechter, M., Beljan, M., Fuhrmann, S., Moehrle, N., Kopf, J., & Goesele, M. (2017) · ACM Transactions on Graphics · doi:10.1145/2999533 · Cited by 36
Evaluation of Large Scale Scene Reconstruction
Merrell, P. C., Mordohai, P., Frahm, J., & Pollefeys, M. (2007) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2007.4409218 · Cited by 13
Cited by
3D Gaussian Splatting for Real-Time Radiance Field Rendering
Kerbl, B., Kopanas, G., Leimkuehler, T., & Drettakis, G. (2023) · ACM Transactions on Graphics · doi:10.1145/3592433 · Cited by 6,025
“…with state-of-the-art (SOTA) visual quality and competitive training times, while our tile-based splatting solution ensures real-time rendering at SOTA quality for 1080p resolution on several previously published datasets [Barron et al. 2022; Hedman et al. 2018; Knapitsch et al. 2017] (see Fig.”
BackgroundMethodMip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields
Barron, J. T., Mildenhall, B., Verbin, D., Srinivasan, P. P., & Hedman, P. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00539 · Cited by 1,935
Matterport3D: Learning from RGB-D Data in Indoor Environments
Chang, A., Dai, A., Funkhouser, T., Halber, M., Niebner, M., Savva, M., Song, S., Zeng, A., & Zhang, Y. (2017) · 2017 International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2017.00081 · Cited by 1,858
Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-Shot Cross-Dataset Transfer
Ranftl, R., Lasinger, K., Hafner, D., Schindler, K., & Koltun, V. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3019967 · Cited by 1,618
Self-citationMVSNet: Depth Inference for Unstructured Multi-view Stereo
Yao, Y., Luo, Z., Li, S., Fang, T., & Quan, L. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01237-3_47 · Cited by 1,455
Metadata
- Authors
- Knapitsch, A., Park, J., Zhou, Q.-Y., & Koltun, V.
- Venue
- ACM Transactions on Graphics
- Published
- 2017-07-20
- Volume
- 36
- Issue
- 4
- Pages
- 1-13
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W2738551266
- Cited by
- 1,707
- References
- 52
- FWCI
- 18.76
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.