Reconstructing building interiors from images
The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
This paper proposes a fully automated 3D reconstruction and visualization system for architectural scenes (interiors and exteriors). The reconstruction of indoor environments from photographs is particularly challenging due to texture-poor planar surfaces such as uniformly-painted walls. Our system first uses structure-from-motion, multi-view stereo, and a stereo algorithm specifically designed for Manhattan-world scenes (scenes consisting predominantly of piece-wise planar surfaces with dominant directions) to calibrate the cameras and to recover initial 3D geometry in the form of oriented points and depth maps. Next, the initial geometry is fused into a 3D model with a novel depth-map integration algorithm that, again, makes use of Manhattan-world assumptions and produces simplified 3D models. Finally, the system enables the exploration of reconstructed environments with an interactive, image-based 3D viewer. We demonstrate results on several challenging datasets, including a 3D reconstruction and image-based walk-through of an entire floor of a house, the first result of this kind from an automated computer vision system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Marching cubes: A high resolution 3D surface construction algorithm
Lorensen, W. E., & Cline, H. E. (1987) · Proceedings of the 14th annual conference on Computer graphics and interactive techniques · doi:10.1145/37401.37422 · Cited by 10,104
Fast approximate energy minimization via graph cuts
Boykov, Y., Veksler, O., & Zabih, R. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.969114 · Cited by 6,988
Photo tourism: exploring photo collections in 3D
Snavely, N., Seitz, S. M., & Szeliski, R. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141964 · Cited by 2,866
Self-citationGortler, S. J., Grzeszczuk, R., Szeliski, R., & Cohen, M. F. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237200 · Cited by 2,458
Self-citationA Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms
Seitz, S. M., Curless, B., Diebel, J., Scharstein, D., & Szeliski, R. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.19 · Cited by 2,457 · cited 2×
“Multi-view stereo (MVS) is one of the most successful dense approaches and produces models whose accuracy rivals laser range scanners [18].”
BackgroundSelf-citationPoisson Surface Reconstruction
Kazhdan, M. M., Bolitho, M., & Hoppe, H. (2006) · doi:10.2312/sgp/sgp06/061-070 · Cited by 2,125
Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach
Debevec, P. E., Taylor, C. J., & Malik, J. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237191 · Cited by 1,905
Procedural modeling of buildings
Müller, P., Wonka, P., Haegler, S., Ulmer, A., & Van Gool, L. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141931 · Cited by 950
Unstructured lumigraph rendering
Buehler, C., Bosse, M., McMillan, L., Gortler, S., & Cohen, M. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383309 · Cited by 881
Detailed Real-Time Urban 3D Reconstruction from Video
Pollefeys, M., Nistér, D., Frahm, J.-M., Akbarzadeh, A., Mordohai, P., Clipp, B., Engels, C., Gallup, D., Kim, S.-J., Merrell, P., et al. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0086-4 · Cited by 717
Cited by
Pixelwise View Selection for Unstructured Multi-View Stereo
Schönberger, J. L., Zheng, E., Frahm, J.-M., & Pollefeys, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_31 · Cited by 2,315
Building Information Modeling (BIM) for existing buildings — Literature review and future needs
Volk, R., Stengel, J., & Schultmann, F. (2014) · Automation in Construction · doi:10.1016/j.autcon.2013.10.023 · Cited by 2,199
Tanks and temples: benchmarking large-scale scene reconstruction
Knapitsch, A., Park, J., Zhou, Q.-Y., & Koltun, V. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073599 · Cited by 1,707
RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments
Henry, P., Krainin, M., Herbst, E., Ren, X., & Fox, D. (2012) · The International Journal of Robotics Research · doi:10.1177/0278364911434148 · Cited by 1,161
Tang, P., Huber, D., Akinci, B., Lipman, R., & Lytle, A. (2010) · Automation in Construction · doi:10.1016/j.autcon.2010.06.007 · Cited by 1,139
RGB-D Mapping: Using Depth Cameras for Dense 3D Modeling of Indoor Environments
Henry, P., Krainin, M., Herbst, E., Ren, X., & Fox, D. (2014) · Springer Tracts in Advanced Robotics · doi:10.1007/978-3-642-28572-1_33 · Cited by 809
Automatic creation of semantically rich 3D building models from laser scanner data
Xiong, X., Adan, A., Akinci, B., & Huber, D. (2013) · Automation in Construction · doi:10.1016/j.autcon.2012.10.006 · Cited by 703
Furukawa, Y., & Hernández, C. (2015) · Foundations and Trends in Computer Graphics and Vision · doi:10.1561/0600000052 · Cited by 598
Self-citationRobust reconstruction of indoor scenes
Choi, S., Zhou, Q.-Y., & Koltun, V. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299195 · Cited by 555
A Survey of Urban Reconstruction
Musialski, P., Wonka, P., Aliaga, D. G., Wimmer, M., van Gool, L., & Purgathofer, W. (2013) · Computer Graphics Forum · doi:10.1111/cgf.12077 · Cited by 429
Golparvar-Fard, M., Peña-Mora, F., & Savarese, S. (2015) · Journal of Computing in Civil Engineering · doi:10.1061/(asce)cp.1943-5487.0000205 · Cited by 404
Furukawa, Y., & Hernández, C. (2015) · now publishers, Inc. eBooks · doi:10.1561/9781601988379 · Cited by 268
Self-citationHydra: A Real-time Spatial Perception System for 3D Scene Graph Construction and Optimization
Hughes, N., Chang, Y., & Carlone, L. (2022) · Robotics: Science and Systems XVIII · doi:10.15607/rss.2022.xviii.050 · Cited by 202
“Furukawa et al. [17] reconstruct floor plans from images using multi-view stereo combined with a Manhattan World assumption.”
Rent3D: Floor-plan priors for monocular layout estimation
Liu, C., Schwing, A. G., Kundu, K., Urtasun, R., & Fidler, S. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298963 · Cited by 104
Image-Driven Fuzzy-Based System to Construct as-Is IFC BIM Objects
Lu, Q., Lee, S., & Chen, L. (2018) · Automation in Construction · doi:10.1016/j.autcon.2018.03.034 · Cited by 64
Omnidirectional 3D reconstruction in augmented Manhattan worlds
Schonbein, M., & Geiger, A. (2014) · 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2014.6942637 · Cited by 63
Plan2Scene: Converting Floorplans to 3D Scenes
Vidanapathirana, M., Wu, Q., Furukawa, Y., Chang, A. X., & Savva, M. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01059 · Cited by 32
Self-citationComplete 3D Scene Parsing from an RGBD Image
Zou, C., Guo, R., Li, Z., & Hoiem, D. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-018-1133-z · Cited by 31
“difficult to model with hand-coded processing and rules. More recent approaches to 3D reconstruction produce detailed literal geometric models, such as 3D point clouds or meshes, from multiple images [12], or coarse interpreted models, such as boxy objects within a box-shaped room [21], from one image. This paper intro…”
BackgroundMulti-stage Floor Plan Recognition and 3D Reconstruction
Cheng, X., Ding, X., Zhang, J., Liu, M., Chang, K., Wang, J., Zhou, C., & Yuan, J. (2022) · Proceedings of the 8th International Conference on Computing and Artificial Intelligence · doi:10.1145/3532213.3532271 · Cited by 1
Metadata
- Authors
- Furukawa, Y., Curless, B., Seitz, S. M., & Szeliski, R.
- Venue
- 2009 IEEE 12th International Conference on Computer Vision
- Publisher
- IEEE
- Published
- 2009-09
- Pages
- 80-87
- OpenAlex
- W2536043048
- Cited by
- 315
- References
- 22
- FWCI
- 23.44
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.