Recovering the spatial layout of cluttered rooms
The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
In this paper, we consider the problem of recovering the spatial layout of indoor scenes from monocular images. The presence of clutter is a major problem for existing single-view 3D reconstruction algorithms, most of which rely on finding the ground-wall boundary. In most rooms, this boundary is partially or entirely occluded. We gain robustness to clutter by modeling the global room space with a parameteric 3D “box” and by iteratively localizing clutter and refitting the box. To fit the box, we introduce a structured learning algorithm that chooses the set of parameters to minimize error, based on global perspective cues. On a dataset of 308 images, we demonstrate the ability of our algorithm to recover spatial layout in cluttered rooms and show several examples of estimated free space.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope
Oliva, A., & Torralba, A. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011139631724 · Cited by 6,319
LabelMe: A Database and Web-Based Tool for Image Annotation
Russell, B. C., Torralba, A., Murphy, K. P., & Freeman, W. T. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0090-8 · Cited by 4,210
Large Margin Methods for Structured and Interdependent Output Variables
Tsochantaridis, I., Joachims, T., Hofmann, T., & Altün, Y. (2005) · Journal of Machine Learning Research · doi:10.5555/1046920.1088722 · Cited by 2,225
Make3D: Learning 3D Scene Structure from a Single Still Image
Saxena, A., Sun, M., & Ng, A. Y. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.132 · Cited by 1,736
Putting Objects in Perspective
Hoiem, D., Efros, A. A., & Hebert, M. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-008-0137-5 · Cited by 805
Self-citationRecovering Surface Layout from an Image
Hoiem, D., Efros, A. A., & Hebert, M. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-0031-y · Cited by 674
Self-citationManhattan World: compass direction from a single image by Bayesian inference
Coughlan, J. M., & Yuille, A. L. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790349 · Cited by 475
Geometric reasoning for single image structure recovery
Lee, D. C., Hebert, M., & Kanade, T. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206872 · Cited by 407
Tour into the picture: using a spidery mesh interface to make animation from a single image
Horry, Y., Anjyo, K.-I., & Arai, K. (1997) · Proceedings of the 24th annual conference on Computer graphics and interactive techniques - SIGGRAPH '97 · doi:10.1145/258734.258854 · Cited by 390
Cited by
Indoor segmentation and support inference from rgbd images
Silberman, N., Hoiem, D., Kohli, P., & Fergus, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33715-4_54 · Cited by 5,760
Self-citationSUN RGB-D: A RGB-D scene understanding benchmark suite
Song, S., Lichtenberg, S. P., & Xiao, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298655 · Cited by 1,943
Single image depth estimation from predicted semantic labels
Liu, B., Gould, S., & Koller, D. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539823 · Cited by 477
RGB-(D) scene labeling: Features and algorithms
Ren, X., Bo, L., & Fox, D. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247999 · Cited by 392
Overview of Environment Perception for Intelligent Vehicles
Zhu, H., Yuen, K.-V., Mihaylova, L., & Leung, H. (2017) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2017.2658662 · Cited by 386
Designing deep networks for surface normal estimation
Wang, X., Fouhey, D. F., & Gupta, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298652 · Cited by 338
Recognizing scene viewpoint using panoramic place representation
Xiao, J., Ehinger, K. A., Oliva, A., & Torralba, A. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247991 · Cited by 318
Blocks World Revisited: Image Understanding Using Qualitative Geometry and Mechanics
Gupta, A., Efros, A. A., & Hebert, M. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_35 · Cited by 308
CASENet: Deep Category-Aware Semantic Edge Detection
Yu, Z., Feng, C., Liu, M.-Y., & Ramalingam, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.191 · Cited by 300
Cross-View Semantic Segmentation for Sensing Surroundings
Pan, B., Sun, J., Leung, H. Y. T., Andonian, A., & Zhou, B. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3004325 · Cited by 291
Kimera: From SLAM to spatial perception with 3D dynamic scene graphs
Rosinol, A., Violette, A., Abate, M., Hughes, N., Chang, Y., Shi, J., Gupta, A., & Carlone, L. (2021) · The International Journal of Robotics Research · doi:10.1177/02783649211056674 · Cited by 271
LayoutNet: Reconstructing the 3D Room Layout from a Single RGB Image
Zou, C., Colburn, A., Shan, Q., & Hoiem, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00219 · Cited by 257
Self-citationNie, Y., Han, X., Guo, S., Zheng, Y., Chang, J., & Zhang, J. J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00013 · Cited by 238
Marr Revisited: 2D-3D Alignment via Surface Normal Prediction
Bansal, A., Russell, B., & Gupta, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.642 · Cited by 213
Scene Parsing by Integrating Function, Geometry and Appearance Models
Zhao, Y., & Zhu, S.-C. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.401 · Cited by 135
Grauman, K., & Leibe, B. (2011) · Synthesis Lectures on Artificial Intelligence and Machine Learning · doi:10.2200/s00332ed1v01y201103aim011 · Cited by 126
Omni3D: A Large Benchmark and Model for 3D Object Detection in the Wild
Brazil, G., Kumar, A., Straub, J., Ravi, N., Johnson, J., & Gkioxari, G. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01264 · Cited by 111
Rent3D: Floor-plan priors for monocular layout estimation
Liu, C., Schwing, A. G., Kundu, K., Urtasun, R., & Fidler, S. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298963 · Cited by 104
BEV-Seg: Bird's Eye View Semantic Segmentation Using Geometry and Semantic Point Cloud
Ng, M. H., Radia, K., Chen, J., Wang, D., Gog, I., & Gonzalez, J. E. (2020) · arXiv · doi:10.48550/arxiv.2006.11436 · Cited by 40
Complete 3D Scene Parsing from an RGBD Image
Zou, C., Guo, R., Li, Z., & Hoiem, D. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-018-1133-z · Cited by 31
“3D reconstruction produce detailed literal geometric models, such as 3D point clouds or meshes, from multiple images [12], or coarse interpreted models, such as boxy objects within a box-shaped room [21], from one image. This paper introduces an approach to recover complete 3D models of indoor objects and layout surfa…”
BackgroundMethodSelf-citationDepth and motion cues with phosphene patterns for prosthetic vision
Perez-Yus, A., Bermudez-Cameo, J., Guerrero, J. J., & Lopez-Nicolas, G. (2017) · 2017 IEEE International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw.2017.179 · Cited by 24
“Taking this assumption into account, denoted as Manhattan world assumption, some works have been proposed for recovering the scene layout [26, 20, 16], or just the orientation of the scene [10] as we do in this work.”
MethodIndoor scenes understanding for visual prosthesis with fully convolutional networks
Sanchez-Garcia, M., Martinez-Cantin, R., & Guerrero, J. (2019) · Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications · doi:10.5220/0007257602180225 · Cited by 16
Metadata
- Authors
- Hedau, V., Hoiem, D., & Forsyth, D.
- Venue
- 2009 IEEE 12th International Conference on Computer Vision
- Publisher
- IEEE
- Published
- 2009-09
- Pages
- 1849-1856
- OpenAlex
- W2534523274
- Cited by
- 487
- References
- 22
- FWCI
- 17.99
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.