The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
LayoutNet: Reconstructing the 3D Room Layout from a Single RGB Image
Open accessAbstract
We propose an algorithm to predict room layout from a single image that generalizes across panoramas and perspective images, cuboid layouts and more general layouts (e.g. "L"-shape room). Our method operates directly on the panoramic image, rather than decomposing into perspective images as do recent works. Our network architecture is similar to that of RoomNet [15], but we show improvements due to aligning the image based on vanishing points, predicting multiple layout elements (corners, boundaries, size and translation), and fitting a constrained Manhattan layout to the resulting predictions. Our method compares well in speed and accuracy to other existing work on panoramas, achieves among the best accuracy for perspective images, and can handle both cuboid-shaped and more general Manhattan layouts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Indoor segmentation and support inference from rgbd images
Silberman, N., Hoiem, D., Kohli, P., & Fergus, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33715-4_54 · Cited by 5,760
Self-citationAlgorithm 778: L-BFGS-B: Fortran subroutines for large-scale bound-constrained optimization
Zhu, C., Byrd, R. H., Lu, P., & Nocedal, J. (1997) · ACM Transactions on Mathematical Software · doi:10.1145/279232.279236 · Cited by 3,462
LSD: A Fast Line Segment Detector with a False Detection Control
von Gioi, R. G., Jakubowicz, J., Morel, J.-M., & Randall, G. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.300 · Cited by 1,946
Geometric context from a single image
Hoiem, D., Efros, A. A., & Hebert, M. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.107 · Cited by 662
Self-citationJoint 2D-3D-Semantic Data for Indoor Scene Understanding
Armeni, I., (Sasha), A. S., Zamir, A., & Savarese, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.01105 · Cited by 621
Recovering the spatial layout of cluttered rooms
Hedau, V., Hoiem, D., & Forsyth, D. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459411 · Cited by 487
Self-citationManhattan World: compass direction from a single image by Bayesian inference
Coughlan, J. M., & Yuille, A. L. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790349 · Cited by 475
Geometric reasoning for single image structure recovery
Lee, D. C., Hebert, M., & Kanade, T. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206872 · Cited by 407
Estimating Spatial Layout of Rooms using Volumetric Reasoning about Objects and Surfaces
Lee, D. C., Gupta, A., Hebert, M., & Takeo Kanade, A. (2018) · doi:10.1184/r1/6554765 · Cited by 252
Thinking Inside the Box: Using Appearance Models and Context Based on Room Geometry
Hedau, V., Hoiem, D., & Forsyth, D. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15567-3_17 · Cited by 249
Self-citationPanoContext: A Whole-Room 3D Context Model for Panoramic Scene Understanding
Zhang, Y., Song, S., Tan, P., & Xiao, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10599-4_43 · Cited by 241
A Dynamic Bayesian Network Model for Autonomous 3D Reconstruction from a Single Indoor Image
Delage, E., Lee, H., & Ng, A. Y. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.23 · Cited by 225
RoomNet: End-to-End Room Layout Estimation
Lee, C.-Y., Badrinarayanan, V., Malisiewicz, T., & Rabinovich, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.521 · Cited by 180
Izadinia, H., Shan, Q., & Seitz, S. M. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.260 · Cited by 159
Self-citationDeLay: Robust Spatial Layout Estimation for Cluttered Indoor Scenes
Dasgupta, S., Fang, K., Chen, K., & Savarese, S. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.73 · Cited by 144
Learning Informative Edge Maps for Indoor Scene Layout Prediction
Mallya, A., & Lazebnik, S. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.113 · Cited by 141
Bayesian geometric modeling of indoor scenes
Pero, L. D., Bowdish, J., Fried, D., Kermgard, B., Hartley, E., & Barnard, K. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247994 · Cited by 140
Scene Parsing by Integrating Function, Geometry and Appearance Models
Zhao, Y., & Zhu, S.-C. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.401 · Cited by 135
Efficient structured prediction for 3D indoor scene understanding
Schwing, A. G., Hazan, T., Pollefeys, M., & Urtasun, R. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6248006 · Cited by 123
Piecewise Planar and Compact Floorplan Reconstruction from Images
Cabral, R., & Furukawa, Y. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.546 · Cited by 123
Rent3D: Floor-plan priors for monocular layout estimation
Liu, C., Schwing, A. G., Kundu, K., Urtasun, R., & Fidler, S. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298963 · Cited by 104
Efficient Exact Inference for 3D Indoor Scene Understanding
Schwing, A. G., & Urtasun, R. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33783-3_22 · Cited by 104
A Coarse-to-Fine Indoor Layout Estimation (CFILE) Method
Ren, Y., Li, S., Chen, C., & Kuo, C. ‐. J. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-54193-8_3 · Cited by 96
Estimating the 3D Layout of Indoor Scenes and Its Clutter from Depth Sensors
Zhang, J., Chen, K., Schwing, A. G., & Urtasun, R. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.161 · Cited by 84
Understanding Bayesian Rooms Using Composite 3D Object Models
Pero, L. D., Bowdish, J., Kermgard, B., Hartley, E., & Barnard, K. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.27 · Cited by 82
Efficient 3D Room Shape Recovery from a Single Panorama
Yang, H., & Zhang, H. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.585 · Cited by 72
Manhattan Junction Catalogue for Spatial Reasoning of Indoor Scenes
Ramalingam, S., Pillai, J. K., Jain, A., & Taguchi, Y. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.394 · Cited by 67
Pano2CAD: Room Layout from a Single Panorama Image
Xu, J., Stenger, B., Kerola, T., et al. (2017) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2017.46 · Cited by 66
Predicting Complete 3D Models of Indoor ScenesPreprint
Guo, R., Zou, C., & Hoiem, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.02437 · Cited by 54
Self-citation
Cited by
Data-driven interior plan generation for residential buildings
Wu, W., Fu, X.-M., Tang, R., Wang, Y., Qi, Y.-H., & Liu, L. (2019) · ACM Transactions on Graphics · doi:10.1145/3355089.3356556 · Cited by 324
MonoScene: Monocular 3D Semantic Scene Completion
Cao, A.-Q., & de Charette, R. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00396 · Cited by 293
Structured3D: A Large Photo-Realistic Dataset for Structured 3D Modeling
Zheng, J., Zhang, J., Li, J., Tang, R., Gao, S., & Zhou, Z. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58545-7_30 · Cited by 282
BEV-Seg: Bird's Eye View Semantic Segmentation Using Geometry and Semantic Point Cloud
Ng, M. H., Radia, K., Chen, J., Wang, D., Gog, I., & Gonzalez, J. E. (2020) · arXiv · doi:10.48550/arxiv.2006.11436 · Cited by 40
Plan2Scene: Converting Floorplans to 3D Scenes
Vidanapathirana, M., Wu, Q., Furukawa, Y., Chang, A. X., & Savva, M. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01059 · Cited by 32
Metadata
- Authors
- Zou, C., Colburn, A., Shan, Q., & Hoiem, D.
- Venue
- 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2018-06
- Pages
- 2051-2059
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2962717701
- Cited by
- 257
- References
- 32
- FWCI
- 52.11
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.