The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Joint 3D Scene Reconstruction and Class Segmentation
Abstract
Both image segmentation and dense 3D modeling from images represent an intrinsically ill-posed problem. Strong regularizers are therefore required to constrain the solutions from being 'too noisy'. Unfortunately, these priors generally yield overly smooth reconstructions and/or segmentations in certain regions whereas they fail in other areas to constrain the solution sufficiently. In this paper we argue that image segmentation and dense 3D reconstruction contribute valuable information to each other's task. As a consequence, we propose a rigorous mathematical framework to formulate and solve a joint segmentation and dense reconstruction problem. Image segmentations provide geometric cues about which surface orientations are more likely to appear at a certain location in space whereas a dense 3D reconstruction yields a suitable regularization for the segmentation problem by lifting the labeling from 2D images to 3D space. We show how appearance-based cues and 3D surface orientation priors can be learned from training data and subsequently used for class-specific regularization. Experimental results on several real data sets highlight the advantages of our joint formulation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms
Seitz, S. M., Curless, B., Diebel, J., Scharstein, D., & Szeliski, R. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.19 · Cited by 2,457
Discovering and exploiting 3D symmetries in structure from motion
Cohen, A., Zach, C., Sinha, S. N., & Pollefeys, M. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247841 · Cited by 67 · cited 1×
“To align the voxel grid with the scene we use the approach described in [5].”
MethodSelf-citation
Research works printed but not linked: 25
- 10.1007/s11263-007-0071-y · DOI · Paper page
- osher, 2004, Decomposition of images by the anisotropic Rudin-Osher-Fatemi model, Comm Pure Appl Math, 57, 1609, 10.1002/cpa.20045 · DOI · Paper page
- 10.1007/s11263-007-0044-1 · DOI
- liu, 2010, Order-preserving moves for graph-cut-based optimization, IEEE Trans Pattern Anal Mach Intell, 32, 1182, 10.1109/TPAMI.2009.120 · DOI
- 10.1109/TPAMI.2007.70713 · doi:10.1109/tpami.2007.70713
- 10.1109/CVPR.2007.383293 · DOI
- 10.1109/CVPR.2011.5995334 · doi:10.1109/cvpr.2011.5995334
- 10.5244/C.24.104 · DOI
- 10.1137/100805844 · DOI
- strecha, 2008, On benchmarking camera calibration and multi-view stereo for high resolution imagery, Proc CVPR
- 10.1109/ICCV.2011.6126551 · doi:10.1109/iccv.2011.6126551
- zach, 2008, Fast and high quality fusion of depth maps, Proc 3DPVT
- zach, 2012, What Is Optimized in Convex Relaxations for Multi-label Problems Connecting Discrete and Continuously-inspired MAP Inference
- 10.1109/CVPR.2012.6247860 · doi:10.1109/cvpr.2012.6247860
- 10.1109/CVPR.2010.5539801 · DOI · Paper page
- zach, 2007, A globally optimal algorithm for robust TV-L1 range image integration, Proc ICCV
- 10.1016/j.patrec.2008.04.005 · DOI · Paper page
- 10.1109/CVPR.2011.5995581 · DOI
- kolev, 2010, Anisotropic minimal surfaces integrating photoconsistency and normal information for multiview stereo, Proc ECCV, 538
- 10.1109/CVPR.2013.167 · DOI
- gould, 2010, The STAIR Vision Library
- 10.1109/CVPR.2010.5540067 · DOI
- 10.1007/s10851-010-0251-1 · DOI · Paper page
- 10.1109/CVPR.2011.5995693 · DOI · Paper page
- 10.1007/s11263-006-0031-y · DOI · Paper page
Cited by
Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I., & Leonard, J. J. (2016) · IEEE Transactions on Robotics · doi:10.1109/tro.2016.2624754 · Cited by 3,596
Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources
Zhu, X. X., Tuia, D., Mou, L., Xia, G.-S., Zhang, L., Xu, F., & Fraundorfer, F. (2017) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2017.2762307 · Cited by 3,400
Past, present, and future of simultaneous localization and mapping: Toward the robust-perception age
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I. D., & Leonard, J. J. (2016) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-138892 · Cited by 3,048
Pixelwise View Selection for Unstructured Multi-View Stereo
Schönberger, J. L., Zheng, E., Frahm, J.-M., & Pollefeys, M. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_31 · Cited by 2,315
Self-citationSemantic Scene Completion from a Single Depth Image
Song, S., Yu, F., Zeng, A., Chang, A. X., Savva, M., & Funkhouser, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.28 · Cited by 1,209
SUN3D: A Database of Big Spaces Reconstructed Using SfM and Object Labels
Xiao, J., Owens, A., & Torralba, A. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.458 · Cited by 803
The ApolloScape Dataset for Autonomous Driving
Huang, X., Cheng, X., Geng, Q., Cao, B., Zhou, D., Wang, P., Lin, Y., & Yang, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00141 · Cited by 679
Computer Vision for Autonomous Vehicles: Problems, Datasets and State of the Art
Janai, J., Güney, F., Behl, A., & Geiger, A. (2020) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000079 · Cited by 643
The ApolloScape Open Dataset for Autonomous Driving and Its Application
Huang, X., Wang, P., Cheng, X., Zhou, D., Geng, Q., & Yang, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2926463 · Cited by 615
The ApolloScape Open Dataset for Autonomous Driving and its Application
Huang, X., Wang, P., Cheng, X., Zhou, D., Geng, Q., & Yang, R. (2018) · arXiv · doi:10.48550/arxiv.1803.06184 · Cited by 615
Multimodal Classification of Remote Sensing Images: A Review and Future Directions
Gomez-Chova, L., Tuia, D., Moser, G., & Camps-Valls, G. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2449668 · Cited by 508
Pulling Things out of Perspective
Ladicky, L., Shi, J., & Pollefeys, M. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.19 · Cited by 457
Self-citationTowards unified depth and semantic prediction from a single image
Wang, P., Shen, X., Lin, Z., Cohen, S., Price, B., & Yuille, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298897 · Cited by 447
Komodakis, N., & Pesquet, J.-C. (2015) · IEEE Signal Processing Magazine · doi:10.1109/msp.2014.2377273 · Cited by 419
Discrete-Continuous Depth Estimation from a Single Image
Liu, M., Salzmann, M., & He, X. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.97 · Cited by 381
Video Object Segmentation without Temporal Information
Maninis, K.-K., Caelles, S., Chen, Y., Pont-Tuset, J., Leal-Taixe, L., Cremers, D., & Van Gool, L. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2838670 · Cited by 354
3DMV: Joint 3D-Multi-view Prediction for 3D Semantic Scene Segmentation
Dai, A., & Nießner, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_28 · Cited by 328
Comparative Evaluation of Hand-Crafted and Learned Local Features
Schonberger, J. L., Hardmeier, H., Sattler, T., & Pollefeys, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.736 · Cited by 310
Self-citationSchonberger, J. L., Pollefeys, M., Geiger, A., & Sattler, T. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00721 · Cited by 267
Self-citationDeep Marching Cubes: Learning Explicit Surface Representations
Liao, Y., Donne, S., & Geiger, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00308 · Cited by 255
Joint Semantic Segmentation and 3D Reconstruction from Monocular Video
Kundu, A., Li, Y., Dellaert, F., Li, F., & Rehg, J. M. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10599-4_45 · Cited by 220
Incremental dense semantic stereo fusion for large-scale semantic scene reconstruction
Vineet, V., Miksik, O., Lidegaard, M., Niebner, M., Golodetz, S., Prisacariu, V. A., Kahler, O., Murray, D. W., Izadi, S., Peerez, P., et al. (2015) · 2015 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2015.7138983 · Cited by 200
Blaha, M., Vogel, C., Richard, A., Wegner, J. D., Pock, T., & Schindler, K. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.346 · Cited by 88
Metadata
- Authors
- Hane, C., Zach, C., Cohen, A., Angst, R., & Pollefeys, M.
- Venue
- 2013 IEEE Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2013-06
- Pages
- 97-104
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2150134683
- Cited by
- 213
- References
- 2
- FWCI
- 52.32
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.