The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
ScanComplete: Large-Scale Scene Completion and Semantic Segmentation for 3D Scans
Open accessAbstract
We introduce ScanComplete, a novel data-driven approach for taking an incomplete 3D scan of a scene as input and predicting a complete 3D model along with per-voxel semantic labels. The key contribution of our method is its ability to handle large scenes with varying spatial extent, managing the cubic growth in data size as scene size increases. To this end, we devise a fully-convolutional generative 3D CNN model whose filter kernels are invariant to the overall scene size. The model can be trained on scene subvolumes but deployed on arbitrarily large scenes at test time. In addition, we propose a coarse-to-fine inference strategy in order to produce high-resolution output while also leveraging large input context sizes. In an extensive series of experiments, we carefully evaluate different model design choices, considering both deterministic and probabilistic models for completion and semantic inference. Our results show that we outperform other methods not only in the size of the environments handled and processing efficiency, but also with regard to completion quality and semantic segmentation performance by a significant margin.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Multi-scale context aggregation by dilated convolutions
Yu, F., & Koltun, V. (2015) · arXiv · doi:10.48550/arxiv.1511.07122 · Cited by 7,738
ScanNet: Richly-Annotated 3D Reconstructions of Indoor Scenes
Dai, A., Chang, A. X., Savva, M., Halber, M., Funkhouser, T., & Niessner, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.261 · Cited by 4,368
Self-citationKinectFusion: Real-time dense surface mapping and tracking
Newcombe, R. A., Fitzgibbon, A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A. J., Kohi, P., Shotton, J., & Hodges, S. (2011) · 2011 10th IEEE International Symposium on Mixed and Augmented Reality · doi:10.1109/ismar.2011.6092378 · Cited by 4,008
VoxNet: A 3D Convolutional Neural Network for real-time object recognition
Maturana, D., & Scherer, S. (2015) · 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353481 · Cited by 3,458
A volumetric method for building complex models from range images
Curless, B., & Levoy, M. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237269 · Cited by 3,124
ShapeNet: An Information-Rich 3D Model Repository
Chang, A. X., Funkhouser, T., Guibas, L., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., et al. (2015) · arXiv · doi:10.48550/arxiv.1512.03012 · Cited by 2,330
Screened poisson surface reconstruction
Kazhdan, M., & Hoppe, H. (2013) · ACM Transactions on Graphics · doi:10.1145/2487228.2487237 · Cited by 2,231
Poisson Surface Reconstruction
Kazhdan, M. M., Bolitho, M., & Hoppe, H. (2006) · doi:10.2312/sgp/sgp06/061-070 · Cited by 2,125
KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera
Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., et al. (2011) · Proceedings of the 24th annual ACM symposium on User interface software and technology · doi:10.1145/2047196.2047270 · Cited by 2,110
ShapeNet: An Information-Rich 3D Model Repository
Chang, A. X., Funkhouser, T. A., Guibas, L. J., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., et al. (2023) · doi:10.5281/zenodo.10089705 · Cited by 1,623
OctNet: Learning Deep 3D Representations at High Resolutions
Riegler, G., Ulusoy, A. O., & Geiger, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.701 · Cited by 1,589
Volumetric and Multi-view CNNs for Object Classification on 3D Data
Qi, C. R., Su, H., NieBner, M., Dai, A., Yan, M., & Guibas, L. J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.609 · Cited by 1,504
Self-citationSemantic Scene Completion from a Single Depth Image
Song, S., Yu, F., Zeng, A., Chang, A. X., Savva, M., & Funkhouser, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.28 · Cited by 1,209
Real-time 3D reconstruction at scale using voxel hashing
Nießner, M., Zollhöfer, M., Izadi, S., & Stamminger, M. (2013) · ACM Transactions on Graphics · doi:10.1145/2508363.2508374 · Cited by 1,002
O-CNN: octree-based convolutional neural networks for 3D shape analysis
Wang, P.-S., Liu, Y., Guo, Y.-X., Sun, C.-Y., & Tong, X. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073608 · Cited by 884
ElasticFusion: Dense SLAM Without A Pose Graph
Whelan, T., Leutenegger, S., Salas Moreno, R., Glocker, B., & Davison, A. (2015) · Robotics: Science and Systems XI · doi:10.15607/rss.2015.xi.001 · Cited by 835
Octree Generating Networks: Efficient Convolutional Architectures for High-resolution 3D Outputs
Tatarchenko, M., Dosovitskiy, A., & Brox, T. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.230 · Cited by 742
BundleFusion: Real-Time Globally Consistent 3D Reconstruction Using On-the-Fly Surface Reintegration
Dai, A., Nießner, M., Zollhöfer, M., Izadi, S., & Theobalt, C. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3054739 · Cited by 662
Self-citationShape Completion Using 3D-Encoder-Predictor CNNs and Shape Synthesis
Dai, A., Qi, C. R., & NieBner, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.693 · Cited by 633
Self-citationPartial and approximate symmetry detection for 3D geometry
Mitra, N. J., Guibas, L. J., & Pauly, M. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141924 · Cited by 529
Discovering structural regularity in 3D geometry
Pauly, M., Mitra, N. J., Wallner, J., Pottmann, H., & Guibas, L. J. (2008) · ACM SIGGRAPH 2008 papers · doi:10.1145/1399504.1360642 · Cited by 343
Nealen, A., Igarashi, T., Sorkine, O., & Alexa, M. (2006) · Proceedings of the 4th international conference on Computer graphics and interactive techniques in Australasia and Southeast Asia · doi:10.1145/1174429.1174494 · Cited by 340
Hierarchical Surface Prediction for 3D Object Reconstruction
Hane, C., Tulsiani, S., & Malik, J. (2017) · 2017 International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2017.00054 · Cited by 307
Han, X., Li, Z., Huang, H., Kalogerakis, E., & Yu, Y. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.19 · Cited by 304
Very High Frame Rate Volumetric Integration of Depth Images on Mobile Devices
Kahler, O., Adrian Prisacariu, V., Yuheng Ren, C., Sun, X., Torr, P., & Murray, D. (2015) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2015.2459891 · Cited by 294
Discovering structural regularity in 3D geometry
Pauly, M., Mitra, N. J., Wallner, J., Pottmann, H., & Guibas, L. J. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360642 · Cited by 247
A search-classify approach for cluttered indoor scene understanding
Nan, L., Xie, K., & Sharf, A. (2012) · ACM Transactions on Graphics · doi:10.1145/2366145.2366156 · Cited by 240
Example-Based 3D Scan Completion
Pauly, M., Mitra, N. J., Giesen, J., Groß, M. H., & Guibas, L. (2005) · doi:10.2312/sgp/sgp05/023-032 · Cited by 233
A robust hole-filling algorithm for triangular mesh
Zhao, W., Gao, S., & Lin, H. (2007) · The Visual Computer · doi:10.1007/s00371-007-0167-y · Cited by 223
An interactive approach to semantic modeling of indoor scenes with an RGBD camera
Shao, T., Xu, W., Zhou, K., Wang, J., Li, D., & Guo, B. (2012) · ACM Transactions on Graphics · doi:10.1145/2366145.2366155 · Cited by 218
Thrun, S., & Wegbreit, B. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.221 · Cited by 216
Database‐Assisted Object Retrieval for Real‐Time 3D Reconstruction
Li, Y., Dai, A., Guibas, L., & Nießner, M. (2015) · Computer Graphics Forum · doi:10.1111/cgf.12573 · Cited by 193
Self-citationStructured Prediction of Unobserved Voxels from a Single Depth Image
Firman, M., Aodha, O. M., Julier, S., & Brostow, G. J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.586 · Cited by 177
OctNetFusion: Learning Depth Fusion from Data
Riegler, G., Ulusoy, A. O., Bischof, H., & Geiger, A. (2017) · 2017 International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2017.00017 · Cited by 177
Acquiring 3D indoor environments with variability and repetition
Kim, Y. M., Mitra, N. J., Yan, D.-M., & Guibas, L. (2012) · ACM Transactions on Graphics · doi:10.1145/2366145.2366157 · Cited by 174
Sorkine, O., & Cohen-Or, D. (2004) · Proceedings Shape Modeling Applications, 2004. · doi:10.1109/smi.2004.1314506 · Cited by 173
Data-driven structural priors for shape completion
Sung, M., Kim, V. G., Angst, R., & Guibas, L. (2015) · ACM Transactions on Graphics · doi:10.1145/2816795.2818094 · Cited by 170
Completing 3D object shape from one depth image
Rock, J., Gupta, T., Thorsen, J., Gwak, J., Shin, D., & Hoiem, D. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298863 · Cited by 154
Approximate Symmetry Detection in Partial 3D Meshes
Sipiran, I., Gregor, R., & Schreck, T. (2014) · Computer Graphics Forum · doi:10.1111/cgf.12481 · Cited by 124
A Field Model for Repairing 3D Shapes
Nguyen, D. T., Hua, B., Tran, M.-K., Pham, Q.-H., & Yeung, S.-K. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.612 · Cited by 106
A Symmetry Prior for Convex Variational 3D Reconstruction
Speciale, P., Oswald, M. R., Cohen, A., & Pollefeys, M. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46484-8_19 · Cited by 55
Cited by
Deep Learning for 3D Point Clouds: A Survey
Guo, Y., Wang, H., Hu, Q., Liu, H., Liu, L., & Bennamoun, M. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3005434 · Cited by 2,398
SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR Sequences
Behley, J., Garbade, M., Milioto, A., Quenzel, J., Behnke, S., Stachniss, C., & Gall, J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00939 · Cited by 2,294
Deep Learning for LiDAR Point Clouds in Autonomous Driving: A Review
Li, Y., Ma, L., Zhong, Z., Liu, F., Chapman, M. A., Cao, D., & Li, J. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3015992 · Cited by 611
Local Implicit Grid Representations for 3D Scenes
Jiang, C., Sud, A., Makadia, A., Huang, J., NieBner, M., & Funkhouser, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00604 · Cited by 526
TopNet: Structural Point Cloud Decoder
Tchapmi, L. P., Kosaraju, V., Rezatofighi, H., Reid, I., & Savarese, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00047 · Cited by 516
Metadata
- Authors
- Dai, A., Ritchie, D., Bokeloh, M., Reed, S., Sturm, J., & Niessner, M.
- Venue
- 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2018-06
- Pages
- 4578-4587
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2963640720
- Cited by
- 311
- References
- 42
- FWCI
- 60.62
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.