The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Make3D: Learning 3D Scene Structure from a Single Still Image
Abstract
We consider the problem of estimating detailed 3D structure from a single still image of an unstructured environment. Our goal is to create 3D models that are both quantitatively accurate as well as visually pleasing. For each small homogeneous patch in the image, we use a Markov Random Field (MRF) to infer a set of "plane parameters" that capture both the 3D location and 3D orientation of the patch. The MRF, trained via supervised learning, models both image depth cues as well as the relationships between different parts of the image. Other than assuming that the environment is made up of a number of small planes, our model makes no explicit assumptions about the structure of the scene; this enables the algorithm to capture much more detailed 3D structure than does prior art and also give a much richer experience in the 3D flythroughs created using image-based rendering, even for scenes with significant nonvertical structure. Using this approach, we have created qualitatively correct 3D models for 64.9 percent of 588 images downloaded from the Internet. We have also extended our model to produce large-scale 3D models from a few images.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
SURF: Speeded Up Robust Features
Bay, H., Tuytelaars, T., & Van Gool, L. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_32 · Cited by 14,955 · cited 1×
“We start by computing 128 SURF features [34], and then calculate matches based on the Euclidean distances between the features found.”
MethodPattern Recognition and Machine Learning
(2007) · Kybernetes · doi:10.1108/03684920710743466 · Cited by 8,265
A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms
Scharstein, D., & Szeliski, R. (2002) · International Journal of Computer Vision · doi:10.1023/a:1014573219977 · Cited by 6,740
Efficient Graph-Based Image Segmentation
Felzenszwalb, P. F., & Huttenlocher, D. P. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000022288.19776.77 · Cited by 6,176
Computer Vision: A Modern Approach
Forsyth, D. A., & Ponce, J. (2002) · Cited by 3,739
Photo tourism: exploring photo collections in 3D
Snavely, N., Seitz, S. M., & Szeliski, R. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141964 · Cited by 2,866
Learning to detect natural image boundaries using local brightness, color, and texture cues
Martin, D. R., Fowlkes, C. C., & Malik, J. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.1273918 · Cited by 2,420
Zhang, R., Tsai, P.-S., Cryer, J. E., & Shah, M. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.784284 · Cited by 1,731
(1995) · Medical Entomology and Zoology · Cited by 1,212
A taxonomy and evaluation of dense two-frame stereo correspondence algorithms
Scharstein, D., Szeliski, R., & Zabih, R. (2002) · Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001) · doi:10.1109/smbv.2001.988771 · Cited by 1,084
(2005) · Cited by 981
Visual Modeling with a Hand-Held Camera
Pollefeys, M., Van Gool, L., Vergauwen, M., Verbiest, F., Cornelis, K., Tops, J., & Koch, R. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000025798.50602.3a · Cited by 874
Putting Objects in Perspective
Hoiem, D., Efros, A. A., & Hebert, M. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-008-0137-5 · Cited by 805
Contextual Priming for Object Detection
Torralba, A. (2003) · International Journal of Computer Vision · doi:10.1023/a:1023052124951 · Cited by 776
Photo tourism: exploring photo collections in 3D
Snavely, N., Seitz, S. M., & Szeliski, R. (2006) · ACM SIGGRAPH 2006 Papers on - SIGGRAPH '06 · doi:10.1145/1179352.1141964 · Cited by 696
Geometric context from a single image
Hoiem, D., Efros, A. A., & Hebert, M. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.107 · Cited by 662
Criminisi, A., Reid, I., & Zisserman, A. (2000) · International Journal of Computer Vision · doi:10.1023/a:1026598000963 · Cited by 618
3-D Depth Reconstruction from a Single Still Image
Saxena, A., Chung, S. H., & Ng, A. Y. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0071-y · Cited by 600
Self-citationHigh speed obstacle avoidance using monocular vision and reinforcement learning
Michels, J., Saxena, A., & Ng, A. Y. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102426 · Cited by 394
Self-citationDepth estimation from image structure
Torralba, A., & Oliva, A. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1033214 · Cited by 343
Using the Forest to See the Trees: A Graphical Model Relating Features, Objects, and Scenes
Murphy, K. P., Torralba, A. B., & Freeman, W. T. (2003) · Cited by 312
Putting Objects in Perspective
Hoiem, D., Efros, A. A., & Hebert, M. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.232 · Cited by 258
A Dynamic Bayesian Network Model for Autonomous 3D Reconstruction from a Single Indoor Image
Delage, E., Lee, H., & Ng, A. Y. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.23 · Cited by 225
Self-citationLearning 3-D Scene Structure from a Single Still Image
Saxena, A., Sun, M., & Ng, A. Y. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4408828 · Cited by 223
Self-citationDepth estimation using monocular and stereo cues
Saxena, A., Schulte, J., & Ng, A. Y. (2007) · International Joint Conference on Artificial Intelligence · Cited by 215
Self-citationComputing Local Surface Orientation and Shape from Texture for Curved Surfaces
Malik, J., & Rosenholtz, R. E. (1997) · International Journal of Computer Vision · doi:10.1023/a:1007958829620 · Cited by 214
Multi viewpoint stereo from uncalibrated video sequences
Koch, R., Pollefeys, M., & Van Gool, L. (1998) · Lecture Notes in Computer Science · doi:10.1007/bfb0055659 · Cited by 176
Robotic Grasping of Novel Objects
Saxena, A., Driemeyer, J., Kearns, J., & Ng, A. Y. (2007) · The MIT Press eBooks · doi:10.7551/mitpress/7503.003.0156 · Cited by 155
Self-citationExample Based 3D Reconstruction from Single 2D Images
Hassner, T., & Basri, R. (2006) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2006.76 · Cited by 131
Bayesian Reconstruction of 3D Shapes and Scenes From A Single Image
(2008) · Cited by 94
Multi-conditional learning: generative/discriminative training for clustering and classification
McCallum, A., Pal, C., Druck, G., & Wang, X. (2006) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 92
Shape from texture from a multi-scale perspective
Tony Lindeberg, C., & Gårding, J. (2002) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.1993.378146 · Cited by 85
Depth from Familiar Objects: A Hierarchical Model for 3D Scenes
Sudderth, E. B., Torralba, A. B., Freeman, W. T., & Willsky, A. S. (2006) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2006.97 · Cited by 65
Make3D: depth perception from a single still image
Saxena, A., Sun, M., & Ng, A. Y. (2008) · National Conference on Artificial Intelligence · Cited by 63
Self-citationA Survey of Motion-Parallax-Based 3-D Reconstruction Algorithms
Lu, Y., Zhang, J., Wu, Q., & Li, Z. (2004) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/tsmcc.2004.829300 · Cited by 50
HMM-based surface reconstruction from single images
Nagai, T., Naruse, T., Ikehara, M., & Kurematsu, A. (2003) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2002.1040012 · Cited by 42
Loomis, J. M. (2001) · Nature · doi:10.1038/35102648 · Cited by 30
3-D Reconstruction from Sparse Views using Monocular Vision
Saxena, A., Sun, M., & Ng, A. Y. (2007) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2007.4409219 · Cited by 24
Self-citationUsing depth features to retrieve monocular video shots
Ewerth, R., Schwalb, M., & Freisleben, B. (2007) · ACM International Conference on Image and Video Retrieval (CIVR) · doi:10.1145/1282280.1282315 · Cited by 9
Cited by
Depth Map Prediction from a Single Image using a Multi-Scale Deep Network
Eigen, D., Puhrsch, C., & Fergus, R. (2014) · arXiv · doi:10.48550/arxiv.1406.2283 · Cited by 3,442
Unsupervised Monocular Depth Estimation with Left-Right Consistency
Godard, C., Aodha, O. M., & Brostow, G. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.699 · Cited by 3,270
What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?
Kendall, A., & Gal, Y. (2017) · arXiv · doi:10.48550/arxiv.1703.04977 · Cited by 3,088
Unsupervised Learning of Depth and Ego-Motion from Video
Zhou, T., Brown, M., Snavely, N., & Lowe, D. G. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.700 · Cited by 2,910
Digging Into Self-Supervised Monocular Depth Estimation
Godard, C., Aodha, O. M., Firman, M., & Brostow, G. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00393 · Cited by 2,561
Metadata
- Authors
- Saxena, A., Sun, M., & Ng, A. Y.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2009-05
- Volume
- 31
- Issue
- 5
- Pages
- 824-840
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2132947399
- Cited by
- 1,736
- References
- 42
- FWCI
- 72.93
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.