The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Shape, Illumination, and Reflectance from Shading
Abstract
A fundamental problem in computer vision is that of inferring the intrinsic, 3D structure of the world from flat, 2D images of that world. Traditional methods for recovering scene properties such as shape, reflectance, or illumination rely on multiple observations of the same scene to overconstrain the problem. Recovering these same properties from a single image seems almost impossible in comparison-there are an infinite number of shapes, paint, and lights that exactly reproduce a single image. However, certain explanations are more likely than others: surfaces tend to be smooth, paint tends to be uniform, and illumination tends to be natural. We therefore pose this problem as one of statistical inference, and define an optimization problem that searches for the most likely explanation of a single image. Our technique can be viewed as a superset of several classic computer vision problems (shape-from-shading, intrinsic images, color constancy, illumination estimation, etc) and outperforms all previous solutions to those constituent problems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
A morphable model for the synthesis of 3D faces
Blanz, V., & Vetter, T. (1999) · Proceedings of the 26th annual conference on Computer graphics and interactive techniques - SIGGRAPH '99 · doi:10.1145/311535.311556 · Cited by 4,710
Land, E. H., & McCann, J. J. (1971) · Journal of the Optical Society of America · doi:10.1364/josa.61.000001 · Cited by 4,095
Bundle Adjustment — A Modern Synthesis
Triggs, B., McLauchlan, P. F., Hartley, R. I., & Fitzgibbon, A. W. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-44480-7_21 · Cited by 3,988
Relations between the statistics of natural images and the response properties of cortical cells
Field, D. J. (1987) · Journal of the Optical Society of America A · doi:10.1364/josaa.4.002379 · Cited by 3,241
Multiple view geometry in computer vision
Opower, H. (2002) · Optics and Lasers in Engineering · doi:10.1016/s0143-8166(01)00145-2 · Cited by 3,007
Image denoising using scale mixtures of gaussians in the wavelet domain
Portilla, J., Strela, V., Wainwright, M. J., & Simoncelli, E. P. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.818640 · Cited by 2,255
Photometric Method For Determining Surface Orientation From Multiple Images
Woodham, R. J. (1980) · Optical Engineering · doi:10.1117/12.7972479 · Cited by 2,003
Removing camera shake from a single photograph
Fergus, R., Singh, B., Hertzmann, A., Roweis, S. T., & Freeman, W. T. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141956 · Cited by 1,815
Make3D: Learning 3D Scene Structure from a Single Still Image
Saxena, A., Sun, M., & Ng, A. Y. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.132 · Cited by 1,736
Zhang, R., Tsai, P.-S., Cryer, J. E., & Shah, M. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.784284 · Cited by 1,731
Segmentation through variable-order surface fitting
Besl, P. J., & Jain, R. C. (1988) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.3881 · Cited by 1,074
Fields of Experts: A Framework for Learning Image Priors
Roth, S., & Black, M. J. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.160 · Cited by 1,039
Statistics of natural images: Scaling in the woods
Ruderman, D. L., & Bialek, W. (1994) · Physical Review Letters · doi:10.1103/physrevlett.73.814 · Cited by 920
Color constancy: a method for recovering surface spectral reflectance
Maloney, L. T., & Wandell, B. A. (1986) · Journal of the Optical Society of America A · doi:10.1364/josaa.3.000029 · Cited by 853
(1952) · Archives of Ophthalmology · doi:10.1001/archopht.1952.00920010678023 · Cited by 819
An efficient representation for irradiance environment maps
Ramamoorthi, R., & Hanrahan, P. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383317 · Cited by 769
Numerical shape from shading and occluding boundaries
Ikeuchi, K., & Horn, B. K. P. (1981) · Artificial Intelligence · doi:10.1016/0004-3702(81)90023-0 · Cited by 738
RECOVERING INTRINSIC SCENE CHARACTERISTICS FROM IMAGES
Barrow, H. G., & Tenenbaum, J. M. (1978) · Cited by 725
A novel algorithm for color constancy
Forsyth, D. A. (1990) · International Journal of Computer Vision · doi:10.1007/bf00056770 · Cited by 722
Recovering Surface Layout from an Image
Hoiem, D., Efros, A. A., & Hebert, M. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-0031-y · Cited by 674
Determining lightness from an image
Horn, B. K. P. (1974) · Computer Graphics and Image Processing · doi:10.1016/0146-664x(74)90022-7 · Cited by 635
Horn, B. K. P., & Brooks, M. J. (1989) · Medical Entomology and Zoology · Cited by 615
Color by correlation: a simple, unifying framework for color constancy
Finlayson, G. D., Hordley, S. D., & HubeL, P. M. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.969113 · Cited by 592
SHAPE FROM SHADING: A METHOD FOR OBTAINING THE SHAPE OF A SMOOTH OPAQUE OBJECT FROM ONE VIEW
Horn, B. K. P. (1970) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 534
Brainard, D. H., & Freeman, W. T. (1997) · Journal of the Optical Society of America A · doi:10.1364/josaa.14.001393 · Cited by 521
pLebensohn, J. E. (1952) · American Journal of Ophthalmology · doi:10.1016/0002-9394(52)91076-3 · Cited by 505
Belhumeur, P. N., Kriegman, D., & Yuille, A. (1999) · International Journal of Computer Vision · doi:10.1023/a:1008154927611 · Cited by 502
Statistics of natural images and models
Huang, J., & Mumford, D. (2003) · Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149) · doi:10.1109/cvpr.1999.786990 · Cited by 495
What Does the Occluding Contour Tell Us about Solid Shape?
Koenderink, J. J. (1984) · Perception · doi:10.1068/p130321 · Cited by 468
Obtaining Shape from Shading Information
Horn, B. K. P. (1975) · The MIT Press eBooks · Cited by 463
Ground truth dataset and baseline evaluations for intrinsic image algorithms
Grosse, R., Johnson, M. K., Adelson, E. H., & Freeman, W. T. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459428 · Cited by 426
Recovering intrinsic images from a single image
Tappen, M. F., Freeman, W. T., & Adelson, E. H. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.185 · Cited by 423
Inverse global illumination: recovering reflectance models of real scenes from photographs
Yu, Y., Debevec, P., Malik, J., & Hawkins, T. (1999) · Proceedings of the 26th annual conference on Computer graphics and interactive techniques - SIGGRAPH '99 · doi:10.1145/311535.311559 · Cited by 420
Self-citationPhotometric Stereo with General, Unknown Lighting
Basri, R., Jacobs, D., & Kemelmacher, I. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-8815-7 · Cited by 407
Real-time edge-aware image processing with the bilateral grid
Chen, J., Paris, S., & Durand, F. (2007) · ACM SIGGRAPH 2007 papers · doi:10.1145/1275808.1276506 · Cited by 394
Removing camera shake from a single photograph
Fergus, R., Singh, B., Hertzmann, A., Roweis, S. T., & Freeman, W. T. (2006) · ACM SIGGRAPH 2006 Papers on - SIGGRAPH '06 · doi:10.1145/1179352.1141956 · Cited by 391
Image Analysis Using Multigrid Relaxation Methods
Terzopoulos, D. (1986) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1986.4767767 · Cited by 370
Entropy Minimization for Shadow Removal
Finlayson, G. D., Drew, M. S., & Lu, C. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-009-0243-z · Cited by 349
Functional optimization for fair surface design
Moreton, H. P., & Séquin, C. H. (1992) · Proceedings of the 19th annual conference on Computer graphics and interactive techniques · doi:10.1145/133994.134035 · Cited by 327
Interpreting line drawings of curved objects
Malik, J. (1987) · International Journal of Computer Vision · doi:10.1007/bf00128527 · Cited by 322
Self-citationGilchrist, A. (2006) · Scientific American Mind · doi:10.1038/scientificamericanmind0606-42 · Cited by 291
Global Stereo Reconstruction under Second-Order Smoothness Priors
Woodford, O., Torr, P., Reid, I., & Fitzgibbon, A. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.131 · Cited by 245
Intrinsic Scene Properties from a Single RGB-D Image
Barron, J. T., & Malik, J. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.10 · Cited by 244
Self-citationColor lines: image specific color representation.
Omer, I., & Werman, M. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315267 · Cited by 217
The perception of shading and reflectance
Adelson, E. H., & Pentland, A. P. (1996) · Perception as Bayesian Inference · doi:10.1017/cbo9780511984037.014 · Cited by 200
Bell (2013) · doi:10.1145/2461912.2462002 · Cited by 200
Shape, albedo, and illumination from a single image of an unknown object
Barron, J. T., & Malik, J. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247693 · Cited by 160
Self-citationAn Extremum Principle for Shape from Contour
Brady, M., & Yuille, A. (1984) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1984.4767521 · Cited by 158
Color Constancy, Intrinsic Images, and Shape Estimation
Barron, J. T., & Malik, J. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33765-9_5 · Cited by 154
Self-citationHuang, J., Lee, A. B., & Mumford, D. (2002) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2000.855836 · Cited by 147
Statistical characterization of real-world illumination
Dror, R. O., Willsky, A. S., & Adelson, E. H. (2004) · Journal of Vision · doi:10.1167/4.9.11 · Cited by 138
Resolving the Generalized Bas-Relief Ambiguity by Entropy Minimization
Alldrin, N., Mallick, S. P., & Kriegman, D. J. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383208 · Cited by 115
Recovering Intrinsic Images with a Global Sparsity Prior On Reflectance
Gehler, P., Rother, C., Kiefel, M., et al. (2011) · Cited by 103
Romeiro, F., & Zickler, T. E. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15549-9_4 · Cited by 102
Recovering Intrinsic Images with a Global Sparsity Prior on Reflectance
Rother, C., Kiefel, M., Zhang, L., et al. (2011) · neural information processing systems · Cited by 86
Forsyth, D. A., & Zisserman, A. (1991) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.85657 · Cited by 80
High-frequency shape and albedo from shading using natural image statistics
Barron, J. T., & Malik, J. (2011) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2011.5995392 · Cited by 74
Self-citationVariable-Source Shading Analysis
Forsyth, D. A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-010-0396-9 · Cited by 36
Learning from examples with quadratic mutual information
Xu, D., & Príncipe, J. C. (2002) · Machine learning for signal processing ... · doi:10.1109/nnsp.1998.710645 · Cited by 25
Cited by
Eigen, D., & Fergus, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.304 · Cited by 2,862
Underexposed Photo Enhancement Using Deep Illumination Estimation
Wang, R., Zhang, Q., Fu, C.-W., Shen, X., Zheng, W.-S., & Jia, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00701 · Cited by 983
NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis
Srinivasan, P. P., Deng, B., Zhang, X., Tancik, M., Mildenhall, B., & Barron, J. T. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00741 · Cited by 515
Self-citationWang, J., Li, X., & Yang, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00192 · Cited by 465
NeRD: Neural Reflectance Decomposition from Image Collections
Boss, M., Braun, R., Jampani, V., Barron, J. T., Liu, C., & Lensch, H. P. A. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01245 · Cited by 438
Self-citation
Metadata
- Authors
- Barron, J. T., & Malik, J.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2015-08-01
- Volume
- 37
- Issue
- 8
- Pages
- 1670-1687
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2027560260
- Cited by
- 656
- References
- 60
- FWCI
- 101.18
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.