The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Intrinsic images in the wild
Abstract
Intrinsic image decomposition separates an image into a reflectance layer and a shading layer. Automatic intrinsic image decomposition remains a significant challenge, particularly for real-world scenes. Advances on this longstanding problem have been spurred by public datasets of ground truth data, such as the MIT Intrinsic Images dataset. However, the difficulty of acquiring ground truth data has meant that such datasets cover a small range of materials and objects. In contrast, real-world scenes contain a rich range of shapes and materials, lit by complex illumination. In this paper we introduce Intrinsic Images in the Wild , a large-scale, public dataset for evaluating intrinsic image decompositions of indoor scenes. We create this benchmark through millions of crowdsourced annotations of relative comparisons of material properties at pairs of points in each scene. Crowdsourcing enables a scalable approach to acquiring a large database, and uses the ability of humans to judge material comparisons, despite variations in illumination. Given our database, we develop a dense CRF-based intrinsic image algorithm for images in the wild that outperforms a range of state-of-the-art intrinsic image algorithms. Intrinsic image decomposition remains a challenging problem; we release our code and database publicly to support future research on this problem, available online at http://intrinsic.cs.cornell.edu/.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Land, E. H., & McCann, J. J. (1971) · Journal of the Optical Society of America · doi:10.1364/josa.61.000001 · Cited by 4,095
Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials
Krähenbühl, P., & Koltun, V. (2012) · arXiv · doi:10.48550/arxiv.1210.5644 · Cited by 2,908
A discriminatively trained, multiscale, deformable part model
Felzenszwalb, P., McAllester, D., & Ramanan, D. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587597 · Cited by 2,867
Maximum Likelihood Estimation of Observer Error-Rates Using the EM Algorithm
Dawid, A. P., & Skene, A. M. (1979) · Applied Statistics · doi:10.2307/2346806 · Cited by 1,692
The multidimensional wisdom of crowds
Welinder, P., Branson, S., Belongie, S., & Perona, P. (2010) · CaltechAUTHORS (California Institute of Technology) · Cited by 742
Shape, Illumination, and Reflectance from Shading
Barron, J. T., & Malik, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2377712 · Cited by 656
Deriving intrinsic images from image sequences
Weiss, Y. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937606 · Cited by 573
Ground truth dataset and baseline evaluations for intrinsic image algorithms
Grosse, R., Johnson, M. K., Adelson, E. H., & Freeman, W. T. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459428 · Cited by 426
Recovering intrinsic images from a single image
Tappen, M. F., Freeman, W. T., & Adelson, E. H. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.185 · Cited by 423
Visual Recognition with Humans in the Loop
Branson, S., Wah, C., Schroff, F., Babenko, B., Welinder, P., Perona, P., & Belongie, S. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_32 · Cited by 402
Fast High‐Dimensional Filtering Using the Permutohedral Lattice
Adams, A., Baek, J., & Davis, M. A. (2010) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2009.01645.x · Cited by 394
Image-based modeling and photo editing
Oh, B. M., Chen, M., Dorsey, J., & Durand, F. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383310 · Cited by 348
A comparative study of image retargeting
Rubinstein, M., Gutiérrez, D., Sorkine‐Hornung, O., & Shamir, A. (2010) · ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia) · doi:10.1145/1866158.1866186 · Cited by 343
A comparative study of image retargeting
Rubinstein, M. H., Gutiérrez, D., Sorkine, O., et al. (2010) · ACM Transactions on Graphics · doi:10.1145/1882261.1866186 · Cited by 269
Intrinsic Scene Properties from a Single RGB-D Image
Barron, J. T., & Malik, J. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.10 · Cited by 244
Color lines: image specific color representation.
Omer, I., & Werman, M. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315267 · Cited by 217
Bell (2013) · doi:10.1145/2461912.2462002 · Cited by 200
A Closed-Form Solution to Retinex with Nonlocal Texture Constraints
Zhao, Q., Tan, P., Dai, Q., et al. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.77 · Cited by 179
A Simple Model for Intrinsic Image Decomposition with Depth Cues
Chen, Q., & Koltun, V. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.37 · Cited by 179
Parameter Learning and Convergent Inference for Dense Random Fields
Krähenbühl, P., & Koltun, V. (2013) · International Conference on Machine Learning · Cited by 172
Shape, albedo, and illumination from a single image of an unknown object
Barron, J. T., & Malik, J. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247693 · Cited by 160
Intrinsic image decomposition with non-local texture cues
Li, S., Tan, P., & Lin, S. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587660 · Cited by 157
Color Constancy, Intrinsic Images, and Shape Estimation
Barron, J. T., & Malik, J. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33765-9_5 · Cited by 154
Perceiving Illumination Inconsistencies in Scenes
Ostrovsky, Y., Patrick Cavanagh, B., & Sinha, P. (2005) · Perception · doi:10.1068/p5418 · Cited by 149
Intrinsic images decomposition using a local and global sparse representation of reflectance
Li, S., & Yeo, C. (2011) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2011.5995738 · Cited by 139
Coherent intrinsic images from photo collections
Laffont, P.-Y., Bousseau, A., Paris, S., Durand, F., & George Drettakis, B. (2012) · ACM Transactions on Graphics · doi:10.1145/2366145.2366221 · Cited by 109
Recovering Intrinsic Images with a Global Sparsity Prior On Reflectance
Gehler, P., Rother, C., Kiefel, M., et al. (2011) · Cited by 103
Smooth and efficient zooming and panning
van Wijk, J. J., & Nuij, W. A. A. (2004) · IEEE Symposium on Information Visualization · doi:10.1109/infvis.2003.1249004 · Cited by 99
Estimating Intrinsic Component Images using Non-Linear Regression
Tappen, M. F., Adelson, E. H., & Freeman, W. T. (2006) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2006.114 · Cited by 95
Rich Intrinsic Image Decomposition of Outdoor Scenes from Multiple Views
Laffont, P., Bousseau, A., & Drettakis, G. (2012) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2012.112 · Cited by 78
Shape, Illumination, and Reflectance from Shading
Barron, J. T., & Malik, J. (2013) · Defense Technical Information Center (DTIC) · doi:10.21236/ada586648 · Cited by 59
Micro perceptual human computation for visual tasks
Gingold, Y. I., Shamir, A., & Cohen‐Or, D. (2012) · ACM Transactions on Graphics · doi:10.1145/2231816.2231817 · Cited by 51
Illumination decomposition for material recoloring with consistent interreflections
Carroll, R., Ramamoorthi, R., & Agrawala, M. (2011) · ACM Transactions on Graphics · doi:10.1145/2010324.1964938 · Cited by 44
Illumination decomposition for material recoloring with consistent interreflections
Carroll, R., Ramamoorthi, R., & Agrawala, M. (2011) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1964921.1964938 · Cited by 42
Statistical Invariance for Texture Synthesis
Liu, X., Jiang, L., Wong, T., & Fu, C. (2012) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2012.75 · Cited by 11
Cited by
Matterport3D: Learning from RGB-D Data in Indoor Environments
Chang, A., Dai, A., Funkhouser, T., Halber, M., Niebner, M., Savva, M., Song, S., Zeng, A., & Zhang, Y. (2017) · 2017 International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2017.00081 · Cited by 1,858
Network Dissection: Quantifying Interpretability of Deep Visual Representations
Bau, D., Zhou, B., Khosla, A., Oliva, A., & Torralba, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.354 · Cited by 1,389
Structure-Revealing Low-Light Image Enhancement Via Robust Retinex Model
Li, M., Liu, J., Yang, W., Sun, X., & Guo, Z. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2810539 · Cited by 1,245
Ordinal Depth Supervision for 3D Human Pose Estimation
Pavlakos, G., Zhou, X., & Daniilidis, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00763 · Cited by 411
Learning Blind Video Temporal Consistency
Lai, W.-S., Huang, J.-B., Wang, O., Shechtman, E., Yumer, E., & Yang, M.-H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01267-0_11 · Cited by 405
Metadata
- Authors
- Bell, S., Bala, K., & Snavely, N.
- Venue
- ACM Transactions on Graphics
- Published
- 2014-07-27
- Volume
- 33
- Issue
- 4
- Pages
- 1-12
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W2076491823
- Cited by
- 380
- References
- 35
- FWCI
- 68.34
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.